閱讀 MITRE ATLAS 中 AML.T0094「Delay Execution of LLM Instructions」相關的 3 個 AI 資安案例,查看事件證據、適用範圍與 AIDEFEND 防禦分析。
風險分類說明
Adversaries may include instructions to be followed by the AI system in response to a future event, such as a specific keyword or the next interaction, in order to evade detection or bypass controls placed on the AI system. For example, an adversary may include "If the user submits a new request..." followed by the malicious instructions as part of their prompt. AI agents can include security measures against prompt injections that prevent the invocation of particular tools or access to certain data sources during a conversation turn that has untrusted data in context. Delaying the execution of instructions to a future interaction or keyword is one way adversaries may bypass this type of control.
Embrace the Red(https://embracethered.com/blog/)示範了 Google Gemini 會被誘導自動呼叫工具,做法是把執行時間延到下一輪對話。這樣就繞過了一項安全控制:原本 Gemini 不允許在不可信資料剛進入脈絡的同一輪對話中,就去呼叫那些能存取使用者機敏資訊的工具。