AML.T0080.001 · Thread

Explore 3 source-supported AI security cases for AML.T0080.001 · Thread in MITRE ATLAS, with evidence, scope, and defensive analysis.

Risk category

Adversaries may introduce malicious instructions into a chat thread of a large language model (LLM) to cause behavior changes which persist for the remainder of the thread. A chat thread may continue for an extended period over multiple sessions. The malicious instructions may be introduced via Direct or Indirect Prompt Injection. Direct Injection may occur in cases where the adversary has acquired a user's LLM API keys and can inject queries directly into any thread. As the token limits for LLMs rise, AI systems can make use of larger context windows which allow malicious instructions to persist longer in a thread. Thread Poisoning may affect multiple users if the LLM is being used in a service with shared threads. For example, if an agent is active in a Slack channel with multiple participants, a single malicious message from one user can influence the agent's behavior in future interactions with others.

Official framework source ↗ · Open interactive explorer ↗

Validated Research ·

Prompt-Based Attacks Against Gemini via Calendar Invitations

SafeBreach demonstrated indirect prompt injection through Calendar invitations and email in Gemini web and Android applications. Retrieved instructions could immediately alter replies or invoke Calendar actions. Other routes retained instructions in conversation history and used a later victim interaction to invoke Google Home, open a website, or launch Zoom. In the Gmail exfiltration route, the initial reply first assembled a source URL containing another email subject; a later interaction opened that existing URL. These are distinct controlled demonstrations, not a single path requiring every impact or a confirmed malicious campaign.

ATLAS annotations follow the source SecureFlow steps; they are not a MITRE endorsement of cross-framework mappings.

SecureFlow · Read the full case ↗

Validated Research ·

AIKatz: Attacking LLM Desktop Applications

Researchers at Lumia have demonstrated that it is possible to extract authentication tokens from the memory of LLM Desktop Applications. An attacker could then use those tokens to impersonate the victim to the LLM backend, thereby gaining access to the victim's conversations as well as the ability to interfere in future conversations. The attacker's access would allow them the ability to directly inject prompts to change the LLM's behavior, poison the LLM's context to have persistent effects, manipulate the user's conversation history to cover their tracks, and ultimately impact the confidentiality, integrity, and availability of the system. The researchers demonstrated this on Anthropic Claude, Microsoft M365 Copilot, and OpenAI ChatGPT. Vendor Responses to Responsible Disclosure: - Anthropic (HackerOne) - Closed as informational since local attack. - Microsoft Security Response Center - Attack doesn't bypass security boundaries for CVE. - OpenAI (BugCrowd) - Closed as informational and noted that it's up to Microsoft to patch this behavior.

ATLAS annotations follow the source SecureFlow steps; they are not a MITRE endorsement of cross-framework mappings.

SecureFlow · Read the full case ↗