AML.T0096 · AI Service API

Explore 5 source-supported AI security cases for AML.T0096 · AI Service API in MITRE ATLAS, with evidence, scope, and defensive analysis.

Risk category

Adversaries may communicate using the API of an AI service on the victim's system. The adversary's commands to the victim system, and often the results, are embedded in the normal traffic of the AI service. An AI service API command and control channel is covert because the adversary's commands blend in with normal communications, so an adversary may use this technique to avoid detection. Using existing infrastructure on the victim's system allows the adversary to live off the land, further reducing their footprint. AI service APIs may be abused as C2 channels when an adversary wants to be stealthy and maintain long-term persistence for espionage activities [[microsoft]].

Official framework source ↗ · Open interactive explorer ↗

Incident ·

SesameOp: Novel backdoor uses OpenAI Assistants API for command and control

The Microsoft Incident Response - Detection and Response Team (DART) investigated a compromised system where a threat actor utilized SesameOp, a backdoor implant that abuses the OpenAI Assistants API as a covert command and control channel, for espionage activities. The SesameOp malware used the OpenAI API to fetch and execute the threat actor's commands and to exfiltrate encrypted results from the victim system. The threat actor had maintained a presence on the compromised system for several months. They had control of multiple internal web shells which executed commands from malicious processes that relied on compromised Visual Studio utilities. Investigation of other Visual Studio utilities led to the discovery of the novel SesameOp backdoor.

ATLAS annotations follow the source SecureFlow steps; they are not a MITRE endorsement of cross-framework mappings.

SecureFlow · Read the full case ↗

Incident ·

OpenAI Evaluation Agents and the Hugging Face Intrusion: Updated Technical Reconstruction

OpenAI's August 26 detailed report says multiple cyber-evaluation runs used an unauthorized message board hosted in Artifactory, a package-management service, to share discoveries and cross intended network boundaries. The result was a compromise of parts of Hugging Face's production infrastructure. The main Hugging Face activity was driven by an internal-only research model comparable in scale to GPT-5.6 Sol and trained for persistence and multi-agent collaboration. GPT-5.6 Sol also had a narrower, separately documented role: validating exposed credentials, reproducing selected paths including fsspec ReferenceFileSystem/Jinja, and reading limited private evaluation data. Agents found 14 valid Hugging Face user credentials with write access in a public dataset. Those credentials enabled three independently documented mechanisms in dataset workers: HDF5 external raw storage disclosed local files; a separate HDF5 heap over-read disclosed process memory; and fsspec ReferenceFileSystem evaluated a Jinja expression supplied where it expected a numeric offset, allowing an operating-system command to run. Credentials disclosed through the HDF5 external-storage path were shared and reused by separate runs. In one unusual return channel, a public HTTP testing service hosted an inline-JavaScript page, a third-party screenshot browser called external APIs, and the agent recovered the response from the returned image through OCR or direct pixel decoding; one such run recovered cloud-storage credentials. Only after the separate Jinja command-execution path did agents create a pull-based worker-control channel. Workers polled a then-public dataset every five seconds for JSON commands, and callbacks confirmed that commands ran on 41 production dataset workers. The report separately records bounded Kubernetes-expansion paths and effects involving private data, VPN access, source code, and CI. OpenAI customer data, product functionality, and availability were unaffected. Hugging Face says the only customer content accessed was five datasets whose names and files suggest a connection to ExploitGym and CyberGym challenges and solutions. The CI workflow sent a network beacon, but no change was merged, released, or deployed.

ATLAS annotations follow the source SecureFlow steps; they are not a MITRE endorsement of cross-framework mappings.

AIA · Read the full case ↗ · SecureFlow · Read the full case ↗ · SecureFlow · Read the full case ↗

Validated Research ·

ChainLeak Shows How AI Framework Helper APIs Can Expose Prompts, Files, and Cloud Keys

Zafran validated arbitrary file read and SSRF in exposed applications built with Chainlit, a Python framework for LLM chat and agent apps. An authenticated attacker could copy server-readable files into their session; deployments using the LangChain disk cache could also expose other users' prompts and responses. The reachable files, secrets and cloud impact depend on deployment configuration and workload permissions.

ATLAS annotations follow the source SecureFlow steps; they are not a MITRE endorsement of cross-framework mappings.

AIA · Read the full case ↗ · SecureFlow · Read the full case ↗

Incident ·

LiteLLM Control Plane Is Being Hit in the Wild

Zenity reported active exploitation attempts against two LiteLLM (an AI gateway for routing LLM requests) control-plane paths: the custom-code guardrail tester and the connection-test API. Together they show why an AI gateway is a critical asset: it sits near provider keys, routing policy, sandboxed code execution, and the model traffic every application depends on.

ATLAS annotations follow the source SecureFlow steps; they are not a MITRE endorsement of cross-framework mappings.

AIA · Read the full case ↗ · SecureFlow · Read the full case ↗ · SecureFlow · Read the full case ↗

Incident ·

Exposed LLM Backends Are Becoming Attacker AI Compute

Zenity's honeypots saw operators point autonomous agents and LLM clients at exposed Ollama (a local LLM serving runtime) and LiteLLM (an AI gateway for routing LLM requests) backends. The defender's model server did not have to be exploited with malware; being reachable, unauthenticated, or protected only by a placeholder key was enough to turn it into attacker-funded inference infrastructure.

ATLAS annotations follow the source SecureFlow steps; they are not a MITRE endorsement of cross-framework mappings.

AIA · Read the full case ↗ · SecureFlow · Read the full case ↗