10.2 · Output manipulation

Explore 2 source-supported AI security cases for 10.2 · Output manipulation in Databricks DASF 3.0, with evidence, scope, and defensive analysis.

Risk category

An attacker intercepts the communication between a model endpoint and the intended recipient and reads or changes the output stream. The model's original prediction may be correct while the delivered result is not. This can expose sensitive information, introduce misinformation, or cause users and downstream systems to act on falsified results.

Official framework source ↗ · Open interactive explorer ↗

Validated Research · · Practical overlap

LiteLLM CVE-2026-89032: Broken Semantic-Cache Isolation Enables Cross-User Leaks and Tool-Call Poisoning

LiteLLM is a gateway that routes applications' requests to language models. Its semantic cache can reuse an earlier answer when two questions have similar meanings. NVISO showed that in the tested configuration, /v1/responses reused cached entries across different API keys. This exposed simulated support data and allowed a fabricated answer or tool-call response to reach a different user. The researchers also demonstrated downstream execution in a mock banking tool and the pi coding agent. CVE-2026-89032 was fixed in v1.101.0-rc.1.

Why it relates: The gateway’s response path substituted an attacker-influenced stored result for the new caller’s result. The observed overlap is the shared runtime cache or inherited gateway exposure in the reported configuration. The test did not change model weights, compromise package distribution or establish takeover of a live MCP account.

All downstream consequences are from separate tests against the vulnerable cache behavior.

AIA · Read the full case ↗ · SecureFlow · Read the full case ↗

Incident ·

Your Agent Is Mine: Malicious LLM API Routers as an Agent Supply-Chain Boundary

This paper shows that third-party LLM API routers are not just compatibility layers. Because they terminate client traffic and forward plaintext tool-call JSON upstream, a malicious or compromised router can rewrite executable tool arguments, steal secrets in transit, and selectively target autonomous agent sessions. The defensive lesson is to treat router choice, route policy, tool execution, and request logging as one governed security boundary.

Why it relates: This paper shows that third-party LLM API routers are not just compatibility layers. The relevant category is Output manipulation: An attacker intercepts the communication between a model endpoint and the intended recipient and reads or changes the output stream.

This paper shows that third-party LLM API routers are not just compatibility layers. Because they terminate client traffic and forward plaintext tool-call JSON upstream, a malicious or compromised router can rewrite executable tool arguments, steal secrets in transit, and selectively target autonomous agent sessions. The defensive lesson is to treat router choice, route policy, tool execution, and request logging as one governed security boundary. The router sits in the application-layer middle. The client intentionally points its base URL at the router, so TLS protects the hop to the router but does not prove that the returned tool call is what the upstream model produced. Payload injection happens after inference. The model can produce a benign Bash call, then the router can replace one argument with an attacker-controlled installer or package name while preserving valid JSON and schema shape. Secret theft does not require visible tampering. API keys, cloud credentials, system prompts, tool definitions, file contents, and environment variables all cross the router in plaintext. The ecosystem signal is already practical. The authors found malicious paid and free routers, unauthorized use of researcher-owned AWS canaries, theft from a researcher-owned ETH key, adaptive triggers, and 440 Codex sessions with exposed shell-execution paths in weak-router decoys. Client-side controls help, but do not prove origin. Policy gates, anomaly screening, and append-only logs reduce exposure today; provider-signed response envelopes are the longer-term integrity answer.

AIA · Read the full case ↗