Lingua Ex Machina: When the AI Monitor Cannot See What the Executor Sees
Lingua Ex Machina reports a blind spot in tested multi-model monitoring configurations: an executor can retain invisible Unicode carriers that a monitor’s tokenizer or upstream preprocessing removes. A monitor cannot inspect a carrier it never receives. Field-specific codepoint admission can reject identified carriers, but the current AIDEFEND example does not cover the reported private-use channel. The study also reports ordinary-language hidden-message channels with substantial detection limits in its tested configurations. Capability and data-flow controls must therefore constrain the consequences of a missed signal.
Threat Analysis
- The architecture needs a shared observation boundary. In a monitor/executor design, one model performs the task while another inspects prompts or outputs. Choosing different model families does not establish that they receive equivalent security-relevant input.
- The blind spot can occur before reasoning. The report describes tested configurations in which tokenization or upstream preprocessing removes a Unicode carrier on the monitor path while preserving it on the executor path.
- The result is a controlled channel demonstration. In the reported tag-character test, the receiver recovered the hidden message and the monitor did not. Providing a decoding key could not recover characters already removed. This is not evidence of a malicious production intrusion or a completed data-exfiltration attack.
- Admission must match the actual model input. Before tokenization, validate raw codepoints against a signed field contract. Reject disallowed carriers, preserve legitimate code and multilingual semantics, and bind both monitoring and model invocation to the admitted text. Identical gateway text is only a prerequisite: the actual tokenizer paths must also be tested. Blank or unparseable monitor verdicts require a safe policy response.
- Ordinary language can also carry hidden messages. The study reports semantic channels based on word choice or structure. Unicode admission does not remove them, and the reported detection results are limited to the tested models, prompts and populations. A hidden message becoming a tool action or secret-bearing network request is a hypothetical consequence that requires additional capabilities; the benchmark does not establish that complete attack chain.
- Enforce action and release boundaries independently. Measure the exact observation paths and keep privileged tools, data release and high-impact actions behind policies that do not depend solely on the monitor detecting every hidden message.
Applicable AIDEFEND Defenses (7)
What Defenders Should Do Now
- Inventory this as AI harness engineering, not only model selection: executor model, monitor model, gateway, prompt builder, RAG adapter, agent-to-agent channel, tool dispatcher, monitor wrapper, and logging layer. For each path, record where raw input is preserved, where the canonical safety copy is created, and what monitor and executor actually see.
- Add a deterministic Unicode intake step before any model tokenizer runs. Inspect raw codepoints against field-specific policy, reject disallowed carriers, preserve legitimate code and multilingual semantics, and bind both paths to the admitted text. Replay the actual tokenizer paths as well; a shared gateway string does not establish a shared model-visible representation.
- Stop treating blank, malformed, or unparseable monitor output as clean. Route those cases to deny, retry with a known-good parser, or human review based on action risk.
- Create tokenizer-survival regression tests for the model pairs your team actually uses. Test both cross-vendor monitor/executor pairs and same-vendor self-monitoring pairs.
- Constrain what agents can do after a missed message. Bind tools to the trusted task, block untrusted values from sensitive destinations, and scan outputs and tool arguments before data leaves the system.
- Treat semantic steganography as difficult to detect reliably. Detection signals should be treated as leads for review, while high-impact actions stay behind capability policy, sink controls, and review.
2 additional considerations
Tokenizer-boundary testing for model pairs
Semantic steganography remains a consequence-control problem
Conclusion
Lingua Ex Machina shows why monitoring depends on the entire model observation path. Inventory the gateway, prompt builder, tokenizer, monitor wrapper and executor, then test the exact deployed composition. AIDEFEND supplies field-specific input admission, detection-efficacy evidence, isolated parsing, capability scoping and data-flow enforcement, each with separate deployment and evidence requirements. The current Unicode example has a private-use gap, and semantic-channel detection remains limited in the reported configurations. Constrain high-impact actions and sensitive-data release independently so a missed signal does not receive new authority.
Last updated: