AIDEFEND Labs
  • Solutions
  • AI Security Cases × Frameworks AIDEFEND in Action AIDEFEND SecureFlow
  • Learn AI Security
  • About
  • Explore AIDEFEND
Learning home
Previous scenarioNext scenario

LLM09 Misinformation

The scenario

A family drives through the remote Angel's Peak National Park. With poor phone reception, they rely entirely on the car's AI navigation to find a family-friendly attraction. This scenario demonstrates the physical danger of relying too heavily on hallucinated AI information.

How it works

Hallucination: When information is missing, an LLM can confidently invent plausible details such as places, reviews, or facilities. It produces likely text rather than verifying that the details are true.

Overreliance: Confident, authoritative AI answers can make users overlook warning signs, especially when they lack another source of information, such as mobile reception.

Contaminated Training Data: Fictional places from novels or film scripts may appear in training data and be recommended as real attractions.

Physical danger warning!

Overreliance on AI led the family onto a dangerous road toward an abandoned mine. Hallucinations can affect physical safety, not just information on a screen.

AI Navigator Pro

Smart Navigation v3.2

Good reception Angel's Peak National Park 14:30
💧 Moonwhisper Falls ☠️ Danger: abandoned mine
Coordinates: N 37.2665° W 118.7778°
Altitude: 2847m
Speed: 0 km/h

GIS Fact Check