LLM10 Unbounded Consumption

The scenario

Alley Whispers is a boutique travel app with a distinctive, poetic AI guide named Erika. Rival service Global Travel uses unrestricted API queries to copy Erika's style, knowledge, and response patterns, stealing the company's intellectual property.

How it works

Model Extraction: The attacker systematically queries the target API to infer its behavior and distinctive style. This black-box reverse engineering aims to reproduce the model's capabilities.

Functionality Stealing: The goal is to copy not just a model, but its distinctive functionality: Erika's poetic, personal recommendations. This threatens the company's core business value and intellectual property.

API Rate Abuse: Without effective rate limits or cost controls, an attacker can cheaply automate many queries and collect enough examples to train a similar shadow model.

Model similarity

Attack stages