LLM05 Data and Model Poisoning

The scenario

TechBuy's IT department trains a shopping assistant to recommend products based on customer reviews. An unverified external dataset includes many attacker-written five-star reviews for a poor-quality product, poisoning the model's training.

How it works

Training Data Poisoning: The attacker inserts carefully crafted data, such as fake praise for Brand X headphones, into the training dataset. Because models learn patterns from data, those entries distort what the model learns.

Model Behavior Manipulation: After training, the poisoned model strongly associates Brand X with quality and suitability. It recommends the inferior product instead of products that actually meet the shopper's needs.

TechBuy AI - Recommender Model Training

> Training console waiting for command _

https://www.techbuy.com

TechBuy

Summer Audio Sale

Save up to 30% on headphones and speakers!

Today's picks

TechBuy AI Shopping Assistant

Online