ChatGPT Package Hallucination
Researchers identified that large language models such as ChatGPT can hallucinate fake software package names that are not published to a package repository. An attacker could publish a malicious package under the hallucinated name to a package repository. Then users of the same or similar large language models may encounter the same hallucination and ultimately download and execute the malicious package leading to a variety of potential harms.
Why it relates: The model invents a package name, the researcher registers that name, and later recommendations lead users toward the registered package. More than 30,000 downloads were measured for an empty tracking package. Malicious package execution remains a conditional consequence. A false generated dependency recommendation propagates into a package-adoption workflow. This is not proof of autonomous agent propagation, observed malware execution, or a production compromise.
Researchers identified that large language models such as ChatGPT can hallucinate fake software package names that are not published to a package repository. An attacker could publish a malicious package under the hallucinated name to a package repository. Then users of the same or similar large language models may encounter the same hallucination and ultimately download and execute the malicious package leading to a variety of potential harms.