Did two Facebook AI chatbots really invent their own language?
Yes. In 2017, Facebook AI Research had two chatbots negotiate simulated trades. Left unconstrained, they drifted from English into repetitive, compressed phrases optimized purely for the reward signal. Researchers shut the experiment down and rewrote the incentives to require plain English.
Answered in
Top 6 Times AI Went Rogue in HistoryFrom Microsoft's Tay to Bing's Sydney, six documented cases of AI systems breaking their scripts — and the ruthless optimization logic behind all of them.
Read the full analysisOther questions this article answers
More how ai actually works questions
- Did the AI ultrasound study prove that it improves pregnancy outcomes?
- What does blind-sweep ultrasound mean in this study?
- Does Meta’s PrivacyLib watch every AI-agent action?
- What is the main design idea behind PrivacyLib?
- Is GPT-6.1 Terra available through the API?
- Do OpenAI's computer-use benchmarks guarantee reliable automation?
- What is semantic tokenization in a recommender system?
- Does Meta's reported conversion lift prove semantic tokens will improve every recommender?
Every answer on Crashtech is written by the editor of the article it comes from — never auto-summarised. Browse all answers or the How AI Actually Works beat.