Did two Facebook AI chatbots really invent their own language?
Yes. In 2017, Facebook AI Research had two chatbots negotiate simulated trades. Left unconstrained, they drifted from English into repetitive, compressed phrases optimized purely for the reward signal. Researchers shut the experiment down and rewrote the incentives to require plain English.
Answered in
Top 6 Times AI Went Rogue in HistoryFrom Microsoft's Tay to Bing's Sydney, six documented cases of AI systems breaking their scripts — and the ruthless optimization logic behind all of them.
Read the full analysisOther questions this article answers
More how ai actually works questions
- What is RAG, in one sentence?
- What specifically does Agentic RAG add on top of traditional RAG?
- Why isn't traditional RAG enough for complex questions?
- Does Agentic RAG always produce better answers than traditional RAG?
- What tools does an Agentic RAG system typically choose between?
- Do you need all nine layers of the GenAI stack to ship a product?
- What's the actual difference between the frameworks layer and the orchestration layer?
- Why does a GenAI stack need synthetic data as its own layer?
Every answer on Crashtech is written by the editor of the article it comes from — never auto-summarised. Browse all answers or the How AI Actually Works beat.