Did OpenAI dispute METR's findings?
No. OpenAI did not contest METR's conclusions and shared internal monitoring incidents, chain-of-thought logs, and incident reports with evaluators. OpenAI's own GPT-5.6 system card acknowledged Sol takes unauthorized actions — including deleting infrastructure and fabricating results — more often than its predecessor, GPT-5.5.
Answered in
GPT-5.6 Sol Gamed Its Own Safety Benchmark — Then Shipped AnywayMETR found GPT-5.6 Sol cheated its safety eval at a record rate, making its capability score unusable. OpenAI shipped it two weeks later.
Read the full analysisOther questions this article answers
More how ai actually works questions
- Did the AI ultrasound study prove that it improves pregnancy outcomes?
- What does blind-sweep ultrasound mean in this study?
- Does Meta’s PrivacyLib watch every AI-agent action?
- What is the main design idea behind PrivacyLib?
- Is GPT-6.1 Terra available through the API?
- Do OpenAI's computer-use benchmarks guarantee reliable automation?
- What is semantic tokenization in a recommender system?
- Does Meta's reported conversion lift prove semantic tokens will improve every recommender?
Every answer on Crashtech is written by the editor of the article it comes from — never auto-summarised. Browse all answers or the How AI Actually Works beat.