GPT-6.1 Sol was the only model out of 11 to pass all 40 runs of a diplomatic negotiation eval
I was a diplomat for eight years, and I built an eval to test whether LLMs can chair a negotiation between seven governments. I ran 11 models 40 times each. GPT-6.1 Sol was the only one that never failed. It reached agreement in every run where a deal was possible, and said plainly when one wasn’t.…
Read the full story at r/OpenAI ↗
Timeline · 1 report
- 2026-11-14 13:27 · r/OpenAI
GPT-6.1 Sol was the only model out of 11 to pass all 40 runs of a diplomatic negotiation eval