Similar Models, Broken Odds: Where Luce's Axiom Fails in Chatbot Arena
arXiv:2610.19095v1 Announce Type: new Abstract: Chatbot Arena ranks language models with the Bradley-Terry model, which gives each model one score and so assumes Luce's choice axiom. Choice theory predicts where this fails: near-copies are told apart more decisively than their scores imply. On 1.8…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-15 04:00 · arXiv cs.CL
Similar Models, Broken Odds: Where Luce's Axiom Fails in Chatbot Arena