Agreement Overstates Evidence: Error Dependence in LLM Judge Consensus
This story is from 2026-09-22. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.22512v1 Announce Type: new Abstract: Consensus among LLM judges is often taken as strong evidence that a decision is correct. This assumes that judges make their errors independently. In practice, LLM judges are often trained and evaluated in similar ways, so they can make the same mista…
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-09-22 04:00 · arXiv cs.AI
Agreement Overstates Evidence: Error Dependence in LLM Judge Consensus