The First Token Is Not the Verdict: Hidden Costs of Reading LLM Judges Without Generating
arXiv:2610.00054v1 Announce Type: new Abstract: Reading an LLM judge's verdict from the logits of its first generated token is cheap, requires no generation, and is exactly what constrained decoding and likelihood-scoring evaluation harnesses produce. We show that this readout distorts position bia…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-02 04:00 · arXiv cs.CL
The First Token Is Not the Verdict: Hidden Costs of Reading LLM Judges Without Generating