New Method Uses Streaming Quantile Matching to Calibrate LLM-as-a-Judge Scores
A new arXiv paper proposes calibrating LLM-as-a-judge scores to human ratings via streaming quantile matching, addressing distributional shifts in ordinal evaluation tasks.
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-11-03 05:00 · arXiv cs.AI
Quantiles, Not Points: Streaming Quantile Matching for Ordinal-Aware LLM-as-a-Judge Calibration