AINewsnow

SANE: Automated Scorer-Specific Metamorphic Testing for LLM Judges

arXiv:2610.28886v1 Announce Type: new Abstract: LLM judges increasingly mediate benchmark evaluation, model selection, data curation, and training. Their decisions are useful only when each judge responds reliably to changes affecting its scoring criterion. Existing methods for reliability testing…

Read the full story at arXiv cs.CL ↗

Timeline · 1 report

  1. 2026-10-22 04:00 · arXiv cs.CL
    SANE: Automated Scorer-Specific Metamorphic Testing for LLM Judges

More stories

  1. OpenAI brings frontier models and Codex to Google Cloud — OpenAI News
  2. Recursive Releases Flint, an Open-Weight 40B MoE Local Coding Model for Agents with 2.5B Active Params — MarkTechPost
  3. Meta to create a new class of shares to fund AI push — The Verge AI
  4. NVIDIA Cosmos Opens New Tools to Train, Evaluate and Deploy World Models — NVIDIA Blog
  5. How Companies Are Using NVIDIA DSX to Break the Power Bottleneck — NVIDIA Blog
  6. Websites pulled offline worldwide as AI finds critical security flaws — South China Morning Post Tech
  7. Solving a 31-year-old grand challenge in mathematics – the KLS conjecture — Microsoft Research Blog
  8. OpenAI acquires Orchestra Bio to fold drug-development agents into Rosalind — OpenAI News

Get the daily brief of stories like this at 6:30 every morning →