AINewsnow

Your judge is drifting too — why evaluation standards move even when the model doesn't

This digest covers LLM evaluation and observability developments from 2026-11-05 through 2026-11-12. The headline thread this week: several independent papers converge on the same uncomfortable finding — the instruments we use to measure LLM quality (human raters, LLM-judges, contamination tests, f…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-12 12:14 · DEV Community — Machine Learning
    Your judge is drifting too — why evaluation standards move even when the model doesn't

More stories

  1. The phantom life of Alice Huang, alleged Chinese spy who had affair with Nvidia CEO — CSET Georgetown
  2. Google DeepMind unveils AlphaGenome 2 for cell-type-specific DNA variant predictions — Google DeepMind Blog
  3. Google DeepMind's AlphaProof Code formally verifies Signal's cryptographic code in four weeks — Google DeepMind Blog
  4. Google launches Gemini Decision 1 model and Decisions API for fast closed-set choices — Google Cloud AI Blog
  5. Google launches Tabletop, an experimental AI platform for group planning and collaboration — Google AI Blog
  6. United Airlines to Ban AI Bots From Booking Flights — Wall Street Journal Technology
  7. Google expands Gemini 4 Carbon access to Pro plan users in AI Mode — Google DeepMind Blog
  8. AI chip startup Fractile raises $720M at $7B valuation — Techmeme

Get the daily brief of stories like this at 6:30 every morning →