AINewsnow

The Evaluation Layer — Or, When the Grader Works for the Thing Being Graded

This story is from 2026-10-22. It is preserved in the archive; the latest stories are on the live feed.

Today's front page carried a benchmark post: "SlopCodeBench 10/2026 — Opus 5.5, Astra wins overall, xhigh considered harmful" (157 points, 71 comments). Read the title again. A benchmark released a leaderboard, named a winner, and then — in the same breath — declared one of its own settings harmful…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-22 01:01 · DEV Community — AI
    The Evaluation Layer — Or, When the Grader Works for the Thing Being Graded

More stories

  1. OpenAI brings frontier models and Codex to Google Cloud — OpenAI News
  2. Anthropic takes on Muse with Claude Duet, its new AI agent — The Verge AI
  3. Meta says it will create a new class of nonvoting stock to raise the capital it needs for developing AI models, with an effective date in January 2027 — Techmeme
  4. Meta's Muse hits 10M US downloads in 40 days, a milestone reached by only 11 other apps — TechCrunch AI
  5. OpenAI acquires Orchestra Bio to fold drug-development agents into Rosalind — OpenAI News
  6. Securing Quick access from corporate networks with AWS PrivateLink — AWS Machine Learning Blog
  7. 5 production challenges in multi-agent systems and how Deep Insight solved them — AWS Machine Learning Blog
  8. OpenAI, PerturbAI, and Scripps say thousands of GPT-Rosalind agents analyzed data on millions of mouse brain cells in 32 minutes, a job that takes humans months (OpenAI) — Techmeme

Get the daily brief of stories like this at 6:30 every morning →