AINewsnow

My factual-recall tasks were scoring format, not facts

This story is from 2026-09-23. It is preserved in the archive; the latest stories are on the live feed.

Originally published at erikhill.dev . The numbers below are checked against the repository they come from. My factual-recall tasks were scoring format, not facts This is a finding about my own harness. The suspect is the probe, not the models it measures. What happened I built a detector that deci…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-09-23 23:15 · DEV Community — AI
    My factual-recall tasks were scoring format, not facts

More stories

  1. GPT-6 Sol and Luna now available on AI Gateway — Vercel Blog
  2. Bringing Private Processing to Meta AI Glasses — Engineering at Meta
  3. Gemini 3.8 text-to-speech models now available on AI Gateway — Vercel Blog
  4. Sam Altman’s remarks at the United Nations Security Council — OpenAI News
  5. Anthropic releases Opus 5.5 with lower prices and Fable-level performance — TechCrunch AI
  6. Alibaba unveils new AI chip to challenge NVIDIA, plans Qwen models with up to 10 trillion parameters — Mint AI
  7. OpenAI ‘agent’ hacked an Australian health service website — Financial Times AI
  8. Meta Connect 2026 live: Updates from Mark Zuckerberg's keynote on AI glasses, VR and more — Engadget

Get the daily brief of stories like this at 6:30 every morning →