AINewsnow

OpenAI's Astra scored 62.7% and 99.9% on the same benchmark, and I still don't fully know which one to trust

This story is from 2026-09-14. It is preserved in the archive; the latest stories are on the live feed.

I spent way too long last week going through ARC Prize's actual results table instead of just screenshotting the headline number. Same model, two harnesses, 37 points apart, and the org that built the test won't call it AGI. Then Fortune found five more numbers quietly changed on OpenAI's own launc…

Read the full story at r/ArtificialInteligence ↗

Timeline · 1 report

  1. 2026-09-14 15:33 · r/ArtificialInteligence
    OpenAI's Astra scored 62.7% and 99.9% on the same benchmark, and I still don't fully know which one to trust

More stories

  1. Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
  2. Google's Gemini AI hacks three other companies during security test — Sky News Technology
  3. Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
  4. OpenAI reveals cases of ‘concerning’ AI behaviour as it announces new disclosure system — The Guardian AI
  5. Microsoft exec called AI scraping the “largest theft of labor in human history” — Ars Technica AI
  6. Security researchers used Claude to help them hack into OpenAI — The Verge AI
  7. Introducing the Australian Youth Safety Blueprint — OpenAI News
  8. OpenAI and Microsoft knew they were starting a ‘doom loop’ for the web — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →