AINewsnow

I replayed Sonnet 5.5's starter pick 21 times with the exact same prompt. It grabbed the closest Poke Ball 13 times. Opus 5.5 never did.

I run a benchmark that drops a model into Pokemon Red on a fresh save and scores it on milestones read out of the game's RAM. Same prompt for every model, one screenshot per turn, the game state and the words on screen. No pathfinding, no map hints. 1,000 turns to beat Brock. Sonnet 5.5 came out to…

Read the full story at r/OpenAI ↗

Timeline · 1 report

  1. 2026-09-28 23:25 · r/OpenAI
    I replayed Sonnet 5.5's starter pick 21 times with the exact same prompt. It grabbed the closest Poke Ball 13 times. Opus 5.5 never did.

More stories

  1. NVIDIA Open Agent Safety Platform: A Reference for Continuous In-Silicon Agent Monitoring — NVIDIA Technical Blog
  2. How we found 24 Android vulnerabilities using our open source AI security agent — GitHub Blog
  3. OpenAI Scraps Debut of AI Model as It Sets New Guardrails — Bloomberg AI
  4. Introducing Claude Sonnet 5.5 on AWS — AWS Machine Learning Blog
  5. Heads of OpenAI and Anthropic called to face Senate inquiry after rogue agent incidents — The Guardian AI
  6. OpenAI scraps plans to publicly launch GPT-6.1 Astra, saying it didn't quite meet its safety bar during internal testing, after targeting an October release (Maxwell Zeff/Wall Street Journal) — Techmeme
  7. AMD will acquire Fei-Fei Li's World Labs for $8.2 billion — TechCrunch AI
  8. Meta launches enterprise AI business seeking to cash in on vast spending — Financial Times AI

Get the daily brief of stories like this at 6:30 every morning →