AINewsnow

Passed Once, Failed 19 Times: The Reliability Gap Microsoft's ThinkingBox Found in Every Agent

Your coding agent just demoed beautifully. It refactored the module, updated the tests, and wrote a tidy summary. One problem: the demo was one run. This week, Microsoft researchers and Hugging Face published the October results of ThinkingBox , a benchmark that ran 507 real business-workflow tasks…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-11 15:58 · DEV Community — Machine Learning
    Passed Once, Failed 19 Times: The Reliability Gap Microsoft's ThinkingBox Found in Every Agent

More stories

  1. ThinkingBox: Solving an agent task once vs. solving it 20/20: 507 stateful workflows graded on terminal database state [R] — r/MachineLearning
  2. Qwen Image 2.1 Turbo Released -- Hugging Face — r/StableDiffusion
  3. Microsoft CEO Nadella Calls for ‘Emergency Brake’ on Advanced AI — Bloomberg AI
  4. Microsoft unveils Microsoft-Decision-1, a fast decision-scoring model trained on Qwen3.5-9B, and says it will soon rebase it on MAI, OpenAI, and other models (Achint Srivastava/Command Line) — Techmeme
  5. Microsoft's Nadella says AI needs an ‘emergency brake’ that humans control — CNBC Technology
  6. Microsoft previews Surface Laptop Ultra, new local AI agents — ZDNET AI
  7. Microsoft Decision-1 now available on AI Gateway — Vercel Blog
  8. I recently cleared the GitHub Copilot GH-300 Certification exam! — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →