AINewsnow

FrontierHarness tested 9 agent harnesses with same model, cost per pass varies 17x

This story is from 2026-09-09. It is preserved in the archive; the latest stories are on the live feed.

A year ago the question was which model. Now it's which harness. Pi, Exo, Claude Code, Codex, DeepSeek Harness and 4 others. Same model, same tasks, same runtime. 360 runs, 2 billion tokens. Pass rates: 50% to 67%. Cost per pass: $1.05 to $18.34. FrontierHarness tested 9 harnesses on 30 tasks using…

Read the full story at r/AI_Agents ↗

Timeline · 1 report

  1. 2026-09-09 19:11 · r/AI_Agents
    FrontierHarness tested 9 agent harnesses with same model, cost per pass varies 17x

More stories

  1. Bolt Adds DeepSeek V4.1 Flash at 10x Cheaper Than V4 Pro — AlphaSignal
  2. I gave 6 different AIs the same 5 questions — r/AI_Agents
  3. Own 1 dashboard for ChatGPT, Gemini, Claude, and more for only $54.97 — Mashable AI
  4. Prompt vs Architecture pt 2 — r/PromptEngineering
  5. AI's role in building AI surging? Anthropic says Claude now leads 26% of its R&D — Mint AI
  6. Claude, Anthropic’s AI model, is helping to develop the next version of itself — Fast Company AI
  7. we made a 27b model for creative writing. performs as good as claude fable 5, at a 40x cheaper price, open weights. — r/GeminiAI
  8. AI skills — r/AI_Agents

Get the daily brief of stories like this at 6:30 every morning →