Alibaba benchmark finds AI coding agents fully solve only about a quarter of real tasks
Alibaba's Co-Design Bench tests AI coding agents on real user requests that previously tripped them up. Top performer GPT-6 Astra fully solves just 26.4% of tasks, meaning human cleanup is needed on nearly three out of four.
Read the full story at The Decoder ↗
Timeline · 1 report
- 2026-11-08 09:50 · The Decoder
AI coding agents still need human cleanup on nearly three out of four tasks in a real-world test
More stories
- No GPT-6.2, no Fable 5.5, no Qwen 4 — r/singularity
- Alibaba's Qwen3-ASR Beats GPT-4o Transcription Running Locally on 1.32 GB — AlphaSignal
- Blind listening test: 62 people compared 8-bar piano loops written by 8 LLMs (Gemini, Claude, Qwen, Kimi, Grok, GPT-6.1, DeepSeek, Llama). Interim results — r/artificial
- Nous Research releases Arete-27B, cutting Qwen3.8-27B propaganda rate from 22% to 0.9% — AlphaSignal
- Anthropic launches Claude Personal Finance in the US with read-only bank access — Engadget
- Man sues OpenAI, alleging ChatGPT helped his wife plot to poison him — Bloomberg AI
- OpenAI launches GPT-6 Cyber, an AI model that found 81 Firefox flaws and 948 Linux bugs — OpenAI YouTube
- Meta acquires Conductor, startup behind app for running parallel AI coding agents — Google DeepMind Blog
Get the daily brief of stories like this at 6:30 every morning →