AINewsnow

Best coding agent fully completes only 26.4% of real tasks on Alibaba benchmark

Alibaba's Co-Design Bench tested ten model endpoints on 273 real app-edit tasks; the strongest agent fully completed 26.4% while meeting 69.9% of each task's criteria on average.

Read the full story at DEV Community — AI ↗

Timeline · 2 reports

  1. 2026-11-09 12:16 · DailyAI
    Best Coding Agent Fully Clears Only 26.4% of Real Tasks
  2. 2026-11-09 07:35 · DEV Community — AI
    Alibaba measured it: the best coding agent meets 70% of requirements and finishes 26% of tasks

More stories

  1. Nous Research releases Arete-27B, cutting Qwen3.8-27B propaganda rate from 22% to 0.9% — AlphaSignal
  2. AI Brief: Apple's HALO Robot, 5,000 Agents per Repo — DEV Community — AI
  3. Nvidia CEO's alleged affair with Chinese spy spotlights governance at $4.5 trillion chipmaker — Reuters AI
  4. How much of GPT-6 Astra's weight-editing demo is the harness? — DEV Community — Machine Learning
  5. L11 N8147 is a neuron that will make Qwen-3.5-4B get things confidently wrong while being weirdly snarky... But also makes it write interesting poetry — r/LocalLLaMA
  6. Qwen 3.8 Flash Next at 124 tok/s on 8GB VRAM and 16GB RAM + SSD, Q3 Quant — r/LocalLLM
  7. Boogu 0.1 in ComfyUI: Three Open Models in One Release, Tested Against Qwen-Class Baselines — DEV Community — AI
  8. AgentScope Basics: Building Your First Agentic Application — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →