New coding agent uses a compiler to make cheap models perform better than frontier models for SWE related work
Benzi is a code intelligence system. With the agentic loop + compiler it scores 82.4% on SWE-bench Verified for $12.96 while reading 2-4x less source code than other agents/harnesses (measured separately, check 24-bug benchmark). Code intelligence itself is old, but bringing AI into the mix changes…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-16 16:04 · r/LocalLLM
New coding agent uses a compiler to make cheap models perform better than frontier models for SWE related work