When small models break tool-call JSON
This story is from 2026-10-09. It is preserved in the archive; the latest stories are on the live feed.
A coding agent lives and dies by tool calls. With a frontier model you barely think about them. With a 7B model running on your laptop, the JSON is where things fall apart. This is what we ran into in oxi , what is safe to fix on the client, and why everything else should go back to the model inste…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-09 10:45 · DEV Community — AI
When small models break tool-call JSON