One field in the request made our agent 3x cheaper and 8x faster
This story is from 2026-10-04. It is preserved in the archive; the latest stories are on the live feed.
TL;DR. Reasoning models decide by themselves how long to think if you don't tell them. Our agent didn't — and on hard tasks the model sometimes thought for 14 minutes and 33K tokens in a single step. One field in the request body ( "reasoning": {"effort": "low"} ) made a task 3x cheaper and 7–8x fa…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-04 10:20 · DEV Community — AI
One field in the request made our agent 3x cheaper and 8x faster