One field in the request made our agent 3x cheaper and 8x faster

This story is from 2026-10-04. It is preserved in the archive; the latest stories are on the live feed.

TL;DR. Reasoning models decide by themselves how long to think if you don't tell them. Our agent didn't — and on hard tasks the model sometimes thought for 14 minutes and 33K tokens in a single step. One field in the request body ( "reasoning": {"effort": "low"} ) made a task 3x cheaper and 7–8x fa…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

1. 2026-10-04 10:20 · DEV Community — AI
   One field in the request made our agent 3x cheaper and 8x faster