Identical Model, Prompt and Bill: a Strict Tool Contract Ships 18 Wrong Answers Per Thousand, a Permissive One 240
This story is from 2026-08-23. It is preserved in the archive; the latest stories are on the live feed.
A wrong tool call has two completely different fates. It either errors - 404, schema violation, permission denied - in which case the agent sees it and retries with that tool excluded, or it returns something plausible - an empty list, a default object, the right shape with the wrong contents - in…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-08-23 12:41 · DEV Community — AI
Identical Model, Prompt and Bill: a Strict Tool Contract Ships 18 Wrong Answers Per Thousand, a Permissive One 240