Tool Previews Lie. Store stdout_bytes and a Truncation Flag.
This story is from 2026-09-23. It is preserved in the archive; the latest stories are on the live feed.
A coding agent closed the flaky test ticket. The JSONL span showed pytest and a short preview. The next human run failed in the same module. The wrapper had capped stdout at 8192 bytes. The assertion text started after that cap. The model never read the failing lines. This is not a prompt problem f…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-09-23 16:29 · DEV Community — AI
Tool Previews Lie. Store stdout_bytes and a Truncation Flag.