40 hand labels: my batching test caught 0 of 30 dependencies
This story is from 2026-10-22. It is preserved in the archive; the latest stories are on the live feed.
A classifier with a clean control told me that 5.9% of my agent's same-tool call pairs were dependent, which left 94% of them unproven. Before publishing that, I hand-labeled 40 of the pairs. Thirty were dependent. The classifier caught none of them. The classifier was mine. The control was clean:…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-22 04:49 · DEV Community — AI
40 hand labels: my batching test caught 0 of 30 dependencies