I edited 12 tensors so a 2B model stops saying "Wait", then taught it to say "I'm stuck"
Small reasoning models have a failure mode that eats your token budget: they reach the answer, then keep re-checking it. "Wait." "Hmm." "Actually, let me verify." On my test set, 34 out of 100 tasks never finished inside a 4000-token budget, and a lot of the finished ones were long loops of the sam…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-10 14:43 · DEV Community — Machine Learning
I edited 12 tensors so a 2B model stops saying "Wait", then taught it to say "I'm stuck"