One Integer Deleted the Stop Token From My Loss. The Curve Never Noticed.
This story is from 2026-08-31. It is preserved in the archive; the latest stories are on the live feed.
For a long time I had a model that trained cleanly and produced nothing usable. The loss fell. Gradients were finite. Nothing crashed. It simply never learned to stop — every generation ran to the length cap and got truncated. The cause was two lines of my own source that were individually correct.…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-08-31 16:37 · DEV Community — Machine Learning
One Integer Deleted the Stop Token From My Loss. The Curve Never Noticed.