Field guide: five loss-curve symptoms, the likely causes, and the first check for each
A list I’d keep next to a training run. These are likely causes, not certainties, and the first check is the cheapest thing to try. 1. Loss is NaN or inf Likely causes: learning rate too high; log(0) or a division by zero in a custom loss; overflow in mixed precision; bad values in the data. First…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-10-29 16:26 · r/deeplearning
Field guide: five loss-curve symptoms, the likely causes, and the first check for each