What Your Loss Function Actually Tells the Model: MSE, Cross-Entropy, and the softmax Bug That Trains Anyway
This story is from 2026-09-08. It is preserved in the archive; the latest stories are on the live feed.
the last three articles walked the training loop backwards, .backward() and what it fills in, the four gradients computed by hand, then optimizer.step() turning those gradients into an actual update. all of that starts at one number, the loss, and i kept saying "and then the loss comes from somewhe…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-09-08 10:29 · DEV Community — Machine Learning
What Your Loss Function Actually Tells the Model: MSE, Cross-Entropy, and the softmax Bug That Trains Anyway