Jesus's Adam (against convergence to odd policies in the beginning)
This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.
Decreasing ε from approx 1 toward approx 0 using β₂ transitions the optimizer from SGD to Adam: https://preview.redd.it/0lfzjby3qqkh1.png?width=677&format=png&auto=webp&s=c1c5e97f930646ab3cca47d1bcbba1b0a62b256c Bias correction terms in the numerator and denominator can be omitted, as their impact…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-08-21 14:46 · r/reinforcementlearning
Jesus's Adam (against convergence to odd policies in the beginning)