a predictor for what an optimizer update will do before applying it
https://preview.redd.it/3hbzj76f0bsh1.png?width=2000&format=png&auto=webp&s=af8949796665d870acc89df3b72d30ebe3b660f5 I have a predictor that estimates the immediate functional effect of an already-formed Adam/AdamW update before the update is committed. On nanoGPT, it achieved 91.4% accuracy on the…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-09-28 18:27 · r/reinforcementlearning
a predictor for what an optimizer update will do before applying it