Title: I built a PyTorch optimizer for large GPU workloads — looking for feedback
Hey, I've been working on a PyTorch optimizer called ApexW and figured I'd share it here to get some feedback from people who know more about this stuff than I do. The main goal is to reduce optimizer-state memory usage and see how much faster I can make optimizer steps on larger GPU workloads. I'v…
Read the full story at r/deeplearning ↗
Timeline · 2 reports
- 2026-10-27 12:11 · r/MachineLearning
I built a PyTorch optimizer for large GPU workloads — looking for feedback[P] - 2026-10-27 11:37 · r/deeplearning
Title: I built a PyTorch optimizer for large GPU workloads — looking for feedback