AINewsnow

I built a PyTorch optimizer for large GPU workloads — looking for feedback[P]

This story is from 2026-10-27. It is preserved in the archive; the latest stories are on the live feed.

Hey, I've been working on a PyTorch optimizer called ApexW and figured I'd share it here to get some feedback from people who know more about this stuff than I do. The main goal is to reduce optimizer-state memory usage and see how much faster I can make optimizer steps on larger GPU workloads. I'v…

Read the full story at r/MachineLearning ↗

Timeline · 1 report

  1. 2026-10-27 12:11 · r/MachineLearning
    I built a PyTorch optimizer for large GPU workloads — looking for feedback[P]

More stories

  1. Meta announces $95B offering to fund AI — Semafor Technology
  2. Introducing GPT-6.1 Terra — OpenAI News
  3. Apple unveils a 14" MacBook Pro with an M6, which has a 12-core CPU and a 12-core GPU, 16GB or 32GB of unified memory, and Wi-Fi 7, for $1,999+ from November 6 (Apple) — Techmeme
  4. Microsoft offers buyouts to 60,000 employees — The Verge AI
  5. OpenAI announces three big science discoveries and a new way to work with academics — The Verge AI
  6. Anthropic’s IPO filing lays out a plan to ‘revolutionize every area of human endeavor' with AI — The Verge AI
  7. How AI Is Changing the Pace of Discovery for Millions Living With Dementia — NVIDIA Blog
  8. 8 examples of Gemini 4 Argon in action — Google Gemini Blog

Get the daily brief of stories like this at 6:30 every morning →