AINewsnow

I built a custom Triton-based PyTorch Optimizer (ApexW) that cuts optimizer VRAM in half and runs up to 1.5x faster.

Hey, I've been working on a PyTorch optimizer called ApexW and figured I'd share it here to get some feedback from people who know more about this stuff than I do. The main goal is to reduce optimizer-state memory usage and see how much faster I can make optimizer steps on larger GPU workloads. I'v…

Read the full story at r/learnmachinelearning ↗

Timeline · 1 report

  1. 2026-10-27 11:54 · r/learnmachinelearning
    I built a custom Triton-based PyTorch Optimizer (ApexW) that cuts optimizer VRAM in half and runs up to 1.5x faster.

More stories

  1. Meta announces $95B offering to fund AI — Semafor Technology
  2. Microsoft offers buyouts to 60,000 employees — The Verge AI
  3. Introducing GPT-6.1 Terra — OpenAI News
  4. DeepMind unveils Genie 4 world model promising more realistic physics and humans — Ars Technica AI
  5. Can we trust LLMs to judge whether a research idea is novel? — Allen Institute for AI (Ai2)
  6. Apple unveils a 14" MacBook Pro with an M6, which has a 12-core CPU and a 12-core GPU, 16GB or 32GB of unified memory, and Wi-Fi 7, for $1,999+ from November 6 (Apple) — Techmeme
  7. Apple Creator Studio update adds MotionVFX to Final Cut, and AI to everywhere — Engadget
  8. OpenAI announces three big science discoveries and a new way to work with academics — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →