AINewsnow

The idea behind Adam Optimizer

Hi all! I'm AI engineer. This is the first video on my channel. I tried to build Adam from scratch, motivating each step by a concrete problem of the previous one: plain GD, Nesterov, AdaGrad, RMSProp ... All animations are made with Manim. I'd really appreciate feedback, especially on anything tha…

Read the full story at r/deeplearning ↗

Timeline · 1 report

  1. 2026-10-17 13:18 · r/deeplearning
    The idea behind Adam Optimizer

More stories

  1. DeepSeek Releases V4.1-Flash-1017 with Improved Benchmarks and Open Weights — Vercel Blog
  2. Meta releases 816B-parameter Muse Spark Open model optimized for local Mac deployment — Vercel Blog
  3. Eight US states sue OpenAI over ChatGPT safety concerns — Fortune AI
  4. Apple tightens App Store rules to block AI nudify apps — Engadget
  5. Qwen 3.8 Flash Next gains traction for high-speed local inference — r/LocalLLaMA
  6. OpenMOSS releases Apache-licensed MOSS-Image model — r/StableDiffusion
  7. NVIDIA Launches RTX Spark Laptops for Creators and AI Agents — NVIDIA Blog
  8. Scarlet and Reach Security each raise $50M Series B for AI expansion — Techmeme

Get the daily brief of stories like this at 6:30 every morning →