Why Nvidia Put Mamba and Attention Together for Agents
This story is from 2026-10-30. It is preserved in the archive; the latest stories are on the live feed.
Nvidia published the technical report for Nemotron 3.5 Super and Lightning this week. Super is a 120-billion parameter Mixture-of-Experts model with 12 billion active parameters per token, while Lightning is a 30-billion parameter model with 3 billion active parameters. On SWE-bench Pro, Super reac…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-30 16:27 · DEV Community — AI
Why Nvidia Put Mamba and Attention Together for Agents