Running NVIDIA's new 120B Nemotron-3.5-Super on an 8 GB GPU — skipping the zeros, and finding the real bottleneck
This story is from 2026-10-17. It is preserved in the archive; the latest stories are on the live feed.
NVIDIA released Nemotron-3.5-Super on October 15: a 120B mixture-of-experts model, 75 GB even in their 4-bit NVFP4 format. The usual answer for an 8 GB card is "not on your hardware". Two days later it runs on my home PC — one RTX 5060 with 8 GB — as an ordinary chat model in Open WebUI at ~8 token…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-17 12:42 · DEV Community — AI
Running NVIDIA's new 120B Nemotron-3.5-Super on an 8 GB GPU — skipping the zeros, and finding the real bottleneck