Run a 48 GB AI Model on a 32 GB Laptop: Janas Streams Model Experts From Your SSD at 37 tok/s
This story is from 2026-10-13. It is preserved in the archive; the latest stories are on the live feed.
The wall everyone hits with local models is always the same one: the model you actually want to run is bigger than your memory. You find a promising 80B mixture-of-experts model, check the file size, see 48 GB, look at your 32 GB of RAM, and close the tab. Or worse, you try it anyway and watch your…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-13 12:03 · DEV Community — AI
Run a 48 GB AI Model on a 32 GB Laptop: Janas Streams Model Experts From Your SSD at 37 tok/s