I wanted 128GB to run bigger models. After trying a 125B MoE, im not sure bigger is always better
Ive been messing around with Qwen3.8-Flash-Next on my Nimo minipc with ryzen AI max+ 395 128GB. The model weights take up around 103.7 GiB, so just getting the whole thing loaded was a nice start. But after spending more time with it, I'm not sure running the biggest model possible is really the be…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-11 12:30 · r/LocalLLM
I wanted 128GB to run bigger models. After trying a 125B MoE, im not sure bigger is always better