Whats the best MoE Model out there that fits in 32 gb ram and 12 gb vram.
I already tried Qwen Flash Next iqm1 coder and im really impressed. But it lacks languages and is fairly bad in agent use outside of coding. I already thought about Gemma 4 26b or smth like kollibri 78b. Any further suggestions I could try?
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-14 18:06 · r/LocalLLM
Whats the best MoE Model out there that fits in 32 gb ram and 12 gb vram.