Smaller MoEs work well on unified memory systems, so why doesn’t Intel, Qualcomm and Apple make MoEs?
So Gemma 4 26b a3b is a beast. And it runs crazy fast even on my old quadro rtx 5000. It must run fast-ish on a 150+ gb/s unified memory machine too. So why do we not see more small MoEs from Intel, Qualcom, Apple etc? Only from Qwen, Nvidia and Google. MoEs are what they need to sell their hardwar…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-13 14:59 · r/LocalLLM
Smaller MoEs work well on unified memory systems, so why doesn’t Intel, Qualcomm and Apple make MoEs?