BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model
Hi! for those who might not know the solution: it takes any MoE GGUF llama.cpp can load, whatever the quant. No repacking, no special format it runs on whatever you have: NVIDIA, AMD, Intel, Mac, a phone, or just the CPU Windows, Linux, macOS, Android, iOS output is the same as llama.cpp, don't cut…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-15 20:11 · r/LocalLLaMA
BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model