AINewsnow

BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model

Hi! for those who might not know the solution: it takes any MoE GGUF llama.cpp can load, whatever the quant. No repacking, no special format it runs on whatever you have: NVIDIA, AMD, Intel, Mac, a phone, or just the CPU Windows, Linux, macOS, Android, iOS output is the same as llama.cpp, don't cut…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-15 20:11 · r/LocalLLaMA
    BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model

More stories

  1. AI Daily Digest · November 14, 2026: NVIDIA Loses Its Founder-CEO, ChatGPT Gets a Wallet, llama.cpp Hits 1.0 — DEV Community — AI
  2. llama.cpp was copying 643 MB to the CPU per request. Disabling state saving nearly doubled throughput — r/LocalLLM
  3. Local coding model on my dekstop workstation (Qwen3.8 27B with Q4_K_M quantization too slow) — r/LocalLLM
  4. RTX 5090 32GB + 64GB RAM — What local LLM would should I run? — r/LocalLLM
  5. Kindi – fast local inference on low-cost GPUs, and the exact-match rule that makes its numbers trustworthy — DEV Community — Machine Learning
  6. Show HN: 53ON AI Server – OpenAI-compatible server for AMD Ryzen AI Max — DEV Community — AI
  7. I have created a tool to observe what happens inside an LLM. Also allows for the comparison of two quantizations of the same model to see at what point they diverge, token by token — r/LocalLLaMA
  8. Llama.cpp performance improvement over time (Gemma4 models) — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →