AINewsnow

CUDA: fuse shared experts into MMVQ by am17an · Pull Request #29184 · ggml-org/llama.cpp

This story is from 2026-10-02. It is preserved in the archive; the latest stories are on the live feed.

MoE speedup, but only for some MoE architectures (like Qwen 35B A3B)

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-03 06:18 · r/LocalLLaMA
    qwen4exp : halve the indexer score memory by ServeurpersoCom · Pull Request #29825 · ggml-org/llama.cpp
  2. 2026-10-02 18:47 · r/LocalLLaMA
    CUDA: fuse shared experts into MMVQ by am17an · Pull Request #29184 · ggml-org/llama.cpp

More stories

  1. How to Speed Up Qwen3.8-27B in llama.cpp (NVIDIA's Draft Model May Lose to MTP) — DEV Community — Machine Learning
  2. Thinking On or Off? Gemma 4 E2B on an 8 GB RTX 3050 — DEV Community — AI
  3. Qwen4-Max Cuts AI Task Costs, but Gives Up Qwen’s Open-Model Edge — DEV Community — AI
  4. Running 26B Coding Models Locally on a 6GB Laptop GPU at 45 Tokens/Sec with MAPLE and llama.cpp — DEV Community — Machine Learning
  5. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  6. Run Mobilerun with local and cheap models Ollama, DeepSeek, Qwen, OpenRouter — DEV Community — Machine Learning
  7. An attached file told the model to delete all customers. In OpenWebUI, it tried — DEV Community — AI
  8. RadixArk Doubles A Free AI Model's Coding Score In Just 18 Days — DEV Community — Machine Learning

Read the Daily Brief: the day's most important AI stories →