AINewsnow

Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp

This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.

now you can use MTP with Qwen Flash Next, time to switch from Qwen 3.8 27B? (merged after 17h of development) quants: https://huggingface.co/ggml-org/Qwen3.8-Flash-Next-GGUF link to the previous discussion (I deleted the old post to avoid duplicates): https://www.reddit.com/r/LocalLLaMA/comments/1w…

Read the full story at r/LocalLLaMA ↗

Timeline · 4 reports

  1. 2026-10-03 06:18 · r/LocalLLaMA
    qwen4exp : halve the indexer score memory by ServeurpersoCom · Pull Request #29825 · ggml-org/llama.cpp
  2. 2026-10-02 18:47 · r/LocalLLaMA
    CUDA: fuse shared experts into MMVQ by am17an · Pull Request #29184 · ggml-org/llama.cpp
  3. 2026-10-02 10:29 · r/LocalLLaMA
    llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) by ngxson · Pull Request #29818 · ggml-org/llama.cpp
  4. 2026-10-01 11:18 · r/LocalLLaMA
    Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp

More stories

  1. How to Speed Up Qwen3.8-27B in llama.cpp (NVIDIA's Draft Model May Lose to MTP) — DEV Community — Machine Learning
  2. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  3. With llama.cpp's v1.0.0 tag out, a short history of the project: the first evening, GGUF, the backends, the server and the move to Hugging Face — r/LocalLLM
  4. California Sues OpenAI For Allegedly Misleading and Endangering the Public — Forbes AI
  5. pgEdge Adds TypeSafe's Jev to Workbench Beta for PostgreSQL Alert Triage — Unite.AI
  6. Thinking On or Off? Gemma 4 E2B on an 8 GB RTX 3050 — DEV Community — AI
  7. Qwen4-Max Cuts AI Task Costs, but Gives Up Qwen’s Open-Model Edge — DEV Community — AI
  8. Running 26B Coding Models Locally on a 6GB Laptop GPU at 45 Tokens/Sec with MAPLE and llama.cpp — DEV Community — Machine Learning

Read the Daily Brief: the day's most important AI stories →