AINewsnow

Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp

now you can use MTP with Qwen Flash Next, time to switch from Qwen 3.8 27B? (merged after 17h of development) quants: https://huggingface.co/ggml-org/Qwen3.8-Flash-Next-GGUF link to the previous discussion (I deleted the old post to avoid duplicates): https://www.reddit.com/r/LocalLLaMA/comments/1w…

Read the full story at r/LocalLLaMA ↗

Timeline · 4 reports

  1. 2026-10-03 06:18 · r/LocalLLaMA
    qwen4exp : halve the indexer score memory by ServeurpersoCom · Pull Request #29825 · ggml-org/llama.cpp
  2. 2026-10-02 18:47 · r/LocalLLaMA
    CUDA: fuse shared experts into MMVQ by am17an · Pull Request #29184 · ggml-org/llama.cpp
  3. 2026-10-02 10:29 · r/LocalLLaMA
    llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) by ngxson · Pull Request #29818 · ggml-org/llama.cpp
  4. 2026-10-01 11:18 · r/LocalLLaMA
    Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp

More stories

  1. How smart is the IQ3 family of Qwen 3.8 Flash Next for coding tasks? — r/LocalLLaMA
  2. Pi extension: Skip reasoning with local Qwen 27B and proceed to answer right now — r/LocalLLaMA
  3. Claude and Grok built me a local monitoring setup for my AI box: two dashboards, one for the machine, one for model training — r/LocalLLM
  4. Cloudflare says its new Clef model means humans no longer need to be in the loop for AI agents — The Decoder
  5. I benchmarked Jev 1.13 against 4 local LLMs on RTX5070 12GB - amazing. — r/singularity
  6. Who’s the current “king” of local LLMs for you — Qwen, Gemma, Llama, something else? — r/LocalLLM
  7. Which LLM is best for coding/agents if I have dual R9700 GPUs? — r/LocalLLM
  8. Used Opus 5.5 to optimize llama.cpp inference for Swift Qwen 3.8 27B Q6_K on RTX 5090 - decode 143 tok/s prefill 2840 tok/s — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →