AINewsnow

qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp

gigabytes of VRAM saved (Qwen Flash Next) "This is one of the things Strata does to squeeze the most juice from the experts' cache."

Read the full story at r/LocalLLaMA ↗

Timeline · 3 reports

  1. 2026-10-25 09:35 · r/LocalLLaMA
    CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/up rows by anujj · Pull Request #29948 · ggml-org/llama.cpp
  2. 2026-10-25 02:16 · r/LocalLLaMA
    model: DSV4.1 flash by am17an · Pull Request #31086 · ggml-org/llama.cpp
  3. 2026-10-23 18:43 · r/LocalLLaMA
    qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp

More stories

  1. Qwen 3.8 Flash Next (129 GB) is better than 2.6 bpw DeepSeek V4.1 Flash 1017 (187 GB + 203 GB Engram) — r/LocalLLaMA
  2. What's the best front-end for LLM assisted studying? — r/LocalLLM
  3. GitHub - vincalkr/DS41Engine: DeepSeek-V4.1-Flash 1017 on 1x-2x RX 7900 XTX (gfx1100, ROCm/HIP): max optimizations — r/LocalLLM
  4. I ran local AI inference (AMD GPU) for 30 days and measured every watt — here's the real cost vs cloud APIs — r/LocalLLM
  5. Meet Groot — four smaller models for reasoning, coding and tool use — r/huggingface
  6. OpenAI and Anthropic support OSS maintainers. Do Chinese AI companies offer similar programs? — r/artificial
  7. I ran a blind test on local AI agents. Here are the results, guess who's who — r/AI_Agents
  8. It is not clear to me which parameter we should use for LoRA training—shift or sigmoid—in the new models (Qwen 2.1, LLaMA 2, and MOSS) within the AI ​​toolkit. — r/comfyui

Get the daily brief of stories like this at 6:30 every morning →