llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

it's time to update your llama.cpp for another speedup (sparse attention models)

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

2026-10-21 21:29 · r/LocalLLaMA
models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp
2026-10-21 19:34 · r/LocalLLaMA
llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

More stories

Jundot--Qwen3.8-Flash-Next-oQ4-mtp running on a Mac Studio M2 192gb with oMLX and OpenwebUI thinks it is Claude??? — r/LocalLLM
1-bit Bonsai-27B on a 6 GB GTX 1660 SUPER: 18.7 -> 54.3 tok/s (+190%) with a Q1_0 CUDA patch for llama.cpp — r/LocalLLM
Making llama.cpp faster on the V100 — r/LocalLLM
Locals: an Apple Silicon engine that runs local agents up to 3x faster. — r/LocalLLM
Fast LoRA in llama.cpp — r/LocalLLaMA
Strata speed up on Apple Silicon? — r/LocalLLaMA
How to squeeze the Max Token from M1 Max 64gb? — r/LocalLLaMA
Installing qwen model on my smartphone — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →