Performance tune for gemma4-26b-a4b flash attention shape. by frobnitzem · Pull Request #28450 · ggml-org/llama.cpp · GitHub

Gemma 26B A4B speedup

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

2026-09-22 17:39 · r/LocalLLaMA
Performance tune for gemma4-26b-a4b flash attention shape. by frobnitzem · Pull Request #28450 · ggml-org/llama.cpp · GitHub

More stories

Success running Qwen 3.8 27B EXL3 on RTX 3060 + 5060 Ti — r/LocalLLM
Has anyone actually replaced Claude with DeepSeek V4.1 Flash/Pro for tool-heavy daily work? — r/ClaudeAI
Transformers now runs llama.cpp quants — Hugging Face Blog
Qwen-3.8-Flash-Next on 1x RTX 5090: TG=50 t/s, PP=2300 t/s - with FreeToken — r/LocalLLaMA
The bear can dance: Qwen 3.8 27B on one 3090 for 3 weeks — r/LocalLLaMA
I trained a 360M-param Python model from scratch on two workstation GPUs and wrote up every step, including the bugs — r/learnmachinelearning
Dynamic Quantiser - a way to make your own high quality dynamic quants — r/LocalLLaMA
Is llama.cpp meant to be slow at long context, even when you aren't using that context? — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →