models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp
now you can use Flint in llama.cpp (merged after 6h) Model specifications Property Flint Developer Recursive Architecture Decoder-only mixture-of-experts Transformer Total parameters 39.8B Active parameters per token Approximately 2.5B, including the output head¹ Layers 49: 2 dense layers followed…
Read the full story at r/LocalLLaMA ↗
Timeline · 4 reports
- 2026-10-23 18:43 · r/LocalLLaMA
qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp - 2026-10-22 18:16 · r/LocalLLaMA
Massive B70 spec-decoding improvement - Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp - 2026-10-22 09:17 · r/LocalLLaMA
webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp - 2026-10-21 21:29 · r/LocalLLaMA
models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp