model: DSV4.1 flash by am17an · Pull Request #31086 · ggml-org/llama.cpp
only 763B params! :) https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash/blob/main/DeepSeek_V41_Tech_Report.pdf
Read the full story at r/LocalLLaMA ↗
Timeline · 3 reports
- 2026-10-25 16:37 · r/LocalLLaMA
qwen: merge tensors on convert by am17an · Pull Request #31028 · ggml-org/llama.cpp - 2026-10-25 09:35 · r/LocalLLaMA
CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/up rows by anujj · Pull Request #29948 · ggml-org/llama.cpp - 2026-10-25 02:16 · r/LocalLLaMA
model: DSV4.1 flash by am17an · Pull Request #31086 · ggml-org/llama.cpp