model: add NVIDIA Nemotron-3-Puzzle-75B-A9B (NemotronHPuzzle) support by YanissAmz · Pull Request #25444 · ggml-org/llama.cpp
This story is from 2026-09-03. It is preserved in the archive; the latest stories are on the live feed.
75B MoE is an interesting size to check, you can run it today (no MTP support yet) The model employs a hybrid MoE architecture with interleaved Mamba, MoE, and Attention layers. Like Nemotron-3-Super, it supports Multi-Token Prediction (MTP) for faster text generation. Compared to its parent, Puzzl…
Read the full story at r/LocalLLaMA ↗
Timeline · 4 reports
- 2026-09-06 02:16 · r/LocalLLM
KV Cache Streaming from RAM - 2026-09-06 02:15 · r/LocalLLaMA
Block KV cache streaming: bound VRAM at long context via a shared CUDA phase arena by giveen · Pull Request #357 · TheTom/llama-cpp-turboquant - 2026-09-04 13:20 · r/LocalLLaMA
Model: add Tencent Hy 4 (hy_v4) preview architecture support by Little0o0 · Pull Request #28127 · ggml-org/llama.cpp - 2026-09-03 07:35 · r/LocalLLaMA
model: add NVIDIA Nemotron-3-Puzzle-75B-A9B (NemotronHPuzzle) support by YanissAmz · Pull Request #25444 · ggml-org/llama.cpp