DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090
No, this is not a lobotomized 1-bit squeeze, its full Q2 nazeshinjite's DeepSeek-V4.1-Flash-1017 Q2 GGUF on a single 3090, natively on Windows no WSL. On an RTX 3090 with 192 GB of RAM I'm writing at 41 tok/s (average across multiple prompts) and the output agrees with DeepSeek's own API on the nex…
Read the full story at r/LocalLLaMA ↗
Timeline · 5 reports
- 2026-10-30 14:27 · DEV Community — AI
DeepSeek V4.1 Flash vs V4 Pro: The Two Benchmarks It Lost - 2026-10-30 00:04 · r/LocalLLM
Deepseek v4.1 Flash 28.8Tk/s average on 5070Ti 9950X 128gb ram - 2026-10-29 17:46 · r/LocalLLaMA
Why you can't trust cloud API endpoints: 40 days of coding-agent telemetry showing the exact day providers silently overwrote deepseek-v4.1-flash with -1017 ("faster execution, shorter answers" = 3x more swearing and 6.7x more model switches) - 2026-10-29 08:26 · r/LocalLLM
DeepSeek-V4.1-Flash (2-bit, 258 GB) running on a single AMD MI50 32GB: ~23 tok/s decode, ~170 tok/s prefill (Strata + a handful of HIP patches) - 2026-10-28 00:39 · r/LocalLLaMA
DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090