DeepSeek-V4.1-Flash quants bring large MoE models to modest consumer hardware
Community releases of DeepSeek-V4.1-Flash-1017 quants, including ISTA's 1-bit GSQ-RCO build and Unsloth's Dynamic V3.1 GGUFs, run the 552B-763B MoE model on a single 12GB GPU or older servers, with users reporting 10-130 tok/s decode speeds.
Read the full story at r/OpenAI ↗
Timeline · 10 reports
- 2026-11-03 03:59 · r/LocalLLM
DeepSeek V4.1 Flash (552B) on a used Dell R820 from 2012: 10 tok/s decode, 100 tok/s prefill - 2026-11-02 15:57 · r/LocalLLaMA
Unsloth vs GSQ-RCO - 512K context DeepSeek-V4.1 GGUF benchmarks Terminal Bench - 2026-11-02 15:52 · r/LocalLLaMA
Running UNCENSORED DeepSeek-V4.1-Flash-1017 on a 12 Gb VRAM - 2026-11-02 15:33 · r/LocalLLM
Uncensored versions of ISTA's GSQ-RCO DeepSeek-V4.1-Flash-1017 quants for Strata, benchmarks inside - 2026-11-02 15:11 · r/LocalLLM
New DeepSeek-V4.1-Flash-1017 Unsloth Dynamic V3.1 GGUFs! - 2026-11-02 14:33 · r/LocalLLaMA
[Release] ISTA DeepSeek-V4.1-Flash-1017 GSQ-RCO Coder: a 763B model at 1 bit per parameter - 2026-11-02 05:37 · r/LocalLLM
Getting incredible results with a single RTX 3090ti and 128gb of ram. Deepseek-V4.1-Flash-1017 (35 tok/s decode) and Qwen3.8-Flash-Next (130 tok/s decode) - 2026-11-01 21:01 · r/LocalLLaMA
Getting incredible results with a single RTX 3090ti and 128gb of ram. Deepseek-V4.1-Flash-1017 (35 tok/s decode) and Qwen3.8-Flash-Next (130 tok/s decode) - 2026-11-01 12:33 · AlphaSignal
NVIDIA Shrinks DeepSeek V4.1 Flash by 75 GiB With Almost No Quality Loss - 2026-10-31 23:04 · r/OpenAI
GPT-6.1 Terra one-shot a 3-level canvas game in 14 agent steps and 6.5 minutes. DeepSeek V4.1 Flash needed 73 steps but came in cheaper on 96% cache hits