DeepSeek-V4.1-Flash-1017 quants shrink model to run on consumer hardware
This story is from 2026-10-31. It is preserved in the archive; the latest stories are on the live feed.
New quantized builds of DeepSeek-V4.1-Flash-1017, including NVIDIA's NVFP4 version and ISTA's 1-bit GSQ-RCO coder, cut the model's size dramatically while benchmarks show near-original quality, enabling runs on a 12 GB GPU or single RTX 3090ti.
Read the full story at r/LocalLLM ↗
Timeline · 10 reports
- 2026-11-02 15:57 · r/LocalLLaMA
Unsloth vs GSQ-RCO - 512K context DeepSeek-V4.1 GGUF benchmarks Terminal Bench - 2026-11-02 15:52 · r/LocalLLaMA
Running UNCENSORED DeepSeek-V4.1-Flash-1017 on a 12 Gb VRAM - 2026-11-02 15:33 · r/LocalLLM
Uncensored versions of ISTA's GSQ-RCO DeepSeek-V4.1-Flash-1017 quants for Strata, benchmarks inside - 2026-11-02 15:11 · r/LocalLLM
New DeepSeek-V4.1-Flash-1017 Unsloth Dynamic V3.1 GGUFs! - 2026-11-02 14:33 · r/LocalLLaMA
[Release] ISTA DeepSeek-V4.1-Flash-1017 GSQ-RCO Coder: a 763B model at 1 bit per parameter - 2026-11-02 05:37 · r/LocalLLM
Getting incredible results with a single RTX 3090ti and 128gb of ram. Deepseek-V4.1-Flash-1017 (35 tok/s decode) and Qwen3.8-Flash-Next (130 tok/s decode) - 2026-11-01 21:01 · r/LocalLLaMA
Getting incredible results with a single RTX 3090ti and 128gb of ram. Deepseek-V4.1-Flash-1017 (35 tok/s decode) and Qwen3.8-Flash-Next (130 tok/s decode) - 2026-11-01 12:33 · AlphaSignal
NVIDIA Shrinks DeepSeek V4.1 Flash by 75 GiB With Almost No Quality Loss - 2026-10-31 23:04 · r/OpenAI
GPT-6.1 Terra one-shot a 3-level canvas game in 14 agent steps and 6.5 minutes. DeepSeek V4.1 Flash needed 73 steps but came in cheaper on 96% cache hits - 2026-10-31 06:16 · r/LocalLLM
How many of you still do use DeepSeek-V4-Flash-0731 with PolyStrata/Strata or its forks because DeepSeek-V4.1-Flash-1017 is too big?