DeepSeek-V4.1-Flash sees wave of compressed releases from NVIDIA, ISTA and Unsloth
NVIDIA shipped an NVFP4 quantized DeepSeek-V4.1-Flash cutting 75 GB with matching benchmark scores, while ISTA released a 1-bit 763B coder build and Unsloth published new GGUFs, with community runs on 12 GB GPUs.
Read the full story at r/LocalLLaMA ↗
Timeline · 11 reports
- 2026-11-02 15:57 · r/LocalLLaMA
Unsloth vs GSQ-RCO - 512K context DeepSeek-V4.1 GGUF benchmarks Terminal Bench - 2026-11-02 15:52 · r/LocalLLaMA
Running UNCENSORED DeepSeek-V4.1-Flash-1017 on a 12 Gb VRAM - 2026-11-02 15:33 · r/LocalLLM
Uncensored versions of ISTA's GSQ-RCO DeepSeek-V4.1-Flash-1017 quants for Strata, benchmarks inside - 2026-11-02 15:11 · r/LocalLLM
New DeepSeek-V4.1-Flash-1017 Unsloth Dynamic V3.1 GGUFs! - 2026-11-02 14:33 · r/LocalLLaMA
[Release] ISTA DeepSeek-V4.1-Flash-1017 GSQ-RCO Coder: a 763B model at 1 bit per parameter - 2026-11-02 05:37 · r/LocalLLM
Getting incredible results with a single RTX 3090ti and 128gb of ram. Deepseek-V4.1-Flash-1017 (35 tok/s decode) and Qwen3.8-Flash-Next (130 tok/s decode) - 2026-11-01 21:01 · r/LocalLLaMA
Getting incredible results with a single RTX 3090ti and 128gb of ram. Deepseek-V4.1-Flash-1017 (35 tok/s decode) and Qwen3.8-Flash-Next (130 tok/s decode) - 2026-11-01 12:33 · AlphaSignal
NVIDIA Shrinks DeepSeek V4.1 Flash by 75 GiB With Almost No Quality Loss - 2026-10-31 23:04 · r/OpenAI
GPT-6.1 Terra one-shot a 3-level canvas game in 14 agent steps and 6.5 minutes. DeepSeek V4.1 Flash needed 73 steps but came in cheaper on 96% cache hits - 2026-10-31 06:16 · r/LocalLLM
How many of you still do use DeepSeek-V4-Flash-0731 with PolyStrata/Strata or its forks because DeepSeek-V4.1-Flash-1017 is too big? - 2026-10-31 05:32 · r/LocalLLaMA
Lawyer with too many GPUs, part 3: DeepSeek-V4.1-Flash on 2x DGX Spark + an old 3090 box. 2,600+ tok/s prefill to 256K, 322 tok/s structured output, full stack and raw data published