Comparing ISTA-DASLab's DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF 2.25bpw against the official API
I've been running ISTA-DASLab's 2.25bpw quant of DSv4.1-1017 for a few days, and it's holding up well. But the fact that it's only 2.25bpw average did make me wonder how good the quant actually is against the full model. Local setup: Project-maya v1.1.27. ISTA-DASLab's 2.25bpw quant. Quality-releva…
Read the full story at r/LocalLLaMA ↗
Timeline · 5 reports
- 2026-10-30 00:04 · r/LocalLLM
Deepseek v4.1 Flash 28.8Tk/s average on 5070Ti 9950X 128gb ram - 2026-10-29 17:46 · r/LocalLLaMA
Why you can't trust cloud API endpoints: 40 days of coding-agent telemetry showing the exact day providers silently overwrote deepseek-v4.1-flash with -1017 ("faster execution, shorter answers" = 3x more swearing and 6.7x more model switches) - 2026-10-29 08:26 · r/LocalLLM
DeepSeek-V4.1-Flash (2-bit, 258 GB) running on a single AMD MI50 32GB: ~23 tok/s decode, ~170 tok/s prefill (Strata + a handful of HIP patches) - 2026-10-28 00:39 · r/LocalLLaMA
DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090 - 2026-10-27 11:51 · r/LocalLLaMA
Comparing ISTA-DASLab's DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF 2.25bpw against the official API