Too good to be true? ISTA's GSQ-RCO 2-bit DeepSeek-V4.1-Flash scoring the same as the base model
Has anyone tried ISTA's GSQ-RCO GGUFs for DeepSeek-V4.1-Flash? Does the quality feel as good as their benchmarks show (IQ2_XXS matching the base)? Their benchmarks are saturated (90%+, and AIME25 is 100 for every version), so they probably can't show the degradation, and I couldn't find any KLD for…
Read the full story at r/LocalLLaMA ↗
Timeline · 12 reports
- 2026-10-27 11:51 · r/LocalLLaMA
Comparing ISTA-DASLab's DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF 2.25bpw against the official API - 2026-10-27 06:31 · r/LocalLLM
Has anyone tried GSQ RCO Qwen3.8 flash next IQ3_s vs deepseek v4.1 1017 IQ1_M? - 2026-10-27 06:03 · r/LocalLLaMA
Do GX10s / DGX Sparks Dream of Throttling? Temps across 6 cooling setups running DeepSeek V4.1-Flash (spoiler: no) - 2026-10-26 22:02 · AlphaSignal
Cursor Adds DeepSeek V4.1 Flash Hitting 47.7% for Under $1 per Task - 2026-10-26 20:15 · AlphaSignal
Inference.net Unlocks DeepSeek V4.1 Flash for Security Teams Behind Gated Access - 2026-10-26 17:59 · r/LocalLLM
DeepSeek-V4.1-Flash-1017 on 4x DGX Spark (TensorFold TP4, EXL3 3.5bpw): concurrency sweep to 16 streams - 2026-10-25 17:40 · r/LocalLLM
Strata DeepSeek V4.1 Flash 1017 - 2026-10-25 09:06 · r/LocalLLM
I Built the Eiffel Tower Using Qwen3.8 Flash Next IQ3_S (Local AI) - 2026-10-25 06:49 · r/LocalLLM
Lean-QwenFlash: Qwen3.8-Flash-Next (125B) running at ~20 tok/s on 16gb vram and 8gb ram via direct nvme SSD offloading - 2026-10-25 06:41 · r/LocalLLaMA
Lean-QwenFlash: Qwen3.8-Flash-Next (125B) running at ~20 tok/s on 16gb vram and 8gb ram via direct nvme SSD offloading - 2026-10-25 03:59 · r/LocalLLaMA
[Benchmark] Strata/Basalt runs Qwen3.8 Flash Next IQ3_S with 16GB VRAM and 55GB RAM with up to 250 tok/s generation and 5,600 tok/s prompt processing (5080, Concurrency 1) - 2026-10-25 03:48 · r/LocalLLaMA
Too good to be true? ISTA's GSQ-RCO 2-bit DeepSeek-V4.1-Flash scoring the same as the base model