DeepSeek-V4.1-Flash-1017 on 4x DGX Spark (TensorFold TP4, EXL3 3.5bpw): concurrency sweep to 16 streams
I've been running the 1017 Flash update on four DGX Sparks for about a week now as my main endpoint, because it beat the GLM-5.3-Flash vLLM I was using on decode and fixed the wierd GLM tool looping issue I was seeing in some search and read operations. A few people asked how it holds up with more…
Read the full story at r/LocalLLM ↗
Timeline · 5 reports
- 2026-10-28 00:39 · r/LocalLLaMA
DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090 - 2026-10-27 11:51 · r/LocalLLaMA
Comparing ISTA-DASLab's DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF 2.25bpw against the official API - 2026-10-27 06:31 · r/LocalLLM
Has anyone tried GSQ RCO Qwen3.8 flash next IQ3_s vs deepseek v4.1 1017 IQ1_M? - 2026-10-27 06:03 · r/LocalLLaMA
Do GX10s / DGX Sparks Dream of Throttling? Temps across 6 cooling setups running DeepSeek V4.1-Flash (spoiler: no) - 2026-10-26 17:59 · r/LocalLLM
DeepSeek-V4.1-Flash-1017 on 4x DGX Spark (TensorFold TP4, EXL3 3.5bpw): concurrency sweep to 16 streams