Ran DeepSeek V4.1 Flash 1017 on a single RTX 5090
Been working over the last few days getting DeepSeek V4.1 Flash 1017 (Unsloth UD-IQ1_S) running in Basalt (inference engine I'm developing). Specs: RTX 5090 (400W) + RTX 5060 Ti 16 GB (180W), 128 GB DDR5. Methodology: Single 243 GB file (weights + vision + drafter). Engram table on SSD. All experts…
Read the full story at r/LocalLLaMA ↗
Timeline · 13 reports
- 2026-10-24 05:31 · DEV Community — AI
Muse Spark Open vs DeepSeek V4.1 Flash in Claude Code: what to measure before you pick - 2026-10-23 23:38 · r/LocalLLM
ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO - 2026-10-23 23:37 · r/LocalLLaMA
ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO - 2026-10-23 20:06 · r/huggingface
5.5× llama.cpp’s prefill throughput on DeepSeek V4.1 Flash 1017 GGUF: TensorSharp benchmarks and quality checks - 2026-10-23 18:32 · r/LocalLLM
Full DeepSeek-V4.1-Flash-1017 (510 GB, original weights) on a 64 GB RAM + RTX 3060 12 GB PC: up to 7.4 tok/s, 98.3% agreement with the full model. Engine released (Apache-2.0) - 2026-10-23 17:23 · AlphaSignal
DeepSeek's V4.1 Flash 1017 Tops Public Cybersecurity Rankings at $0.42 per Task - 2026-10-23 11:49 · r/LocalLLaMA
Maya-XS runs DeepSeek-V4.1-Flash in 120.6 GB, with all 384 experts resident in GPU memory on a 128 GB Ryzen AI Max. - 2026-10-22 20:58 · r/LocalLLM
GitHub - vincalkr/DS41Engine: DeepSeek-V4.1-Flash 1017 on 1x-2x RX 7900 XTX (gfx1100, ROCm/HIP): max optimizations - 2026-10-22 13:30 · r/huggingface
Full DeepSeek-V4.1-Flash-1017 (510 GB) on an RTX 3060 12 GB + 64 GB DDR4 + NVMe: 5.8 tok/s cold, 7.4 warm, >97% exact quality. - 2026-10-22 13:29 · r/LocalLLM
Full DeepSeek-V4.1-Flash-1017 (510 GB) on an RTX 3060 12 GB + 64 GB DDR4 + NVMe: 5.8 tok/s cold, 7.4 warm, >97% exact quality. - 2026-10-22 08:25 · r/huggingface
DeepSeek V4 Flash API prices compared across providers (Oct 2026) - 2026-10-21 18:11 · r/LocalLLaMA
Tried running 748B DeepSeek-V4.1-Flash on a €2k PC - 2026-10-21 15:38 · r/LocalLLaMA
Ran DeepSeek V4.1 Flash 1017 on a single RTX 5090