DeepSeek V4.1 Flash Unsloth IQ2 at 42 tok/s on one RTX 3090 + 192 GB RAM: Delta Inference Engine 0.94 (native Windows)
Delta Inference Engine 0.94 is out. It runs DeepSeek-V4.1-Flash-1017 on one NVIDIA GPU plus system RAM, natively on Windows (no WSL). It's a Windows port of Xolotl, which is built on Strata; on Linux, use upstream Xolotl. Speed on my PC (RTX 3090 24 GB, i5-13600K, 4x48 GB DDR5-5600, PCIe 4.0 NVMe)…
Read the full story at r/LocalLLM ↗
Timeline · 6 reports
- 2026-11-12 04:25 · DEV Community — Machine Learning
Evaluating DeepSeek-V4.1-Flash-1017 on a 60-Page PDF: What Text Extraction Misses - 2026-11-11 22:07 · r/machinelearningnews
New Inference Optimization technique speeds DeepSeek-V4.1-Flash up 3x on B200 than vLLM and SGLang running on GB300 - 2026-11-10 10:19 · DEV Community — AI
DeepSeek V4.1 Flash in DeepSeek Harness: GenUI praktisch einrichten und prüfen - 2026-11-09 23:32 · r/LocalLLaMA
Same prompt, DeepSeek V4.1 Flash vs Qwen 3.8 FN: 94 tok/s vs 350 tok/s - 2026-11-09 19:49 · r/LocalLLM
RustingStrata vs llama.cpp runs DeepSeek-V4.1-Flash Q2 (249 GB) on a single RTX 3060 12 GB with 30 GB RAM - 2026-11-09 13:47 · r/LocalLLM
DeepSeek V4.1 Flash Unsloth IQ2 at 42 tok/s on one RTX 3090 + 192 GB RAM: Delta Inference Engine 0.94 (native Windows)