DeepSeek V4.1 Flash 763B runs on consumer hardware as local inference setups multiply
Community reports show the 763B DeepSeek V4.1 Flash running at 25-42 tok/s on mismatched GPUs, a single RTX 3090, or a 12 GB card with RAM streaming, plus faster Mac setups via RAID 0 SSDs and benchmark comparisons with Claude Haiku 5.5.
Read the full story at Vercel Blog ↗
Timeline · 8 reports
- 2026-11-09 19:49 · r/LocalLLM
RustingStrata vs llama.cpp runs DeepSeek-V4.1-Flash Q2 (249 GB) on a single RTX 3060 12 GB with 30 GB RAM - 2026-11-09 13:47 · r/LocalLLM
DeepSeek V4.1 Flash Unsloth IQ2 at 42 tok/s on one RTX 3090 + 192 GB RAM: Delta Inference Engine 0.94 (native Windows) - 2026-11-09 05:54 · DEV Community — AI
Ollama vs. llama.cpp on the Same GGUF: The 15% Speed Gap Was the Defaults, Not the Engine - 2026-11-08 20:27 · DEV Community — AI
DeepSeek V4.1 Flash API: Clean and Tag 10,000 Comments, and What It Costs - 2026-11-08 03:33 · DEV Community — AI
DeepSeek V4.1 Flash vs Claude Haiku 5.5: a 17-task benchmark of the two cheapest tiers - 2026-11-07 06:39 · r/LocalLLM
Two Thunderbolt 5 SSDs in RAID 0 made DeepSeek V4.1 Flash (763B) about 25% faster on my M3 Ultra with InferSSD - 2026-11-07 00:00 · Vercel Blog
DeepSeek V4.1 Flash 1017 Ultrafast now available on AI Gateway - 2026-11-06 23:45 · r/LocalLLM
Making the most of the GPUs we could get: 763B DeepSeek V4.1 Flash at 25.6 tok/s on a mismatched R9700 + Arc Pro B65 + 128 GB RAM, no speculation