Lawyer's eight-V100 server runs DeepSeek-V4.1-Flash locally at near-NVFP4 quality
A lawyer built a legal harness with Claude, then moved it fully local: DeepSeek-V4.1-Flash runs on eight 2018 V100s at near-NVFP4 quality with 524K context and 100+ tok/s, with a public repo.
Read the full story at r/LocalLLaMA ↗
Timeline · 9 reports
- 2026-11-14 12:50 · Tom's Hardware
Lawyer’s eight-V100 AI server moves DeepSeek from 2-bit to near-NVFP4 precision - 2026-11-14 12:50 · Tom's Hardware
Lawyer upgrades eight-V100 private AI server to run 80% of DeepSeek V4.1 Flash at 4-bit NVFP4 precision — adds 1TB of RAM, an Nvidia RTX 3090, and fixes crashes caused by a bad PSU - 2026-11-13 20:22 · r/LocalLLM
DeepSeek V4.1 Flash RAM overheat - 2026-11-12 23:37 · r/LocalLLM
[Crazy AI Lawyer] My Claude legal harness now runs 100% local on DeepSeek-V4.1-Flash: eight 2018 V100s at near-NVFP4 quality, 524K context, 100+ tok/s. Not as good as frontier, but it replaces real work today - 2026-11-12 23:33 · r/ClaudeAI
I spent Feb to July building a legal harness to make Claude more predictable. Now Opus 5.5 and Fable 5.2 have turned it into a 100% local DeepSeek harness and written custom GPU kernels for my 2018 V100s. Repo is public - 2026-11-12 23:31 · r/LocalLLaMA
Lawyer with too many GPUs, part 5: DeepSeek-V4.1-Flash at near-NVFP4 quality on eight V100s from 2018. 524K context, 100+ tok/s decode, ~160 tok/s with two chats at once, and my legal harness now runs on it, 100% local - 2026-11-12 22:31 · AlphaSignal
vLLM Rebuilds DeepSeek-V4.1-Flash Serving to Run 58x Faster on Rubin - 2026-11-12 04:25 · DEV Community — Machine Learning
Evaluating DeepSeek-V4.1-Flash-1017 on a 60-Page PDF: What Text Extraction Misses - 2026-11-12 00:50 · r/LocalLLaMA
DeepSeek V4.1 Flash 1017 exl3 2.9bpw APEX 2025 benchmark results