Lawyer's eight-V100 server runs DeepSeek-V4.1-Flash locally at near-NVFP4 quality
This story is from 2026-11-12. It is preserved in the archive; the latest stories are on the live feed.
A lawyer built a Claude-based legal harness from February to July 2026 and now runs it fully local on DeepSeek-V4.1-Flash across eight 2018 V100s, with 524K context and 100+ tok/s decode. Community benchmarks on Mac Studios and token-usage analyses followed.
Read the full story at AlphaSignal ↗
Timeline · 9 reports
- 2026-11-15 07:26 · DEV Community — AI
DeepSeek V4.1 Flash spent 84% of my tokens thinking: real latency, real cost, and the settings that fix it - 2026-11-15 01:55 · r/LocalLLM
I benchmarked DeepSeek-V4.1-Flash on one and two M5 Ultra 512 GB Mac Studios - 2026-11-14 12:50 · Tom's Hardware
Lawyer upgrades eight-V100 private AI server to run 80% of DeepSeek V4.1 Flash at 4-bit NVFP4 precision — adds 1TB of RAM, an Nvidia RTX 3090, and fixes crashes caused by a bad PSU - 2026-11-14 12:50 · Tom's Hardware
Lawyer’s eight-V100 AI server moves DeepSeek from 2-bit to near-NVFP4 precision - 2026-11-13 20:22 · r/LocalLLM
DeepSeek V4.1 Flash RAM overheat - 2026-11-12 23:37 · r/LocalLLM
[Crazy AI Lawyer] My Claude legal harness now runs 100% local on DeepSeek-V4.1-Flash: eight 2018 V100s at near-NVFP4 quality, 524K context, 100+ tok/s. Not as good as frontier, but it replaces real work today - 2026-11-12 23:33 · r/ClaudeAI
I spent Feb to July building a legal harness to make Claude more predictable. Now Opus 5.5 and Fable 5.2 have turned it into a 100% local DeepSeek harness and written custom GPU kernels for my 2018 V100s. Repo is public - 2026-11-12 23:31 · r/LocalLLaMA
Lawyer with too many GPUs, part 5: DeepSeek-V4.1-Flash at near-NVFP4 quality on eight V100s from 2018. 524K context, 100+ tok/s decode, ~160 tok/s with two chats at once, and my legal harness now runs on it, 100% local - 2026-11-12 22:31 · AlphaSignal
vLLM Rebuilds DeepSeek-V4.1-Flash Serving to Run 58x Faster on Rubin