AINewsnow

Lawyer's eight-V100 server runs DeepSeek-V4.1-Flash locally at near-NVFP4 quality

This story is from 2026-11-12. It is preserved in the archive; the latest stories are on the live feed.

A lawyer built a legal harness with Claude Code, then moved it to a fully local DeepSeek-V4.1-Flash setup on eight 2018 V100s, achieving near-NVFP4 quality, 524K context, and 100+ tok/s decode.

Read the full story at DEV Community — Machine Learning ↗

Timeline · 9 reports

  1. 2026-11-15 01:55 · r/LocalLLM
    I benchmarked DeepSeek-V4.1-Flash on one and two M5 Ultra 512 GB Mac Studios
  2. 2026-11-14 12:50 · Tom's Hardware
    Lawyer’s eight-V100 AI server moves DeepSeek from 2-bit to near-NVFP4 precision
  3. 2026-11-14 12:50 · Tom's Hardware
    Lawyer upgrades eight-V100 private AI server to run 80% of DeepSeek V4.1 Flash at 4-bit NVFP4 precision — adds 1TB of RAM, an Nvidia RTX 3090, and fixes crashes caused by a bad PSU
  4. 2026-11-13 20:22 · r/LocalLLM
    DeepSeek V4.1 Flash RAM overheat
  5. 2026-11-12 23:37 · r/LocalLLM
    [Crazy AI Lawyer] My Claude legal harness now runs 100% local on DeepSeek-V4.1-Flash: eight 2018 V100s at near-NVFP4 quality, 524K context, 100+ tok/s. Not as good as frontier, but it replaces real work today
  6. 2026-11-12 23:33 · r/ClaudeAI
    I spent Feb to July building a legal harness to make Claude more predictable. Now Opus 5.5 and Fable 5.2 have turned it into a 100% local DeepSeek harness and written custom GPU kernels for my 2018 V100s. Repo is public
  7. 2026-11-12 23:31 · r/LocalLLaMA
    Lawyer with too many GPUs, part 5: DeepSeek-V4.1-Flash at near-NVFP4 quality on eight V100s from 2018. 524K context, 100+ tok/s decode, ~160 tok/s with two chats at once, and my legal harness now runs on it, 100% local
  8. 2026-11-12 22:31 · AlphaSignal
    vLLM Rebuilds DeepSeek-V4.1-Flash Serving to Run 58x Faster on Rubin
  9. 2026-11-12 04:25 · DEV Community — Machine Learning
    Evaluating DeepSeek-V4.1-Flash-1017 on a 60-Page PDF: What Text Extraction Misses

More stories

  1. EXCLUSIVE: Chinese AI firms rush to secure Nvidia chip capacity as spy scandal stirs fear of US curbs — Reuters AI
  2. Lawyer's eight-V100 server runs DeepSeek-V4.1-Flash locally at near-NVFP4 quality — AlphaSignal
  3. Companies Tied to Alice Huang Invested in DeepSeek, Report Says — The Information AI
  4. Per ex OpenAI researcher, DeepSeek, Kimi, MiniMax, Ling models are all trained on Nvidia chips — r/singularity
  5. DeepSeek brings app capabilities including search, files, and voice to its API — DeepSeek News
  6. DeepSeek Web Code Reveals 'Coding Plan' Quota Management, No Official Announcement — Pandaily
  7. Every new model has a 1M-token context window. Do you still need retrieval? — DEV Community — AI
  8. Using Chinese LLM APIs From Malaysia: What Actually Works — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →