DeepSeek-V4.1-Flash runs on aging V100s and single RTX 3090 as local inference tools mature
This story is from 2026-11-03. It is preserved in the archive; the latest stories are on the live feed.
A lawyer reports DeepSeek-V4.1-Flash running on eight 2018 V100s at 200+ tok/s on code with 524K context, while the Delta Inference Engine v0.93 update enables usable performance from 64GB RAM on one RTX 3090.
Read the full story at Vercel Blog ↗
Timeline · 30 reports
- 2026-11-06 17:04 · DEV Community — Machine Learning
Weight-Space Programming: When LLMs Learn to Read and Rewrite Neural Network Weights - 2026-11-06 17:02 · r/machinelearningnews
Kimi K3.1 Pro (2.8T/104B) vs DeepSeek 1017 (552B/16B) vs GLM-5.3 & Qwen3.8-27B on AA Index v5: why a 16B-active model beats 104B on DeepSWE at 6.1x lower cost - 2026-11-06 04:35 · DEV Community — AI
Kimi K3.1 Pro Open Weights: A Developer's Checklist Before You Self-Host a 2.8T Model - 2026-11-06 01:44 · DEV Community — AI
Open models vs Claude: Kimi K3, GLM 5.3 and DeepSeek V4 Pro against Sonnet 5.5 and Opus 5.5 - 2026-11-05 21:16 · r/LocalLLM
[Crazy AI Lawyer] DeepSeek-V4.1-Flash on eight 2018 V100s is doing my real work now: 524K context, every weight in VRAM, 200+ tok/s on code, ~110 on legal writing, RAG and tool calls wired in - 2026-11-05 21:07 · r/LocalLLaMA
Lawyer with too many GPUs, part 4: DeepSeek-V4.1-Flash on eight V100s from 2018. 200+ tok/s on code, ~110 on legal writing, 2,200 tok/s prefill at 128K, 524K context, every weight in VRAM - 2026-11-05 19:28 · DEV Community — AI
Moonshot Just Put a 2.8-Trillion-Parameter Model on Hugging Face — Kimi K3.1 Pro's Open Weights Are Real, and the Fine Print Matters - 2026-11-05 18:23 · r/LocalLLaMA
DeepSeek-V4.1-Flash-1017 on one RTX 3090: Big updates to the Delta Inference Engine v0.93. Same 41 tok/s at 192GB/IQ2 at better quality, usable from 64 GB RAM, first token ~40% sooner, new Unsloth quants at full speed, EXL3, basic multi-GPU, public CI and more - 2026-11-05 16:51 · Matthew Berman
Kimi K3.1 weights OUT, open source computer use, SOTA image model, science model, Pika H3: AI NEWS - 2026-11-05 16:23 · DEV Community — AI
How Fusion works: DeepSeek V4 Pro plans, V4 Flash writes the code - 2026-11-05 14:19 · DEV Community — Machine Learning
Kimi K3.1 Pro Weights Are Out: $20M License Cliff, ~1.56 TB Reality, and Hosted vs Self-Host - 2026-11-05 13:10 · r/LocalLLM
2x RTX PRO 6000 running DeepSeek-V4-Flash (284B) fully offline: 1,170 tok/s peak - 2026-11-05 07:12 · r/machinelearningnews
Sparks of Weight-Space Programming:LLMs can natively read & write neural network weights - 2026-11-05 07:09 · Pandaily
Alibaba Cloud Lingjun Zhenwu M890 SuperPoD Adds Day-Zero Support for Kimi K3.1 Pro - 2026-11-05 06:55 · DEV Community — AI
LongCat-2.5 vs Kimi K3.1 Pro vs DeepSeek: Which New AI Wins? - 2026-11-05 06:01 · TechNode
Moonshot AI releases Kimi K3.1 Pro model weights - 2026-11-05 02:23 · Pandaily
Huawei Ascend Adds Day-Zero Support for Kimi K3.1 Pro Across Atlas A3 and Ascend 950 SuperPoDs - 2026-11-04 20:54 · DEV Community — AI
Moonshot AI's Kimi K3.1 Pro Weights Are Now Open — Explained Honestly - 2026-11-04 17:00 · Vercel Blog
Kimi K3.1 Pro now has more ZDR providers on AI Gateway - 2026-11-04 16:00 · AlphaSignal
Moonshot AI Opens Kimi K3.1 Pro Weights to Beat Claude on Coding Agents - 2026-11-04 15:44 · r/LocalLLaMA
Kimi-K3.1-Pro is now open-weights - 2026-11-04 12:56 · DEV Community — Machine Learning
Weight-Space Programming - 2026-11-04 12:15 · DEV Community — AI
Moonshot AI's Kimi 3D Make Builds a Two-Arm Robot Workcell From a Single Prompt - 2026-11-04 10:33 · DEV Community — Machine Learning
Weight-Space Programming: how GPT-6 Astra edited Qwen's weights and took MATH-500 from 7.9% to 48.1% - 2026-11-04 09:46 · DEV Community — AI
Build a Same-Prompt Harness: Compare Kimi K3.1 Pro, DeepSeek V4.1 Flash, GPT-5.1, and Qwen3.8 Max on Meeting Notes - 2026-11-04 08:44 · r/LocalLLM
Deepseek v4–flash-0731，rtx5900+96gb or rtx spark 128gb? - 2026-11-04 02:26 · r/mlscaling
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights - 2026-11-03 20:53 · Pandaily
Huawei Cloud to Retire openPangu-2.0 Models From MaaS, Recommends DeepSeek-V4.1-Flash and GLM-5.3 - 2026-11-03 19:26 · r/LocalLLaMA
DeepSeek V4.1 Flash 1017 can also do Weight-Space Programming - 2026-11-03 05:35 · Latent Space
[AINews] LLMs can read & write neural network weights: "Weight Space Programming" cuts Autoresearch out of the RSI loop