AINewsnow

theogravity/deepseek-flash-v4.1-dual-rtx-6000: Setup for running DS4.1 flash with reasonable quality and speed on 2x RTX 6000 PRO @ 512k context c6 max w/ RAM and disk offload / caching

I saw a post mention this model to use for DS4.1 Flash with 2x 6000 Pros: https://huggingface.co/diffbot/DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000 Unfortunately the model card wants you to have > 260 GB RAM to properly use it. I had Opus move the n-grams to disk instead of RAM, and added in LMC…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-09 06:57 · r/LocalLLM
    theogravity/deepseek-flash-v4.1-dual-rtx-6000: Setup for running DS4.1 flash with reasonable quality and speed on 2x RTX 6000 PRO @ 512k context c6 max w/ RAM and disk offload / caching

More stories

  1. DeepSeek's Harness agent app reaches 1.54 million daily users — Bloomberg AI
  2. DeepSeek V4.1 Flash Gains Traction Across Benchmarks, Local Hardware, and Low-Cost APIs — Vercel Blog
  3. DeepSeek Harness daily active users quadruple to 1.54 million as plugin ecosystem grows — DigiTimes Asia
  4. Kimi K3.1 Pro (2.8T/104B) vs DeepSeek 1017 (552B/16B) vs GLM-5.3 & Qwen3.8-27B on AA Index v5: why a 16B-active model beats 104B on DeepSWE at 6.1x lower cost — r/machinelearningnews
  5. Nvidia Probe, Anthropic's $3.4B Power Deal, and DeepSeek's Agent Surge — DEV Community — AI
  6. Four Nvidia DGX Spark Boxes Serve DeepSeek To 16 Users At Once — DEV Community — Machine Learning
  7. Is it worth it? (Connected 9 ps5s together for a huge llm inference. ) — r/LocalLLM
  8. How to Use DeepSeek Harness Creator Mode for Beginners — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →