AINewsnow

Budget LLM Workstation

Finally got my old setup running and wanted to share the results so far. Xeon W-2245 256GB DDR4-2666 ECC RAM (8 × 32GB) 2 × NVIDIA RTX PRO 4000 Blackwell Right now I’m running Qwen3.8 FN and DeepSeek V4.1 Flash. With the DeepSeek model at 2.25 bpw, I’m seeing around 30–35 tokens/s. Qwen is hitting…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-04 03:58 · r/LocalLLM
    Budget LLM Workstation

More stories

  1. DeepSeek, Qwen and MiniMax Leads Debate Open-Source Model Risks on Shared Wuzhen Stage — Pandaily
  2. E2E Networks Launches Blaze for Pay-Per-Token AI Inference — Analytics India Magazine
  3. Setup For Automatic Reverse Engineering — r/LocalLLM
  4. Am I Crazy Or GLM 5.3 Flash is Hilarious? — r/LocalLLaMA
  5. Tencent unveils Hy4 as open-weight AI race with DeepSeek, Z.ai, Alibaba heats up — South China Morning Post Tech
  6. NVIDIA Shrinks DeepSeek V4.1 Flash by 75 GiB With Almost No Quality Loss — AlphaSignal
  7. DeepSeek V5 reportedly targets Huawei Ascend 950 training in 2027, a crucial test for a Chinese alternative to Nvidia — DigiTimes Asia
  8. Runway News | Runway Dev is in Claude Code, Codex and Cursor — Runway Research

Get the daily brief of stories like this at 6:30 every morning →