AINewsnow

DeepSeek 1.75 bpw on 64 GB RAM: Tuning the Expert-Cache Budget

DeepSeek benchmarks on consumer hardware, shared with fellow enthusiasts looking to run 763.2B (1.75 bpw) quantized models locally: Thirty-six decode requests compare nominal expert-cache budgets on a 64 GB RAM PC with an RTX 5060 Ti 16 GB. The --ssd-cache 63 setting reached an 11.7 tokens/s median…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-28 09:41 · r/LocalLLM
    DeepSeek 1.75 bpw on 64 GB RAM: Tuning the Expert-Cache Budget

More stories

  1. The Sequence Learning Loop - Issue #960: Last Week in AI Infrastructure — TheSequence
  2. Strata DeepSeek V4.1 Flash 1017 — r/LocalLLM
  3. DeepSeek 1017 Official API vs 2.25 BPW Quantized Version vs GPT 6.1 Terra vs Qwen 3.8FN 3.78 BPW — r/LocalLLM
  4. DeepSeek Just Made American AI Companies Panic — TheAIGRID
  5. Let the Gate Decide: Per-Lookup Precision for Quantized Conditional Memory in LLMs — arXiv cs.LG
  6. Deepseek crushed everyone — Matthew Berman
  7. Limits on pro — r/GeminiAI
  8. How GPT-6.1 Sol compared to Claude and DeepSeek as an agent in Salesforce — r/OpenAI

Get the daily brief of stories like this at 6:30 every morning →