AINewsnow

Is it worth it? (Connected 9 ps5s together for a huge llm inference. )

uhm...... yeah. grinded some useful (and meaningfu?l) resources. on my way to run DeepSeek-V3 IQ1_M (~1.5-bit to 1.58-bit) >>>>>>>> The model weights take up roughly 130 GB. This leaves us with about 30 GB of breathing room across the cluster to handle KV Cache and context overhead. Cuz each PS5 ha…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-08 22:44 · r/LocalLLM
    Is it worth it? (Connected 9 ps5s together for a huge llm inference. )

More stories

  1. DeepSeek's open-source agent app Harness hits 1.54M DAUs in under three months — Techmeme
  2. DeepSeek V4.1 Flash Gains Traction Across Benchmarks, Local Hardware, and Low-Cost APIs — Vercel Blog
  3. Tencent launches Hy4 AI model with visual reasoning and tighter safety controls — DigiTimes Asia
  4. Nvidia Probe, Anthropic's $3.4B Power Deal, and DeepSeek's Agent Surge — DEV Community — AI
  5. Four Nvidia DGX Spark Boxes Serve DeepSeek To 16 Users At Once — DEV Community — Machine Learning
  6. DeepSeek's AI Agent Platform Reaches 1.54 Million Daily Users — Bloomberg AI
  7. How to Use DeepSeek Harness Creator Mode for Beginners — DEV Community — AI
  8. How to Use DeepSeek Through an OpenAI-Compatible API — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →