AINewsnow

Running GLM 5.3 Flash on a 40 mini PC cluster via USB 3 interconnects at 14 tps

Hello! Here is a rack I made using 40 mini PCs I happened to have from a different project: Intel N150 12 GB DDR5 4800 - physical bandwidth limit around 33GBs Diskless nodes and they are connected via 10 Gbps USB 3.2 exploiting the USB DbC functionality. Its a tree topology with 1 -> 3 -> 9 -> 27 n…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-10 11:11 · r/LocalLLM
    Running GLM 5.3 Flash on a 40 mini PC cluster via USB 3 interconnects at 14 tps

More stories

  1. Anthropic launches Claude Fable 5.2 and Mythos 5.2 with coding gains and 20% price cut — Anthropic (X)
  2. Google DeepMind's AlphaProof Code Formally Verifies Signal Protocol Security — Google DeepMind Blog
  3. Anthropic targets up to $1.4 trillion valuation in IPO — Wall Street Journal Technology
  4. Nvidia CEO Jensen Huang Admits Affair With Executive Alleged to Be Chinese Spy — Axios AI+
  5. DeepSeek's Harness agent app reaches 1.54 million daily users — Bloomberg AI
  6. Australia to create AI safety regulator with mandatory reporting after OpenAI agent breach — Barron's
  7. Google Cloud launches Gemini for healthcare to unify clinical data and automate workflows — Google Cloud AI Blog
  8. Meta expands AI age-estimation globally to extend Instagram Teen Account protections — Meta Newsroom

Get the daily brief of stories like this at 6:30 every morning →