AINewsnow

I split a 104 GB MoE between my desktop (RTX 3090) and my laptop (RTX 4060) over one Ethernet cable

I've been building my own local inference engine,, for big MoE models on consumer hardware. The newest piece is a pool is a second PC lends its GPU and RAM, and the model is split by layers across both machines. **Setup** - Desktop: RTX 3090 24 GB, i9-12900K, 32 GB DDR5-6000 - Laptop: RTX 4060 Lapt…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-11 15:10 · r/LocalLLM
    I split a 104 GB MoE between my desktop (RTX 3090) and my laptop (RTX 4060) over one Ethernet cable

More stories

  1. Google DeepMind's AlphaProof Code formally verifies Signal protocol in four weeks — Google DeepMind Blog
  2. Anthropic launches Claude Sheets, Whiteboards and Data as Fable 5.2 debuts — Anthropic (X)
  3. Google Cloud launches Gemini for Healthcare in U.S. preview — Google Cloud AI Blog
  4. The phantom life of Alice Huang, alleged Chinese spy who had affair with Nvidia CEO — CSET Georgetown
  5. Google DeepMind launches Gemini Robotics 2.5, reports 96% success in Mercedes-Benz sorting test — Google DeepMind Blog
  6. Anthropic IPO said to be multiple times oversubscribed ahead of record share sale — CNBC Technology
  7. Helsing launches Clarity, an AI military intelligence platform to rival Palantir — Financial Times AI
  8. Over 35,000 Grok-built apps found exposed online, leaking confidential data — Ars Technica AI

Get the daily brief of stories like this at 6:30 every morning →