AINewsnow

DDR4 512GB vs. switching to DDR5 for MoE offload on a multi-GPU rig?

Setup: (if finished - still under construction, partly watercooled) Threadripper PRO 5995WX, ASUS WRX80E-SAGE SE WIFI II 6× RTX PRO 6000 8× RTX 5090 4× RTX 3090 128 GB DDR4 (that’s the problem) I want to run models bigger than VRAM (e.g. ~1T MoE at FP8/Q8) with the routed experts offloaded to RAM.…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-06 16:25 · r/LocalLLM
    DDR4 512GB vs. switching to DDR5 for MoE offload on a multi-GPU rig?

More stories

  1. Election backlash against data centers rattles AI stocks and expansion plans — TechCrunch AI
  2. Anthropic strikes $3.4bn deal for gas-fired generators to power AI data centres — Financial Times AI
  3. OpenAI to keep expanding AI data centers despite election results favoring restrictions — DigiTimes Asia
  4. Tencent AI chief warns AI will soon master biology, raising new safety risks — SCMP China Tech
  5. Hydra-PSIE expands 'Coeziune OM–IA' DOI registry to 39 published works — DEV Community — AI
  6. Developer's 48-Hour Field Notes Detail Free-Tier LLM Batch Job Failures — DEV Community — AI
  7. Apple's John Ternus reportedly pushing for faster AI progress beyond Siri upgrades — Techmeme
  8. US AI Safety Center Staff Now Report to White House, Raising Independence Concerns — AP News

Get the daily brief of stories like this at 6:30 every morning →