AINewsnow

Budget upgrade for a 31B model? Dual GPUs over PCIe x1 or another approach?

Looking for advice on upgrading my AI server on a budget. My goal is to run Gemma 4 31B Q5_K_M (~23GB) at 16K+ context (q8), achieving at least 15 t/s. I am aware of the 26B MoE, but I want the dense model after extensive testing. Current setup: --> CPU: Intel i5-14400F --> Motherboard: Gigabyte B7…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-20 02:50 · r/LocalLLaMA
    Budget upgrade for a 31B model? Dual GPUs over PCIe x1 or another approach?

More stories

  1. MiniMax launches M3.1 Flash, confirming Space Bunny was an early build — Vercel Blog
  2. Inception launches Mercury 3, a diffusion LLM it claims tops GPT-6 Luna, Claude Haiku 5.5, and GLM-5.3 Flash on agentic benchmarks while being 4x to 8x faster — Techmeme
  3. DeepSeek barred from government agency IT systems — Politico Technology
  4. AI Fears Roar Back With Data Center Firm Elice’s 32% Debut Flop — Bloomberg AI
  5. Ex-OpenAI worker accused of bugging offices planned to 'flee' to Saudi Arabia, prosecutors say — Sky News Technology
  6. Sources: Eric Schmidt, who owns ~1% of Anthropic after investing tens of millions in its Series A, is poised to have one of the largest windfalls from its IPO (Bloomberg) — Techmeme
  7. Spain-Based Startups Advance Regional Innovation With Barcelona Supercomputing Center — NVIDIA Blog
  8. Introducing Clairic, a new System One class of extraction models — Cloudflare Blog — AI

Get the daily brief of stories like this at 6:30 every morning →