AINewsnow

How to solve waisted vram

Hello fellow llmers! I have a bit of a problem I'm running 2x 3090 with 48gb memory (24gb each). And I'm also running 4x 1440p screens. The screens use 5gb vram. When I load models and split the layers between two cards it only uses 19gb per card. So 38gb effective vram to the models. I have anothe…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-28 16:54 · r/LocalLLM
    How to solve waisted vram

More stories

  1. NVIDIA Open Agent Safety Platform: A Reference for Continuous In-Silicon Agent Monitoring — NVIDIA Technical Blog
  2. How we found 24 Android vulnerabilities using our open source AI security agent — GitHub Blog
  3. Meta launches enterprise AI business seeking to cash in on vast spending — Financial Times AI
  4. AMD to Buy Fei-Fei Li’s World Labs AI Startup for $8.2 Billion — Bloomberg AI
  5. Heads of OpenAI and Anthropic called to face Senate inquiry after rogue agent incidents — The Guardian AI
  6. Introducing Claude Sonnet 5.5 on AWS — AWS Machine Learning Blog
  7. Scoop: Anthropic's Dario Amodei to have White House dinner with Trump — Axios AI+
  8. OpenAI agents posted user images online, disclose dozens of third party incidents — Axios AI+

Get the daily brief of stories like this at 6:30 every morning →