What's more impactful: more system RAM or faster RAM?
I currently have 32GB of system ram in a system with an RTX Pro 6000. Currently system memory seems to be the limiting factor in terms of running larger MOE models (like QFN) at higher quants with newer expert caching techniques. In a perfect world I would build a threadripper system, but given the…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-05 18:11 · r/LocalLLM
What's more impactful: more system RAM or faster RAM?