4x RTX 3090 PCIe 4.0 x16 - advice? Qwen 3.8 Next Flash?
We're upgrading our server (Threadripper Pro 5955WX, 128GB 8-channel DDR4) from two RTX 3090 to four cards. Currently we're running Qwen 3.8 27b Q8 with vLLM for a few users. I'm wondering what we should do next: Keep running Qwen 3.8 27b Q8 and enjoy the performance boost and use a bit of spare VR…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-19 10:49 · r/LocalLLaMA
4x RTX 3090 PCIe 4.0 x16 - advice? Qwen 3.8 Next Flash?