VLLM 4x rtx 3060 vs 8x rtx 3060 performance loss
Hello! I am currently building my local AI server, I have the Huananzhi H12D-8D EPYC Motherboard with 8x16GB memory sticks at 2666 mhz (waiting for the other components at the moment) I currently have four RTX 3060 12gb gpus and I plan running those at PCIe4 x16 in VLLM. However seeing that this mo…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-25 11:05 · r/LocalLLaMA
VLLM 4x rtx 3060 vs 8x rtx 3060 performance loss