Quick, before Qwen4 comes out!
I'm running Qwen3.8 27B on my 2x 3060 12GB cards. Prior today I had a B550 motherboard which was running one card at x16 and the other at x1 PCIe Bus Link Speed. This was making it to where only one card was actually doing any processing, and both held the model in memory. I was getting 11-16 tps t…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-10 20:38 · r/LocalLLM
Quick, before Qwen4 comes out!