Windows 11 + 2× RTX 5060 Ti 16GB: Qwen3.8-27B NVFP4 at up to 76.65 tok/s — despite no GPU P2P
This story is from 2026-09-07. It is preserved in the archive; the latest stories are on the live feed.
I built a Windows 11 fork of NInfer specifically for running Qwen3.8-27B NVFP4 across two RTX 5060 Ti 16GB GPUs. The interesting part is that this is not an ideal multi-GPU setup: Windows 11 / WDDM GeForce GPUs cudaDeviceCanAccessPeer() = false No GPU P2P One GPU is connected through the Z690 chips…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-07 18:00 · r/LocalLLM
Windows 11 + 2× RTX 5060 Ti 16GB: Qwen3.8-27B NVFP4 at up to 76.65 tok/s — despite no GPU P2P