Qwen3.8 27b nvfp4 doing 180t/s on dual v100 16g without nvlink.
this is the legend of V100 , the pair of v100s isnt end, and the The legend of V100 is eternal!!!! the 27b in video is doing kv Q8 , and MTP4/0 btw repo: tuxKOH/ninfer-V100X2
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-14 15:24 · r/LocalLLM
Qwen3.8 27b nvfp4 doing 180t/s on dual v100 16g without nvlink.