NVFP4 on VOLTA! Despite being built for Blackwell, I made four 2017 V100s run Qwen 3.8 NVFP4 natively and match my $6000 RTX 5090.
This story is from 2026-08-19. It is preserved in the archive; the latest stories are on the live feed.
Four Tesla V100s from 2017 matched my RTX 5090 on single-request Qwen 3.8 decode. Repo: https://github.com/dnv2003/v100-skinny https://i.redd.it/5ws2ak3uqckh1.gif The 5090 was not being held back. It ran NInfer , a specialist engine built to make this exact model as fast as possible on that GPU. (l…
Read the full story at r/LocalLLaMA ↗