NVFP4 - what does the quality usually equate to? (5090)
i keep seeing people recommending, for people with Blackwell/ 5090 cards, that using nvfp4 is "a no brainer" because of the big speed benefits. but my response is always... but that means trading down from Q5 or Q6 quality (depending on how much context I want) down to... what? ive assumed nvfp4 wa…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-23 20:16 · r/LocalLLaMA
NVFP4 - what does the quality usually equate to? (5090)