Fastest NVFP4 quant of Qwen3.8 27B out there
This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.
Here's a brand new Blackwell-native, prefill-optimized 4-bit quant that runs 50% faster on compatible hardware than a Q4 quant of the same memory footprint. And it runs 4-7% faster than other NVFP4 quants as benchmarked on RTX 5090 32GB. Quant Benchmark Speed NVFP4 pp2048 6250 t/s unsloth NVFP4 pp2…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-08-21 09:19 · r/LocalLLaMA
Fastest NVFP4 quant of Qwen3.8 27B out there