Which Qwen 3.8 27B NVFP4 quant is better? Nvidia or Unsloth?

I see both vendors have an NVFP4 quant on hugging face - from what I can understand Nvidia's is maybe faster, and Unsloth preserves more accuracy? What's the practical difference between these two and which should I choose?

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-10-22 18:17 · r/LocalLLM
Which Qwen 3.8 27B NVFP4 quant is better? Nvidia or Unsloth?

More stories

KFlash: Benchmarks of newly released versions of Apple Silicon optimized engines: 1.4.0 Splash (DFlash2 ~ 50 tok/s) vs 0.2 Kapitsa (KFlash ~65 tok/s), MLX(MTP) & more on Qwen 3.8 27b/4b/35b 4Q on Macbook Pro M4 Pro 48 GB 2024, 48GB & Macbook Pro M1 Pro 16GB 2021 — r/LocalLLaMA
What models would be worth backing up in case they start being taken down? — r/LocalLLM
InternScience/Sage-A1.5 [Finetune of Qwen 3.6 35b-a3b] — r/LocalLLaMA
Agnes-AI/Agnes-3.0-Qwen (QFN finetune) — r/LocalLLaMA
migtissera/Tess-4.5-27B (Qwen finetune) — r/LocalLLaMA
OpenAI donates Open Responses, its spec for a common LLM API, to the Agentic AI Foundation — The New Stack AI
Qwen 3.8 Flash Next: drastically faster and much more precise in reaching the result. — r/LocalLLaMA
Make Volta Great Again! — Strata: 500 tok/s System Aggregate Decode, 6,000+ tok/s Prefill, Built on six $150 Volta GPUs — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →