AINewsnow

Tested: Qwen3.8-Flash-Next Q6 vs NVFP4 on my RTX 5090 using Strata — is the Q6 worth the extra memory ?

Unsloth Qwen3.8-Flash-Next UD-Q6_K_XL versus Qwen3.8-Flash-Next NVFP4-GPTQ Fresh MMLU-Pro comparison, speed and whether six bits are worth the wait. I wanted to find out whether slower Q6 generation bought better answers. I first compared Q6 with my saved NVFP4 quality results, then ran a fresh, id…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-23 09:02 · r/LocalLLM
    Tested: Qwen3.8-Flash-Next Q6 vs NVFP4 on my RTX 5090 using Strata — is the Q6 worth the extra memory ?

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. Securing our frontier model training environment — OpenAI News
  3. DeepSeek V4 Flash API prices compared across providers (Oct 2026) — r/huggingface
  4. Block unveils Dessa, a "true speech-to-speech" AI model trained on "nothing but human conversation" that it says runs locally on a MacBook Pro M4 Max or newer — Techmeme
  5. UK Vows £100 Million for Biosecurity Lab With OpenAI, Anthropic — Bloomberg AI
  6. Fired OpenAI researchers say independent safety audits aren't going well — NPR Technology
  7. Qwen 3.8 Flash Next GSQ-RCO IQ_3S at 70tok/s decode/1900tok/s prefill on 2013 Xeon E5-1680v2, 128GB quad channel DDR3-1866 ECC, and an EVGA 3090 FTW3 — r/LocalLLM
  8. Clean Energy Has a Lot Riding on the AI Data Center Boom — TIME Tech

Get the daily brief of stories like this at 6:30 every morning →