Qwen 3.8 Flash Next GSQ RCO quant as good as BF16
This story is from 2026-11-04. It is preserved in the archive; the latest stories are on the live feed.
Unsloth has posted about their UD v3.1 quant for Qwen3.8 FN on X saying their new quant is 15% better than GSQ RCO as the almost same file size. But the takeaway from the post for me and many other how are using IQ_3S GSQ RCO with Strata is that it is 99.0% percent as good as the BF16 The chart of…
Read the full story at r/LocalLLaMA ↗
Timeline · 4 reports
- 2026-11-06 19:13 · r/LocalLLM
Qwen 3.8 Flash Next at 124 tok/s on 8GB VRAM and 16GB RAM + SSD, Q3 Quant - 2026-11-06 09:51 · r/LocalLLaMA
pi + strata + qwen 3.8 flash next q4 k xl --> funny stuff in logs - 2026-11-06 09:40 · r/LocalLLaMA
CyberTiel35BA3B working on Blender Rigging via MCP. 8GB VRAM, 16GB RAM. llama.cpp. - 2026-11-04 17:50 · r/LocalLLaMA
Qwen 3.8 Flash Next GSQ RCO quant as good as BF16
More stories
- CyberTiel35BA3B working on Blender Rigging via MCP. 8GB VRAM, 16GB RAM. llama.cpp. — r/LocalLLaMA
- Llama vs Qwen vs DeepSeek: How Much VRAM Do You Need to Self-Host? — DEV Community — AI
- Your AI models can change. Your memory shouldn't. — DEV Community — AI
- Blind listening test: 62 people compared 8-bar piano loops written by 8 LLMs (Gemini, Claude, Qwen, Kimi, Grok, GPT-6.1, DeepSeek, Llama). Interim results — r/artificial
- Hugging Face CEO Clément Delangue says his P(doom) is "close to zero", arguing that future AI risks stem from closed frontier AI labs, not open-source systems — Techmeme
- Strata for all Qwen models from little to big — r/LocalLLaMA
- Local LLM with real internet search: no API keys, 4 GB RAM, Windows 8.1 (open source) — DEV Community — AI
- Apple drops Siri AI waitlist in iOS 27 and opens integrations to all developers — ZDNET AI
Get the daily brief of stories like this at 6:30 every morning →