I gave Qwen 3.8 27B vision model at different bit widths; bf16, Q4_K_M, Q3_K_M, my 12 GB quant, and Ternary Bonsai2 a design brief as a single IMAGE and made it build the animation. Side-by-side videos + per-check scores.
Follow up to my previous post in which I showed a quantized version of Qwen 3.8 27b that had a Wikitext PPL on par with the q4_k_m quant at a ~27% reduction in file size. I got a lot of pushback regarding the use of that PPL metric and how it doesn't really show if the quants are worth using. So I…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-20 17:01 · r/LocalLLM
I gave Qwen 3.8 27B vision model at different bit widths; bf16, Q4_K_M, Q3_K_M, my 12 GB quant, and Ternary Bonsai2 a design brief as a single IMAGE and made it build the animation. Side-by-side videos + per-check scores.
More stories
- Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
- Qwen Image 2.1 PR to ComfyUI — r/StableDiffusion
- Alibaba releases Qwen-Image-2.1, a 7B open-weight model it says outperforms most closed-source models, with native transparency and up to ten reference images (Qwen) — Techmeme
- Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
- 10 hours left fo Qwen Image 2.1 Public Open Source Release — r/StableDiffusion
- Qwen 3.8 27B running on a single RTX 5090 researches and creates a full animation using only code. — r/artificial
- US government website used Chinese model the FBI called "malicious" — Ars Technica AI
- M2 Mac ultra128gb Qwen flash next — r/LocalLLM
Get the daily brief of stories like this at 6:30 every morning →