AINewsnow

I tested different Qwen 3.8 27B quants

There is a lot of discussion which quant to use. Especially a lot of post how much speed you gain with FP4, but not much about quality. So i tested some of the models that I use on my R9700. Models : Qwen3.8-27B-UD-Q6_K_L.gguf Swift-Qwen3.8-27B-Q6_K.gguf Swift-1.5-Qwen3.8-27B-MXFP4-A-outQ6_K.gguf H…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-11 20:24 · r/LocalLLaMA
    I tested different Qwen 3.8 27B quants

More stories

  1. Qwen-Image 2.1 Turbo gains support across local AI tools and ComfyUI — r/StableDiffusion
  2. Qwen 3.8 Flash-Next enables high-speed local inference on consumer hardware — r/LocalLLM
  3. Qwen3.6 35B-A3B optimized for a 4 GB GTX 1050 Ti Mobile: up to 2× prefill and 3× decode vs llama.cpp — r/LocalLLM
  4. Thinking vs Instruct for Qwen 3.8 27b — r/LocalLLM
  5. Gen Al on a laptop? — r/LocalLLM
  6. qwen 2.1 turbo or normal - fixed the artifacts — r/StableDiffusion
  7. My new iPad Air M4 base variant just ran Qwen 3.5 9B very smoothly and super fast — r/LocalLLM
  8. "Strata" for GLM5.3 Flash is here for some! Project Maya — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →