AINewsnow

This draft model is OP on 16 GB cards for Qwen 3.8 27b

This story is from 2026-09-12. It is preserved in the archive; the latest stories are on the live feed.

https://huggingface.co/HermiHg/Qwen3.8-27B-DFlash2-Q2_K_S-MIX-GGUF I used this draft model with https://huggingface.co/ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF with the IQ3_XXS with 128k context and I saw it averaging about 60 tokens per second tg speed on the 16 GB RX 9070 XT. This is much better than…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-12 14:57 · r/LocalLLaMA
    This draft model is OP on 16 GB cards for Qwen 3.8 27b

More stories

  1. Thank you :) Swift Qwen 3.8 27B now has 100k+ downloads, is #1 finetune and #9 model on HuggingFace Trending — r/LocalLLaMA
  2. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  3. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  4. Qwen 3.8 27B Running for 63 hours on a RTX 3090 to solve the Riemann hypothesis — r/LocalLLM
  5. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  6. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
  7. Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
  8. Qwen Image 2.1 on Comfy: Coming Soon — r/StableDiffusion

Get the daily brief of stories like this at 6:30 every morning →