AINewsnow

Which Qwen model to run: versions, sizes and VRAM for 11 models

The Qwen model you can run depends on your GPU memory. At Q4_K_M with an 8K context, Qwen3.5 9B needs 6.8 GB, Qwen3.8 27B 17.2 GB, Qwen3 Next 80B-A3B 46.5 GB and Qwen3 Coder 480B-A35B 273.1 GB. These are single-request figures for the 11 family models. Below: what separates the generations, which m…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-21 03:26 · DEV Community — Machine Learning
    Which Qwen model to run: versions, sizes and VRAM for 11 models

More stories

  1. Google open-sources Harness²: agents that rewrite their own harness on unseen tasks, with frozen weights and no labels — r/machinelearningnews
  2. Together Post-Training: frontier-grade model shaping, the way that fits you — Together AI Blog
  3. The last few weeks be like... — r/StableDiffusion
  4. Qwen 3.8 Flash Next optimized for two CMP 170hx GPUs — r/LocalLLaMA
  5. Qwen3.8-Flash-Next 125B Q2_0 on a 24GB M4 Mac mini: ~8.1 tok/s with Strata — r/LocalLLM
  6. Is Qwen a good option for broke devs? — r/AI_Agents
  7. Installing qwen model on my smartphone — r/LocalLLM
  8. Eagle-4 Released: Faster than DFlash2 & DSpark — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →