AINewsnow

12 Vram - 140tps Qwen 3.6 35b a3b

For the love of god, if you’re running Qwen 3.6 35b a3b on a 8-12 vram GPU try Polystrata My setup: RTX 4070 SUPER — 12GB VRAM 32GB DDR5-6000 RAM Windows 11 Qwen3.6-35B-A3B, HauhauCS uncensored Aggressive TTQ Q4_K_M GGUF MTP enabled Performance: In my runs, 2,800–3,300 tok/s prompt processing 140 t…

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-10-11 04:27 · r/LocalLLaMA
    Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B A3B IQ4 at ~145 tok/s with 256k all on $500 of ex mining BC-250 boards
  2. 2026-10-10 21:13 · r/LocalLLM
    12 Vram - 140tps Qwen 3.6 35b a3b

More stories

  1. Qwen Image 2.1 Turbo and MiniMax H3 Gain Community Support — r/StableDiffusion
  2. Alibaba Prepares Qwen Go Personal AI Assistant for Task Automation — TechNode
  3. Users report Qwen 3.8 Flash Next performance on local hardware — r/LocalLLaMA
  4. Local Embedding Models in 2026: Which to Run, What Hardware They Need, and What They Cost — DEV Community — Machine Learning
  5. Do any local models come close to chatgpts ability to generate sample character images? (2nd image is original) — r/StableDiffusion
  6. For anyone complaining about Qwen 3.8 27b on Apple Silicon — r/LocalLLM
  7. madebyollin/texture-fix-vae-for-qwen-image-2.1 · Hugging Face — r/StableDiffusion
  8. Para adapters qwen 36 35b ou 3.8 27b ? — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →