AINewsnow

Qwen 3.8 27B UD-IQ4_XS even faster on 16GB CUDA

This story is from 2026-09-13. It is preserved in the archive; the latest stories are on the live feed.

This is an evolution on top of Raymond's KV cache streaming fork - all credits to what enabled this goes to him. The basic idea behind what he enabled was a pool of memory in VRAM that is used differently depending on the phase (prompt processing or decoding) and when total used context is larger t…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-13 15:50 · r/LocalLLaMA
    Qwen 3.8 27B UD-IQ4_XS even faster on 16GB CUDA

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Qwen Image 2.1 PR to ComfyUI — r/StableDiffusion
  3. Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
  4. 10 hours left fo Qwen Image 2.1 Public Open Source Release — r/StableDiffusion
  5. Qwen 3.8 27B running on a single RTX 5090 researches and creates a full animation using only code. — r/artificial
  6. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  7. Ternary Bonsai 2 27B — r/LocalLLaMA
  8. Get rid of GPT images using QWEN IMAGE 2.1. 🔥👍 — r/StableDiffusion

Get the daily brief of stories like this at 6:30 every morning →