AINewsnow

ExLlamav3 Recent Updates : CPU offload, GLM-5.3-FLASH, Qwen3.8-Flash, SC Quants ++

This story is from 2026-09-01. It is preserved in the archive; the latest stories are on the live feed.

More new massive updates from turboderp: - CPU offload of MoE experts - Qwen-3.8-Flash-Next ngram disk offload - GLM-5.3-Flash - New self-calibrated optimization technique - Countless other optimizations and improvements If you have an NVIDIA card and haven't tried it lately, you might be missing o…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-01 07:14 · r/LocalLLaMA
    ExLlamav3 Recent Updates : CPU offload, GLM-5.3-FLASH, Qwen3.8-Flash, SC Quants ++

More stories

  1. Built a home server from an old PC with GPU upgrade. Qwen3.8 27B runs at ~30 tokens per second. — r/LocalLLaMA
  2. Alibaba's Qwen3.8-Omni-Flash Cuts Video AI Costs by 89% With Agent Tool Use — AlphaSignal
  3. Qwen Image 2.1 PR to ComfyUI — r/StableDiffusion
  4. Alibaba releases Qwen-Image-2.1, a 7B open-weight model it says outperforms most closed-source models, with native transparency and up to ten reference images (Qwen) — Techmeme
  5. Success running Qwen 3.8 27B EXL3 on RTX 3060 + 5060 Ti — r/LocalLLM
  6. Qwen q4 3.8 27b 16 tok/s 32k RTX 3060 :D — r/LocalLLM
  7. 10 hours left fo Qwen Image 2.1 Public Open Source Release — r/StableDiffusion
  8. Qwen 3.8 27B running on a single RTX 5090 researches and creates a full animation using only code. — r/artificial

Get the daily brief of stories like this at 6:30 every morning →