Anyone running Qwen3.8-27B IQ4_XS on an 8GB GPU with 64k context? Is it usable?

https://huggingface.co/bartowski/Qwen3.8-27B-GGUF Has anyone tried running Qwen3.8-27B (IQ4_XS) on a laptop that had a 3070 with 8GB VRAM and 32GB DDR5 What speeds are you getting, and is it usable in practice?

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-10-12 08:09 · r/LocalLLM
Anyone running Qwen3.8-27B IQ4_XS on an 8GB GPU with 64k context? Is it usable?

More stories

LiquidAI/LFM2.5-24B-A2B — r/LocalLLaMA
Qwen-Image 2.1 Turbo model is available in ZPix (a friendly local image generator and editor) — r/StableDiffusion
The Toddlers Have Bazookas Now - a nice visualization of the Hugging Face incident — r/ArtificialInteligence
madebyollin/texture-fix-vae-for-qwen-image-2.1 · Hugging Face — r/StableDiffusion
I released Mage-Flow W4A8 + ARA with TE INT 8 / 8.9 GB VRAM — r/StableDiffusion
Netflix’s documentary of Huggingface discussion — r/LocalLLaMA
Hugging Face Hacking 🎦 — r/ArtificialInteligence
I trained two Anima ControlNet-LLLite models using 3D body poses and color regions — r/StableDiffusion

Get the daily brief of stories like this at 6:30 every morning →