Qwen Ships Qwen3-VL 8B Locally, Seeing Images and Video in 5 GB

Alibaba's Qwen team shipped GGUF weights for Qwen3-VL-8B-Instruct, letting the multimodal model run locally through llama.cpp, Ollama, and LM Studio.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-10-18 09:28 · AlphaSignal
Qwen Ships Qwen3-VL 8B Locally, Seeing Images and Video in 5 GB

More stories

Developer Mert Cobanov Runs llama.cpp on a Jailbroken PS5 — AlphaSignal
Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM
Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels. — r/LocalLLaMA
FLUX 3 Klein and Qwen Image 2.1 face user scrutiny over quality and workflow issues — r/StableDiffusion
Community evaluates Qwen 3.8 Flash Next performance and quantization trade-offs — r/LocalLLaMA
Local model for language course — r/LocalLLM
Crossroad - should or shouldn't — r/LocalLLM
We all joke about our rigs being space heaters, so I had Qwen vibecode it — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →