Bartowski Packs Qwen2.5-32B Into a 9GB File for Local Machines
A full set of imatrix GGUF quantizations lets you run Qwen2.5-32B-Instruct locally, from a 9GB phone-friendly build up to lossless 65GB weights.
Read the full story at AlphaSignal ↗
Timeline · 1 report
- 2026-10-12 13:02 · AlphaSignal
Bartowski Packs Qwen2.5-32B Into a 9GB File for Local Machines