Local coding LLM on a 24GB GPU: Qwen2.5-Coder 32B vs Qwen3-Coder 30B-A3B (it's all about context)
If you want a local coding model on an RTX 4090 / 3090 / 7900 XTX, the question isn't only "does it load", it's "does it load with enough context to read my files". Qwen2.5-Coder 32B (dense) Build 4K 8K 16K 32K GGUF Q4_K_M 21.7 GB (90%, tight) 95% doesn't fit doesn't fit AWQ INT4 18.1 GB (75%) 80%…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-12 02:54 · DEV Community — AI
Local coding LLM on a 24GB GPU: Qwen2.5-Coder 32B vs Qwen3-Coder 30B-A3B (it's all about context)