Local coding model on my dekstop workstation (Qwen3.8 27B with Q4_K_M quantization too slow)
I'm running what I think is reasonably specd workstation. A single NVIDIA GeForce RTX 5090 (32 GB), AMD Ryzen 9 9950X3D x 32, 128GB RAM, 8TB SSD. Locally built llama.cpp serving Qwen3.8 27B with Q4_K_M hooked to pi harness is too slow to be useful. What options do I have with this setup? I suppose…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-15 12:36 · r/LocalLLM
Local coding model on my dekstop workstation (Qwen3.8 27B with Q4_K_M quantization too slow)