Planning to get a cheap-ish GPU. Would appreciate some advice.
This story is from 2026-09-06. It is preserved in the archive; the latest stories are on the live feed.
Hi, I've been wanting to run my own local LLM for some time and I finally saved enough to get a budget GPU. I can spend 700$ at most, and I'm looking for a GPU that can run quantized 30B~ parameter models with decent speed. Being able to run Qwen 3.8 27 B Q4_K_M and similar models at +20 T/s is goo…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-06 17:25 · r/LocalLLaMA
Planning to get a cheap-ish GPU. Would appreciate some advice.