Is it fine to put all the llm weights on DRAM and run the actual ai on your VRAM?
I am VERY new to local ai and I have yet to even run a model. I am curious because I don't have a ton of VRAM to work with. Thank you!
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-28 23:46 · r/LocalLLM
Is it fine to put all the llm weights on DRAM and run the actual ai on your VRAM?