Will this model fit on your GPU? Size a local LLM on paper before you pull it
You download the biggest model your disk can hold, ask it a question, and wait. The answer arrives a word at a time, the CPU fans spin up, and ollama ps says 45%/55% CPU/GPU . The model did not fit in the card's memory, so part of it runs from system RAM, and the whole thing moves at the speed of t…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-03 15:00 · DEV Community — AI
Will this model fit on your GPU? Size a local LLM on paper before you pull it