Just downloaded the OpenAI 120B model on my gaming PC.
I'm just curious and thinking about how well the 120b is going to run on my gaming PC, and surprisingly it's not too bad (17.83 tokens/sec). But when I check my RAM allocation, it has used almost all of my RAM. The AI really uses a lot of RAM. (Usually I use a cloud AI model, but I've started conce…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-02 07:55 · r/LocalLLM
Just downloaded the OpenAI 120B model on my gaming PC.