I got Gemma 4 26B A4B QAT running on 16GB of RAM and a Ryzen 5 5600GT :D
This story is from 2026-09-13. It is preserved in the archive; the latest stories are on the live feed.
-it is just a few MBs less than all of my system ram, it sometimes even collapses my system, but it works (A friend of mine running on windows had problems and couldn't run it, maybe because of how heavy it is and problems with his 4GB GPU) - It runs at around, 10 tokens per second, but sometimes s…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-13 20:06 · r/LocalLLM
I got Gemma 4 26B A4B QAT running on 16GB of RAM and a Ryzen 5 5600GT :D