Ran a 120B model across 6 computing devices that had no business running it!
https://preview.redd.it/qrp7lwet27sh1.png?width=1161&format=png&auto=webp&s=dcc6cc4e51931c789b84375104703c3df69c829b ok so I genuinely did not think this was going to work. None of these machines could load a 120B model on their own, not even close. So I threw them all in a cluster and tried anyway…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-28 04:46 · r/LocalLLM
Ran a 120B model across 6 computing devices that had no business running it!