Built a hub that pools RAM across Windows/Mac/Android over LAN to run models too big for any one device
Been lurking and posting here on and off while building this. Quick recap for anyone new: RAMDeck is a small hub + node agent setup that shards a model's layers across whatever devices you already own (old laptop, Mac, GPU box, even an Android phone) and runs inference across them, but handling pri…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-20 01:41 · r/LocalLLM
Built a hub that pools RAM across Windows/Mac/Android over LAN to run models too big for any one device