I turned old Android phones into a distributed LLM cluster. It works, but we hit a wall. Looking for ideas!
Hey everyone! I've been working on an open-source project called DistAI , and I wanted to share what we've achieved so far, what we've learned, and hopefully get some ideas from this community. In this photo, DistAI runs Qwen2.5-Coder-14B-Instruct (Q3_K_M, 7.3 GB) across three Android smartphones:…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-16 22:18 · r/LocalLLM
I turned old Android phones into a distributed LLM cluster. It works, but we hit a wall. Looking for ideas!