AINewsnow

I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating)

I saw a lot of posts here struggling to run 27B models on 8GB VRAM or complaining about phones turning into space heaters. I hit the exact same OOM wall on my phone, so I decided to build a hardware-split workaround. I wrote a custom C++ engine (fork of llama.rn ) to cluster two Android phones over…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-13 19:40 · r/LocalLLM
    I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating)
  2. 2026-10-13 04:00 · r/LocalLLaMA
    I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating)

More stories

  1. I built Harness Studio — an open-source desktop app for running Hugging Face models locally. Looking for feedback and contributors. — r/huggingface
  2. I built Agent Praxis: 6 adversarial environments to test how LLM agents handle traps, metric gaming, and fake authority — r/LocalLLM
  3. Qwen 27B at ~20 tok/s on a jailbroken PS5's GPU. I forked PS5LM and turned it into a native app — r/LocalLLM
  4. Titan-Llama: Retrofitting Pre-trained LLMs with External Neural Memory Modules — arXiv cs.CL
  5. Qwen3.8 Flash Next vs Qwen3.8 27B - The hype vs the truth. — r/LocalLLM
  6. Dual Rx 580 32GB ram 2600x — r/LocalLLM
  7. Running Qwen3.8-27B at 128K Context on an RTX 5060 Ti 16GB + GTX 1080 8GB — 21.9 tok/s — r/LocalLLM
  8. A couple of hours of work - serious speed improvements — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →