AINewsnow

I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating)

I saw a lot of posts here struggling to run 27B models on 8GB VRAM or complaining about phones turning into space heaters. I hit the exact same OOM wall on my phone, so I decided to build a hardware-split workaround. I wrote a custom C++ engine (fork of llama.rn) to cluster two Android phones over…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-13 19:40 · r/LocalLLM
    I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating)

More stories

  1. MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis — arXiv cs.CL
  2. QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases — r/LocalLLaMA
  3. Gemini leaked its thinking tokens by just asking what tag it uses to end thinking — r/ArtificialInteligence
  4. Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels. — r/LocalLLaMA
  5. P100 (sm_60) patches for llama.cpp: +42% decode and +74% short-prefill on a 2×P100 tensor split — r/LocalLLM
  6. Qwen3.8FN vLLM vs. llama.cpp vs Ninfer6000 — r/LocalLLaMA
  7. I built Harness Studio — an open-source desktop app for running Hugging Face models locally. Looking for feedback and contributors. — r/huggingface
  8. I built Agent Praxis: 6 adversarial environments to test how LLM agents handle traps, metric gaming, and fake authority — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →