Gemma 3 1B on the Nexus 5X (Directly on the Linux Kernel, No Android) — 2 GB RAM, 4.47 t/s
https://github.com/kaiwalyakhasnis/nexus5x-local-llm A custom boot image for the 2015 Nexus 5X that replaces Android entirely: a trimmed Linux 3.10 kernel plus a tiny rootfs where llama.cpp, BusyBox and the screen/voice UI are baked in as static binaries. Booted straight into RAM with fastboot boot…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-29 04:13 · r/LocalLLM
Gemma 3 1B on the Nexus 5X (Directly on the Linux Kernel, No Android) — 2 GB RAM, 4.47 t/s
More stories
- Learned attention gates separate instructions from data to resist prompt injection — DEV Community — Machine Learning
- Basalt (NVFP4) vs Unsloth Studio (llama.cpp IQ4_XS) — 5090 with 64GB RAM — r/LocalLLM
- Generate a training set with DeepSeek, then fine-tune a small model on a rented GPU — DEV Community — Machine Learning
- I tested LFM2.5-24B-A2B vs Qwen3.6-35B-A3B on 75 fresh multi-step tool tasks. Qwen solved 91%, LFM2.5 49%, and LFM2.5 said "done" on most of its failures — r/LocalLLM
- Nanbeige4.3-33B Q4 on a MacBook Pro M5 Max, mlx-lm vs llama.cpp vs Kapitsa, Prefill/Decode 512 to 32K range. — r/LocalLLaMA
- A 2013 Mac Pro runs a 35B model at 66 tok/s reading. The first benchmark I trusted was wrong by about 9x. — r/LocalLLM
- mtmd: enable video input support for LFM3 model family by tdakhran · Pull Request #31283 · ggml-org/llama.cpp — r/LocalLLaMA
- shura.cpp: a llama.cpp fork with a VRAM governor, so a 35B MoE can share one 16 GB card with the desktop you keep using — r/LocalLLM
Get the daily brief of stories like this at 6:30 every morning →