Can a small language model run on a budget Android phone with 4 GB RAM?
Our small open model answered a stock question in 4.25 s on a 4 GB Galaxy A05s. In that same run, its first turn took 13.4 s, right after a print preview, and that gap is still open. Both times come from a whole-app run of a test build (31 Oct), with airplane mode on, using 673 MB of model memory.…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-12 07:47 · DEV Community — Machine Learning
Can a small language model run on a budget Android phone with 4 GB RAM?