MiniCPM-V 4.7 runs a 35B-A3B vision model on phones by streaming experts from storage
OpenBMB posted a mobile demo of MiniCPM-V 4.7 doing things like reading signs and interpreting documents locally. It’s a 35B MoE with 3B active parameters. They report 13+ tok/s on an iPhone 17 Pro Max with a 3GB inference memory footprint in the model docs . The trick is LES, or Lookahead Expert S…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-13 17:53 · r/LocalLLM
MiniCPM-V 4.7 runs a 35B-A3B vision model on phones by streaming experts from storage