Web search for a 1.7B model running fully on a phone, no search API and no backend (open source)
We just shipped web search in Private Mind, our open source app for running LLMs locally on iOS and Android. The video is the whole pitch: Qwen 3 1.7B with web off makes up Apple's September event, with web on it gets it right and cites 5 pages. The fun constraint is that a 1.7B model with a short…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-14 11:28 · r/LocalLLaMA
Web search for a 1.7B model running fully on a phone, no search API and no backend (open source)