I made an open-source tool for running on-device LLMs in web and mobile apps
I made open-source SDKs for running AI models on-device within apps and websites: https://github.com/wfloat/wfloat There's currently 6 LLMs supported Full model list here . It works inside web browsers, React Native (iOS and Android), and Python (macOS, Windows, and Linux).
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-28 15:06 · r/LocalLLM
I made an open-source tool for running on-device LLMs in web and mobile apps