Privacy Focused AI assistant with on-device inference (opensource)
Hi, I created a Roles Witch - privacy-focused AI assistant featuring voice/video calls and on-device inference (via LiteRT for Gemma models). It also easily connects to any OpenAI-compatible API (LM Studio, OpenRouter, etc.). Unlike typical Character AI like apps, Roles Witch supports MCP tools. Th…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-17 17:50 · r/LocalLLM
Privacy Focused AI assistant with on-device inference (opensource)