AINewsnow

Fully local conversational AI: Whisper + Hermes 8B + Kokoro, zero cloud, running inside a plush toy

A conversational AI plush toy where nothing leaves my network. Everything runs on my LAN: STT: Whisper LLM: Hermes 3 Llama 3.1 8B (Q8_0) TTS: Kokoro Memory: per-person (LangGraph). It knows who it's talking to and remembers past conversations Vision: face identity (dlib) + emotion recognition (FER+…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-10 11:28 · r/LocalLLaMA
    Fully local conversational AI: Whisper + Hermes 8B + Kokoro, zero cloud, running inside a plush toy

More stories

  1. Qwen 3.6 35B A3B: 131K context + vision on 6GB VRAM — r/LocalLLaMA
  2. Tested Mellum2.1-12B-A2.5B on PI Coding Agent - surprisingly usable, but not great at one-shot projects — r/LocalLLaMA
  3. Running the uncensored Qwen3.8-27B (HauhauCS) on a 4090 at 262K context and ~130 tok/s — r/LocalLLaMA
  4. Java vllm-like framwork claims 90% of perfomance of llama.cpp on local inference on NVIDIA GPUs by compiling Java to CUDA and cuTile — r/LocalLLM
  5. Success with Qwen3.8 27B GSQ-RCO-IQ3_S on 16GB VRAM — r/LocalLLM
  6. Created laya : Now Introducing a new 800 Million Param physics-based typed decision model with 73k context and image support — r/LocalLLaMA
  7. Is there a better option than llama.cpp for 4GB VRAM for Higher tokens/sec? — r/LocalLLaMA
  8. Qwen3.8-27B on a single 3090: 140 tok/s on code with a custom megakernel — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →