AINewsnow

My local voice assistant stuttered until I made the LLM wait for the TTS

This story is from 2026-10-16. It is preserved in the archive; the latest stories are on the live feed.

I wanted small ESP32 voice-assistant boards (running the open-source xiaozhi firmware) to hold real conversations offline, served from my laptop: an RTX 4060 Laptop GPU (8 GB) and 16 GB of RAM. Speech detection and recognition run on the CPU; an LLM (Gemma 4 E4B, QAT q4_0, on llama.cpp) writes the…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-16 10:11 · DEV Community — AI
    My local voice assistant stuttered until I made the LLM wait for the TTS

More stories

  1. Qwen3.8 Flash Next (Low Quant) vs 27B Q5: Is Strata Worth It on a 32GB VRAM + 32GB RAM System? — r/LocalLLM
  2. MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis — arXiv cs.CL
  3. QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases — r/LocalLLaMA
  4. Gemini leaked its thinking tokens by just asking what tag it uses to end thinking — r/ArtificialInteligence
  5. Ternary Bonsai 2 (2B, 4B, and 9B) just released on Hugging Face. The 2B can run entirely locally in the browser at up to 500 tok/s on an M4 Max with custom WebGPU kernels. — r/LocalLLaMA
  6. P100 (sm_60) patches for llama.cpp: +42% decode and +74% short-prefill on a 2×P100 tensor split — r/LocalLLM
  7. Qwen3.8FN vLLM vs. llama.cpp vs Ninfer6000 — r/LocalLLaMA
  8. I built Agent Praxis: 6 adversarial environments to test how LLM agents handle traps, metric gaming, and fake authority — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →