Fast voice agents with ConvFill
Voice agents are either fast or smart. ConvFill proposes a way to bridge that gap by training a smol talker model (0.6B!) to talk with cheat notes from a large reasoner model. The way it works is this: after the user's speech is transcribed, the talker replies quickly to buy itself time while the r…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-26 15:06 · r/LocalLLaMA
Fast voice agents with ConvFill