Where the time goes in a live AI call assistant: my code takes 150 ms, the model takes the rest
This story is from 2026-10-26. It is preserved in the archive; the latest stories are on the live feed.
I'm building a Windows app that listens to both sides of a call, transcribes it and drafts a short answer while the other person is still talking. People use it for job interviews and for calls in a second language. The first thing I wanted to fix was speed: the answer often arrived after the momen…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-26 11:50 · DEV Community — AI
Where the time goes in a live AI call assistant: my code takes 150 ms, the model takes the rest