How Deepgram optimized voice AI at scale with AWS Trainium
Deepgram worked with the AWS Forward Deployed Engineering team to port its Nova-3 speech-to-text model to AWS Trainium2 for offline batch inference. This post covers porting to the AWS Neuron stack, kernel-level tuning, a data-parallel Rust runtime, and the throughput and cost results on batch tran…
Read the full story at AWS Machine Learning Blog ↗
Timeline · 1 report
- 2026-10-19 16:23 · AWS Machine Learning Blog
How Deepgram optimized voice AI at scale with AWS Trainium