vLLM-Omni Now Serves Fish Audio's Drama 3 at 128 Concurrent Streams

vLLM-Omni now serves Fish Audio's 35B directable TTS model with 128 concurrent streams on one H200 and 255 ms median time to first audio.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-10-15 08:39 · AlphaSignal
vLLM-Omni Now Serves Fish Audio's Drama 3 at 128 Concurrent Streams

More stories

NVIDIA releases Nemotron 3.5 Super VL and Bolt models for enterprise agents — NVIDIA Technical Blog
Welcome Muse Spark Open: open-weight frontier multimodal mixture-of-experts model from Meta — Hugging Face Blog
Be There for the Beginning: Celebrate the Launch of NVIDIA RTX Spark — NVIDIA Blog
Black Forest Labs Releases Open-Weights FLUX 3 Image Klein Model — Hugging Face Blog
Anthropic Reports $16.8 Billion Q3 Revenue Ahead of IPO — Bloomberg AI
Google Launches Universal Cart Across Search and Gemini App — The Verge AI
Employee arrested after listening device found in OpenAI conference room, FBI and the company say — ABC News Technology
Amazon launches new Bee personal AI devices starting at $75 — TechCrunch AI

Get the daily brief of stories like this at 6:30 every morning →