Drama3 in audio.cpp: Up to 5× faster than real time at full speed, or 2× real-time speed with < 8 GB of VRAM on an RTX 5090!
Drama3 support in audio.cpp was contributed by https://github.com/JarodMica . Many thanks for the great work! So far, follow-up optimizations have primarily focused on CUDA. The model also runs on Vulkan and Metal. There's still plenty of room for improvement in performance and VRAM efficiency and…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-16 03:38 · r/LocalLLaMA
Drama3 in audio.cpp: Up to 5× faster than real time at full speed, or 2× real-time speed with < 8 GB of VRAM on an RTX 5090!