Towards Optimal Multi-draft Speculative Decoding
arXiv:2502.18779v2 Announce Type: replace Abstract: Large Language Models (LLMs) have become an indispensable part of natural language processing tasks. However, autoregressive sampling has become an efficiency bottleneck. Multi-Draft Speculative Decoding (MDSD) is a recent approach where, when gen…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-11-04 05:00 · arXiv cs.CL
Towards Optimal Multi-draft Speculative Decoding