Speculative Diffusion is a Tale of Two Tradeoffs
arXiv:2610.31819v1 Announce Type: new Abstract: Speculative decoding is a technique that accelerates the inference speed of autoregressive large language models (LLMs) by sampling from a faster, lower quality draft model. Traditionally, a fundamental characteristic of speculative decoding is that i…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-26 04:00 · arXiv cs.LG
Speculative Diffusion is a Tale of Two Tradeoffs