Factorization-Guided Training and Inference for Diffusion-Drafted Speculative Decoding
arXiv:2610.23935v1 Announce Type: new Abstract: Speculative decoding accelerates large language model inference through parallel verification of tokens proposed by a drafter. Diffusion drafters further parallelize proposal generation, but greater proposal capacity or higher mean accepted tokens (MA…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-20 04:00 · arXiv cs.LG
Factorization-Guided Training and Inference for Diffusion-Drafted Speculative Decoding