[Paper] D3D: Decoupled Diffusion Drafting for Asynchronous Speculative Decoding
Target-conditioned diffusion drafters predict candidate tokens in parallel, yet each new block must wait for updated target-model hidden states. This forces drafting and verification to run sequentially, limiting speedup even though each block is generated in one pass. We introduce D3D, a standalon…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-07 09:00 · r/LocalLLaMA
[Paper] D3D: Decoupled Diffusion Drafting for Asynchronous Speculative Decoding