Target Regeneration Shrinks the Gains of Draft-Training Objectives in Speculative Decoding
arXiv:2610.29013v1 Announce Type: new Abstract: Speculative decoding accelerates large language models by verifying drafted tokens in parallel. New draft-training objectives are usually credited with the acceptance they add over cross-entropy on externally written responses, yet many pipelines let…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-22 04:00 · arXiv cs.CL
Target Regeneration Shrinks the Gains of Draft-Training Objectives in Speculative Decoding