[Paper & Models] MMFlash: Faster Speculative Decoding for Vision-Language Models
This story is from 2026-11-16. It is preserved in the archive; the latest stories are on the live feed.
Speculative decoding accelerates generation by letting a lightweight drafter propose tokens for parallel verification by a target model. Diffusion drafters such as DFlash propose an entire token block in a single forward pass, but mainly focus on text-only tasks, leaving multimodal drafting underex…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-16 10:48 · r/LocalLLaMA
[Paper & Models] MMFlash: Faster Speculative Decoding for Vision-Language Models