Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation
This story is from 2026-09-16. It is preserved in the archive; the latest stories are on the live feed.
Discrete flow matching generates text by iteratively transforming noise tokens into coherent language, but may require hundreds of forward passes. Distillation uses the multi-step trajectory to train a student to reproduce the process in a few steps. When the student underperforms, the usual explan…
Read the full story at Apple Machine Learning Research ↗
Timeline · 1 report
- 2026-09-16 00:00 · Apple Machine Learning Research
Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation