On-Policy Distillation Meets Off-Policy GRPO: Training Compact Instruction-Following Rerankers
This story is from 2026-09-03. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.01947v1 Announce Type: new Abstract: Compact instruction-following rerankers are attractive for deployment, but conventional distillation pipelines typically train students by offline imitation of teacher outputs on a fixed set of examples, constraining supervision to the teacher's obser…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-09-03 04:00 · arXiv cs.LG
On-Policy Distillation Meets Off-Policy GRPO: Training Compact Instruction-Following Rerankers