Beyond On-Policy vs. Off-Policy: At What Level Should LLM Agent Distillation Follow the Student?
arXiv:2610.31918v1 Announce Type: new Abstract: Distilling interactive LLM agents requires choosing between teacher-generated demonstrations and student-generated experience, corresponding broadly to off-policy and on-policy distillation. While both have proven effective, we argue that this distinc…
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-10-26 04:00 · arXiv cs.AI
Beyond On-Policy vs. Off-Policy: At What Level Should LLM Agent Distillation Follow the Student?