Coupled Calibration and Learning: Mitigating Teacher Bias in LLM Distillation without Target-Domain Reward Feedback
This story is from 2026-09-16. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.17474v1 Announce Type: cross Abstract: Large language model (LLM) distillation aims to transfer the capabilities of a powerful teacher to a smaller student. Direct imitation, however, can also transfer the teacher's systematic bias and errors. This challenge is particularly pronounced un…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-09-16 04:00 · arXiv stat.ML
Coupled Calibration and Learning: Mitigating Teacher Bias in LLM Distillation without Target-Domain Reward Feedback