COFFEQA: Counterfactual-Guided Few-Shot Distillation for LLM Question Answering
arXiv:2610.12837v1 Announce Type: new Abstract: Knowledge distillation aims to train a smaller student model to mimic a larger teacher model for resource-constrained environments. However, the process of distillation is typically data-intensive and computationally expensive, particularly for genera…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-12 04:00 · arXiv cs.CL
COFFEQA: Counterfactual-Guided Few-Shot Distillation for LLM Question Answering