Beyond Aggregate Accuracy: Item-Level Transitions in Prompt Optimization
arXiv:2610.19084v1 Announce Type: new Abstract: Automatic prompt optimization (APO) uses feedback from model responses to improve prompts automatically. However, its effectiveness is usually measured through overall scores, which do not reveal which questions become correct, which previously correc…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-15 04:00 · arXiv cs.LG
Beyond Aggregate Accuracy: Item-Level Transitions in Prompt Optimization