Efficient Cost-Aware LLM Evaluation via Bayesian Bandit Gittins Indices
arXiv:2609.25645v1 Announce Type: cross Abstract: Exhaustively evaluating every candidate LLM configuration on every benchmark item to identify a high-performing one is costly. We formulate configuration selection as a cost-aware Bayesian bandit problem and propose GittinsEval, which draws on the B…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-09-23 04:00 · arXiv stat.ML
Efficient Cost-Aware LLM Evaluation via Bayesian Bandit Gittins Indices