[R] How to downsample 1M+ transaction graphs by up to 611× for LLM evaluation without distorting full-test metrics (HT-Coreset)
TL;DR: Evaluating LLMs on million-scale graph benchmarks (like AMLworld) requires >1M graph prompts per pass, making evaluation prohibitively expensive. Naive downsampling distorts precision and F1 due to extreme class imbalance. We introduced HT-Coreset, an importance-weighted downsampling protoco…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-10-12 09:43 · r/learnmachinelearning
[R] How to downsample 1M+ transaction graphs by up to 611× for LLM evaluation without distorting full-test metrics (HT-Coreset)