"AI puzzles": a new format between a benchmark and an open-problem list
We have benchmarks (fixed questions, hidden answers, they saturate), competition problems (solved, so they can be memorized), and open-problem lists (no evidence, no clear success criterion). With Claude and Sol, I've tried something in between: a graded ladder of AI puzzles from one research area,…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-10-25 14:59 · r/deeplearning
"AI puzzles": a new format between a benchmark and an open-problem list