"Your agent's failures are your regression suite" is great advice. Building eval datasets by hand isn't. Here's what I do instead.
If you are into AI evals, you have definitely heard that you have to "turn your failures into your regression suite" . That's solid advice. The only issue is that it takes soooo much time. I started doing it by hand, and I quickly realized it's not scalable. Especially given how fast you can implem…
Read the full story at r/AI_Agents ↗