Eval Suite Auditor skill.md: my eval passed at 0.9 while its judge had never executed
Most eval advice tells you to write better evals. I wanted a skill for the opposite problem: auditing the eval suite you already have, because mine was lying to me. The reason it exists: I found that my own eval layer passed a run at 0.9 while its LLM judge had never executed. The judge model I'd h…
Read the full story at r/PromptEngineering ↗
Timeline · 1 report
- 2026-10-14 08:25 · r/PromptEngineering
Eval Suite Auditor skill.md: my eval passed at 0.9 while its judge had never executed