My LLM Critic Flip-Flops on Every Run. That's Fine — Because a Frozenset Decides What's Fatal.
This story is from 2026-08-31. It is preserved in the archive; the latest stories are on the live feed.
This is a companion to the PlannerCritic series . Article 2 was about a specific critic bug. This one is about the design principle I extracted from fixing it — and the measurement that proved it holds. I measured my LLM critic on identical input across five trials. It returned a different verdict…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-08-31 08:09 · DEV Community — AI
My LLM Critic Flip-Flops on Every Run. That's Fine — Because a Frozenset Decides What's Fatal.