Is there a labelled dataset for guardrail decisions anywhere, because two vendors just told me opposite things with equal confidence

So am an Independent security consultant, usually on client engagements. This month I was mid review for a logistics company where I ran forty identical inputs through two guardrail systems on the same agent, one hosted and one local, and they disagreed on eleven, neither obviously wrong, so the cl…

Read the full story at r/AI_Agents ↗

Timeline · 1 report

1. 2026-10-07 12:35 · r/AI_Agents
   Is there a labelled dataset for guardrail decisions anywhere, because two vendors just told me opposite things with equal confidence