"98% sure" should mean something: how we made our AI agent's confidence honest
Ask a language model how confident it is, and it will happily say "95%". The number sounds precise, but it often means nothing. For most chatbots that's harmless. For an on-call engineer deciding whether to restart production at 3 a.m., it's dangerous. Our team built DejaVu , an AI incident agent t…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-07 16:52 · DEV Community — AI
"98% sure" should mean something: how we made our AI agent's confidence honest