Do your agent evals test access being revoked halfway through a conversation?
One eval case I'd add for an agent working with permissioned data: revoke access halfway through the conversation. Toy setup: A user can access Project A. The agent retrieves an incident note and produces a summary. Their project access is removed. In the same session, they ask for another detail f…
Read the full story at r/AI_Agents ↗
Timeline · 1 report
- 2026-10-20 07:52 · r/AI_Agents
Do your agent evals test access being revoked halfway through a conversation?