AINewsnow

Grep your tool surface before you write another refusal eval

Every eval I wrote last year assumed the agent would try to do the wrong thing. A model reaching for another tenant's records. A model running the destructive migration. So I wrote refusal evals: hand it the forbidden request, check that it declines. Pass rate looked great. I felt good about it for…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-11-09 14:37 · DEV Community — AI
    Grep your tool surface before you write another refusal eval

More stories

  1. Nvidia CEO Jensen Huang admits affair amid probe into alleged Chinese espionage — The Verge AI
  2. Meta expands AI age estimation globally to extend Instagram Teen Account protections — Meta Newsroom
  3. DeepSeek's Harness agent app reaches 1.54 million daily users — Bloomberg AI
  4. Anthropic commits $3.4 billion to gas generators for AI data centers — Financial Times AI
  5. US AI Safety Center CAISSI Asked to Report to White House, Raising Independence Concerns — AP News
  6. US Leads Frontier AI as China Pursues Broader Path to AGI — CSET Georgetown
  7. Meta chief strategy officer Dave Wehner to join AI startup Fireworks as CFO — CNBC Technology
  8. Give Claude Code, Codex or Cursor memory you can read with OpenViking — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →