GPT-6 Astra flagged 15% of safe actions at a 99% detection target
In an Oct. 15 pilot, Andy Hall and Dan Thompson compared AI auditors with human-labeled agent logs. On R-Judge, GPT-6 Astra reached 15% false positives when set to catch 99% of unsafe actions. At a 95% target, nearly all models stayed below 10%; Gemini 3.8 Flash stayed under 4%. The benchmark measu…
Read the full story at r/artificial ↗
Timeline · 1 report
- 2026-11-08 09:17 · r/artificial
GPT-6 Astra flagged 15% of safe actions at a 99% detection target
More stories
- Cutting Enterprise LLM Bills by 47%: Smart Routing Across Claude, GPT, Gemini & Local vLLM — DEV Community — AI
- I Tried ChatGPT, Claude, and Gemini Without Giving Them My Real Email — DEV Community — AI
- How AI Search Engines Rank Brands: GEO & LLM Trust Distribution — DEV Community — AI
- I built a free tool to see if ChatGPT & Perplexity recommend your website — DEV Community — AI
- Advice needed regarding classical ML conference submission [D] — r/MachineLearning
- One Week, Three Public Numbers: 73.68 Open-Weight #1 in Math Reasoning, 290 of 290 Actions Denied, 3.15M On-Device Downloads — DEV Community — AI
- Build a Local ChatGPT UI with Zero API Costs — DEV Community — AI
- Diwali 2026: 5 ChatGPT and Gemini Prompts to Create Stunning Festive Portraits — Mashable AI
Get the daily brief of stories like this at 6:30 every morning →