My sandboxed agent scored 60% checking code reviews and a bigger model only added 3 points. Shrinking the question got it to 12 for 12.

One of my agents, Lance, does engineering work on a separate Linux box. I wanted to find out two things: can I give an agent a real shell without trusting it, and can it check code reviews well enough that I stop doing it myself. The first answer was yes. The second was no, but the way it failed wa…

Read the full story at r/AI_Agents ↗

Timeline · 1 report

1. 2026-10-08 15:12 · r/AI_Agents
   My sandboxed agent scored 60% checking code reviews and a bigger model only added 3 points. Shrinking the question got it to 12 for 12.