I benchmarked 8 models on our own code reviews. The first bug was ours.
Claude Opus 5.5 failed the same review three runs out of three. Same pull request, same reviewer role, same result: the stage output "failed to parse", the review was marked errored, and Opus dropped to the bottom of my table. When I finally pulled the raw response, Opus had done exactly what it wa…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-06 13:05 · DEV Community — AI
I benchmarked 8 models on our own code reviews. The first bug was ours.