AI-written code was 2.3x more verbose than code in 473 human-maintained Python repos. A breakdown of SlopCodeBench and what it means for AI-assisted coding
I made a video essay on SlopCodeBench (arXiv 2603.24755, out of UW–Madison). It looks at something most coding benchmarks skip: what happens to an agent's code when the requirements keep changing. Most benchmarks give a model one task and check whether the tests pass. SlopCodeBench gives agents pro…
Read the full story at r/ChatGPT ↗