AINewsnow

Isn't "rerun the tests until green" just grading the agent on its training set?

This story is from 2026-10-02. It is preserved in the archive; the latest stories are on the live feed.

One agent writes tests from the spec, another writes the code in parallel, and the test agent never sees the code. Their reason was basically that otherwise the AI cheats. I take it to mean tests written after reading the code just confirm what it does, bugs included. I come from ML, so to me this…

Read the full story at r/ChatGPTCoding ↗

Timeline · 1 report

  1. 2026-10-02 21:26 · r/ChatGPTCoding
    Isn't "rerun the tests until green" just grading the agent on its training set?

More stories

  1. OpenAI launches GPT-6.2 Astra and Sol as Google ships Gemini 4 Neon and Microsoft unveils MAI Code 2 — OpenAI News
  2. Anthropic debuts on Nasdaq with record $81.3 billion IPO, hitting $2 trillion value — Anthropic (X)
  3. Google launches Gemini 4 Neon and opens Genie 4 world model to Gemini API developers — Google DeepMind YouTube
  4. Google books Blue Origin's New Glenn for 2029 launch of AI server satellites — Google: The Keyword
  5. AWS expands SageMaker AI with data preparation tools and cross-Region inference routing — AWS Machine Learning Blog
  6. Anthropic's stock debut soars, but Wall Street indexes drop — Washington Post AI
  7. AWS expands SageMaker JumpStart with OpenTSLM, model leaderboard, and PolyAI Dialog-RSN-1 — AWS Machine Learning Blog
  8. How Duco transforms financial data automation with Amazon Bedrock AgentCore — AWS Machine Learning Blog

Read the Daily Brief: the day's most important AI stories →