HarnessDev: feedback and held-out agreed on 34 of 64 switches
HarnessDev (this month) is the first paper I've seen that measures the loop of letting an agent revise its own harness, keeping the revision when the feedback says so, and repeating. Across 64 adjacent version switches, the feedback score and the held-out score moved in the same direction 34 times,…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-10-15 16:23 · r/reinforcementlearning
HarnessDev: feedback and held-out agreed on 34 of 64 switches