Marginally Correct Tool Caches Can Reverse Group-Normalized Policy Updates
arXiv:2609.26866v1 Announce Type: new Abstract: Tool-result caching reduces repeated execution in agent training, but also couples rollout randomness. We study a two-action model in which independent and shared execution preserve every rollout's conditional reward distribution. Despite this margina…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-09-24 04:00 · arXiv cs.LG
Marginally Correct Tool Caches Can Reverse Group-Normalized Policy Updates