Towards understanding score-seeking in LLMs
The field of AI alignment understands surprisingly little about the details of AIs’ current misaligned motivations. Production LLMs sometimes reward-hack, exploiting flaws in how tasks are scored rather than performing the tasks as intended [1] , and we've recently seen AIs reward-hack in some part…
Read the full story at LessWrong (Curated) ↗
Timeline · 1 report
- 2026-11-06 03:19 · LessWrong (Curated)
Towards understanding score-seeking in LLMs