Consequentialist Objectives and Catastrophe
arXiv:2603.15017v3 Announce Type: replace
Abstract: Because human preferences are too complex to codify, AIs operate with misspecified objectives. Optimizing such objectives often produces undesirable outcomes; this phenomenon is known as reward hacki…