AI alignment rests on a simple model of human decision-making: people are noisily rational agents maximizing fixed rewards that exist in the environment. This talk examines that model from both sides: minds and machines. In humans, choices follow resource-rational heuristics rather than optimal policies, and pursuing even an arbitrarily assigned ...
