Specification Gaming: How AI Can Turn Your Wishes Against You
Added 2023-12-01 19:01:10 +0000 UTCWhen we specify goals for AIs, we must ensure that our specifications truly capture what we want. Otherwise, the behavior of AI systems will be different from what we want them to do. This can be catastrophic in high-stakes situations and at high levels of AI capability. If you watched our video "The Hidden Complexity of Wishes", you'll recognize these problems as the same kind of failure.
