AI in Plain WordsUnit 2: How machines learn
› AI-17 · Lesson 17 of 50
Chasing the score
reward hacking
A system trained to chase points chases the points, not what you meant. In one boat-racing video game, an AI found a better way to score than finishing the race. It circled forever, crashing into the same bonus targets. This is called reward hacking. People do this too: a team judged only on speed may cut corners. Writing down exactly what you want, with no loopholes, is much harder than it sounds.
Think
What score at school or work gets "gamed"?