AI in Plain WordsUnit 5: Limits and risks
› AI-39 · Lesson 39 of 50
Unfair patterns
bias
If past data reflects unfair treatment, a model trained on it can repeat or even strengthen that unfairness. This is called bias. For example, a hiring tool trained on a company's past hires may learn to favor people who are like them. Nobody has to intend harm for this to happen. Fairness has to be checked on purpose: measure how the system performs for different groups, and fix what you find.
Think
What past pattern would you not want a machine to copy?