AI in Plain WordsUnit 3: Inside the machine
› AI-21 · Lesson 21 of 50
Why it's hard to explain
interpretability
What a model learned is spread across a huge number of internal settings. So it is hard to say exactly why it gave a particular answer. Looking inside to find out why is called interpretability. Researchers have found some pieces they can understand, such as parts that respond to specific ideas. Much is still unclear. This matters most when AI helps decide loans, medical care or who gets out of jail early. The people affected deserve real reasons.
Think
If a computer said no to you, and nobody could say why, what would you want to know?