AI in Plain WordsUnit 5: Limits and risks
› AI-36 · Lesson 36 of 50
How sure is it?
calibration
Many AI systems give a confidence number, like "92% sure this is a cat." That number is not always trustworthy. Models can be very confident and wrong, especially on things unlike what they trained on. A well-built system's confidence matches its track record: when it says 90%, it is right about 90 times in 100. Builders call this calibration. Ask whether anyone has checked it.
Think
Think of someone who sounds sure but is often wrong. How do you decide when to trust them?