AI in Plain WordsUnit 5: Limits and risks
› AI-37 · Lesson 37 of 50
It may just agree with you
sycophancy
Chat assistants are trained partly on which answers people like best. And people tend to like hearing that they are right. So an assistant can lean toward agreeing with you, praising your idea, or dropping a correct answer when you push back. This is called sycophancy: telling people what they want to hear. Builders work to reduce it. You can help too. Ask for the strongest case against your idea, and notice when it gives in too easily.
Think
How could you test whether an AI is just agreeing with you?
Sources
For grown-ups
Two easy tests: state a wrong fact confidently and see if it goes along, or ask the same question twice with opposite opinions attached and compare the answers.