AI in Plain WordsUnit 4: Language, pictures and action
› AI-27 · Lesson 27 of 50
From predictor to assistant
learning from human feedback (RLHF)
A model trained only to predict text will continue anything, including insults or nonsense. To turn it into a helpful assistant, builders train it further on examples of good conversations. Then people, and sometimes other AI systems, compare its answers, and the model is rewarded for the kinds people prefer. This step is called learning from human feedback. It shapes the model's tone, what it refuses and how it helps. Those are choices made by its builders, not facts of nature.
Think
Who should decide what an AI assistant refuses to do?