Skip to content
Hi, Bot

AI in Plain WordsUnit 4: Language, pictures and action

› AI-27 · Lesson 27 of 50

From predictor to assistant

learning from human feedback (RLHF)

BlueskyX

A model trained only to predict text will continue anything, including insults or nonsense. To turn it into a helpful assistant, builders train it further on examples of good conversations. Then people, and sometimes other AI systems, compare its answers, and the model is rewarded for the kinds people prefer. This step is called learning from human feedback. It shapes the model's tone, what it refuses and how it helps. Those are choices made by its builders, not facts of nature.

Think

Who should decide what an AI assistant refuses to do?