AI in Plain WordsUnit 4: Language, pictures and action
› AI-24 · Lesson 24 of 50
Language models guess the next piece
large language model (LLM)
A large language model, or LLM, is first trained on enormous amounts of text to do one thing: guess the next bit of text. Given "The cat sat on the," it learns that "mat" is likely. Doing this across billions of pages pushes the model to pick up grammar, facts, writing styles and patterns of reasoning. All of these help predict what comes next.
Think
To guess the last word of a mystery novel, what would you need to understand?