Skip to content
Hi, Bot

AI in Plain WordsUnit 4: Language, pictures and action

› AI-24 · Lesson 24 of 50

Language models guess the next piece

large language model (LLM)

BlueskyX

A large language model, or LLM, is first trained on enormous amounts of text to do one thing: guess the next bit of text. Given "The cat sat on the," it learns that "mat" is likely. Doing this across billions of pages pushes the model to pick up grammar, facts, writing styles and patterns of reasoning. All of these help predict what comes next.

Think

To guess the last word of a mystery novel, what would you need to understand?

Try it