› Information Theory · 4 of 14
Claude Shannon
1916–2001 · American
Laid the mathematical foundation for digitizing information, and pioneered computer chess and search.
- Ideas
- Information theory, bits
- Affiliations
- Bell Labs, MIT
- Contribution
- Founded information theory — a math of how much surprise a message carries, measured in bits.
- Showed how to send signals reliably over noisy channels with encoding and redundancy.
- Built early experiments in computer chess and search, treating play as a tree of choices.
- Key observations
- Information can be measured separately from meaning — bits are about possibility, not understanding.
- Noise is normal; good systems plan for errors instead of pretending channels are perfect.
- Search through move trees is a concrete way machines can "look ahead."
- Conclusions
- Digital life — files, networks, compression, encryption — sits on Shannon's bit.
- When AI models "compress" language into patterns, they are still in the business of representing information efficiently.
- Chess and games remain a classroom for search, evaluation, and limits of lookahead.
Same notes in the short book →
This page is the link. Send it as it is.