› Deep Learning · 12 of 14
Yoshua Bengio
1964–present · Canadian
Made fundamental contributions to deep learning architectures and natural language processing. Godfather of AI.
- Ideas
- Word embeddings, language modeling
- Affiliations
- University of Montreal (Mila)
- Contribution
- Made foundational contributions to deep architectures and representation learning.
- Advanced neural language modeling and word embeddings — how networks map words into usable geometry.
- Built Mila in Montreal into a major deep-learning research center. Godfather of AI.
- Key observations
- Language can be treated as vectors in space where "nearby" means "related in use."
- Deep models learn intermediate representations that transfer across tasks.
- Scientific communities (labs, open papers, students) multiply individual insight.
- Conclusions
- Today's language models sit on decades of representation-learning work.
- Embeddings are a classroom idea: meaning as position and distance.
- Localization of talent (cities, institutes) shapes who gets to build the next wave.
Same notes in the short book →
This page is the link. Send it as it is.