Перейти к содержимому

Attention Is All You Need, Visually Explained | How Transformers Changed AI

The Deep Dive Room

0:00 / 0:00

Attention Is All You Need, Visually Explained | How Transformers Changed AI

192 просмотра · 3 дн. назад
The Deep Dive Room
12 подписчиков
192 просмотра · 3 дн. назад
The 2017 paper behind ChatGPT and almost every modern AI model — visually explained. See why RNNs hit a wall, how self-attention lets every word look at every other word, and how positional encoding keeps word order, with the math mapped onto the animation. 📄 Paper: https://arxiv.org/abs/1706.03762 0:00 Intro 0:50 Why RNNs struggled 1:40 Self-attention 2:37 Positional encoding 3:57 Results 4:53 Beyond text The Deep Dive Room — concepts & research, visually explained.