Making AI Easy · Lesson 1 · Vaswani et al., NeurIPS 2017
Attention Is All You Need, Visualized
Three ways to understand the paper that introduced the Transformer, the design behind modern AI systems. Read the blog post, click through the picture book, then open the engine room when you want the math.
No math needed
Transformers From Zero
11 short scenes with everyday analogies: word cards, a video search, beams of attention and a translation written word by word.
Start here → Reading versionAttention, Explained Plainly
A 20-minute blog post that walks through the whole paper in plain language, from the problem to the results.
Read the post → Live tensor mathThe Attention Engine
13 stages computing every step of a tiny Transformer in your browser, with notes for researchers on each stage.
Open the deep dive →