Skip to contentScience, DecodedContext Jamming
Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, Illia Polosukhin · 2017
Why this paper
The architecture behind almost every current language model. Its key equation is one line, and every symbol in it can be decoded with the Rosetta Stone.
Pass 1 of 8
Research question
What problem were the authors trying to solve?
Where to look: Abstract and Introduction
Your read