Generative Art Timeline · Chapter 9: AI Era (2010s)
2017
Attention Is All You Need

The foundational “transformer” paper was written by eight Google researchers who built a network from attention alone. Instead of reading a sentence word by word, it weighed every word against every other at once, so it could train on vast amounts of text. Attention drove AlphaFold and the transformer became the T in rival OpenAI’s ChatGPT.
Text by Peter Bauman. Generative Art Timeline, Le Random.
Sources
Movements
artificial intelligence
Filed under
- Ideas
- ai history
- Technologies
- artificial intelligence, deep learning, Large Language Model (LLM)
- Organisations
- Other subjects
- Ashish Vaswani, Niki Parmar, transformers
Related moments
Le Random editorials
Le Random podcast
- Timeline Ch 9—AI Era (2010s) with Tyler Hobbs, Helena Sarin, Rhea Myers & Gene Kogan — listen with transcript on Le Random (30 Jul 2024, 51 min). Chapter 9’s episode. Apple Podcasts · Spotify