Generative Art Timeline · Chapter 6: Personal Computer Era (1980s)
1982
Paul Werbos Proposes Backpropagation to Train Neural Networks

In a major advancement in AI and Machine Learning research, Paul Werbos proposed using backpropagation to train neural networks at the “System Modeling and Optimization” conference in New York. The method was initially introduced by Seppo Linnainmaa in 1970 for automatic differentiation in complex systems.
Werbos’s adaptation of this algorithm marked a significant advancement in neural network training, enabling the efficient adjustment of network weights by propagating errors backward through the layers.
Jürgen Schmidhuber describes it as “essentially an efficient way of implementing Leibniz’s chain rule for deep networks.”
Backprop's roots go back further, though, to control theory: Henry J. Kelley published a precursor in 1960 for computing optimal flight paths, followed by Arthur E. Bryson and Stuart Dreyfus. Werbos’s own 1974 thesis included a preliminary discussion of applying it to neural networks.
This breakthrough became foundational to modern deep learning, influencing the development of widely used AI frameworks like TensorFlow and PyTorch.
Text by Peter Bauman. Generative Art Timeline, Le Random.
Sources
People
Gottfried Leibniz, Jürgen Schmidhuber, Paul Werbos, Seppo Linnainmaa
Movements
Machine Learning Art
Filed under
- Ideas
- ai history, Machine Learning Art
- Technologies
- artificial intelligence, automatic differentiation, backpropagation, complex systems, deep learning, machine learning, neural networks, PyTorch
- People
- Gottfried Leibniz, Jürgen Schmidhuber, Paul Werbos, Seppo Linnainmaa
- Organisations
- System Modeling and Optimization
- Places
- New York
Echoes across time
- 1955 · John McCarthy, Marvin Minsky & Claude Shannon Introduce World to AI
- 1763 · Thomas Bayes develops Bayesian Inference
- 1951 · Marvin Minsky and Dean Edmonds Build the SNARC Neural Network Machine
Related moments
Le Random editorials
- Seeing Machines: Luba Elliott on the 2026 CVPR Art Gallery, Luba Elliott, June 1, 2026
- Ryan Murdock on Hacking AI, Peter Bauman, September 28, 2026