Loading lesson…
Rumelhart, Hinton, and Williams published the algorithm that would eventually power everything.
In 1986, David Rumelhart, Geoffrey Hinton, and Ronald Williams published Learning representations by back-propagating errors in Nature. Their paper showed how to train multi-layer neural networks by using the chain rule to propagate error gradients from output back to input.
It was a really good feeling when we realized this was going to work.
— Geoffrey Hinton, on backprop
The big idea: the central algorithm of modern AI was published in 1986 and then sat mostly dormant for a generation. Sometimes the bottleneck is not the math but the hardware and data around it.
15 questions · take it digitally for instant feedback at tendril.neural-forge.io/learn/quiz/end-history-backprop-1986-creators
What is the core idea behind "Backpropagation Rediscovered, 1986"?
Which term best describes a foundational idea in "Backpropagation Rediscovered, 1986"?
A learner studying Backpropagation Rediscovered, 1986 would need to understand which concept?
Which of these is directly relevant to Backpropagation Rediscovered, 1986?
Which of the following is a key point about Backpropagation Rediscovered, 1986?
Which of these does NOT belong in a discussion of Backpropagation Rediscovered, 1986?
Which statement is accurate regarding Backpropagation Rediscovered, 1986?
Which of these does NOT belong in a discussion of Backpropagation Rediscovered, 1986?
What is the key insight about "Why it broke the XOR barrier" in the context of Backpropagation Rediscovered, 1986?
Which statement accurately describes an aspect of Backpropagation Rediscovered, 1986?
What does working with Backpropagation Rediscovered, 1986 typically involve?
Which best describes the scope of "Backpropagation Rediscovered, 1986"?
Which section heading best belongs in a lesson about Backpropagation Rediscovered, 1986?
Which section heading best belongs in a lesson about Backpropagation Rediscovered, 1986?
Which of the following is a concept covered in Backpropagation Rediscovered, 1986?