Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Learning representations by back-propagating errors

Nature volume 323, pages 533–536 (1986)Cite this article

Abstract

We describe a new learning procedure, back-propagation, for networks of neurone-like units. The procedure repeatedly adjusts the weights of the connections in the network so as to minimize a measure of the difference between the actual output vector of the net and the desired output vector. As a result of the weight adjustments, internal ‘hidden’ units which are not part of the input or output come to represent important features of the task domain, and the regularities in the task are captured by the interactions of these units. The ability to create useful new features distinguishes back-propagation from earlier, simpler methods such as the perceptron-convergence procedure1.

This is a preview of subscription content

Access options

Buy article

Get time limited or full article access on ReadCube.

$32.00

Buy

All prices are NET prices.

References

  1. Rosenblatt, F. Principles of Neurodynamics (Spartan, Washington, DC, 1961).

    Google Scholar 

  2. Minsky, M. L. & Papert, S. Perceptrons (MIT, Cambridge, 1969).

    MATH  Google Scholar 

  3. Le Cun, Y. Proc. Cognitiva 85, 599–604 (1985).

    Google Scholar 

  4. Rumelhart, D. E., Hinton, G. E. & Williams, R. J. in Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Vol. 1: Foundations (eds Rumelhart, D. E. & McClelland, J. L.) 318–362 (MIT, Cambridge, 1986).

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Cognitive Science, C-015, University of California, San Diego, La Jolla, California, 92093, USA

    David E. Rumelhart & Ronald J. Williams

  2. Department of Computer Science, Carnegie-Mellon University, Pittsburgh, Philadelphia, 15213, USA

    Geoffrey E. Hinton

Authors
  1. David E. Rumelhart
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Geoffrey E. Hinton
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ronald J. Williams
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Rumelhart, D., Hinton, G. & Williams, R. Learning representations by back-propagating errors. Nature 323, 533–536 (1986). https://doi.org/10.1038/323533a0

Download citation

  • Received:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1038/323533a0

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing