Letter | Published:

Chaotic dynamics in nanoscale NbO2 Mott memristors for analogue computing

Nature volume 548, pages 318321 (17 August 2017) | Download Citation

Abstract

At present, machine learning systems use simplified neuron models that lack the rich nonlinear phenomena observed in biological systems, which display spatio-temporal cooperative dynamics. There is evidence that neurons operate in a regime called the edge of chaos1 that may be central to complexity, learning efficiency, adaptability and analogue (non-Boolean) computation in brains2,3,4,5,6,7. Neural networks have exhibited enhanced computational complexity when operated at the edge of chaos2, and networks of chaotic elements have been proposed for solving combinatorial or global optimization problems8. Thus, a source of controllable chaotic behaviour that can be incorporated into a neural-inspired circuit may be an essential component of future computational systems. Such chaotic elements have been simulated using elaborate transistor circuits that simulate known equations of chaos9,10,11,12, but an experimental realization of chaotic dynamics from a single scalable electronic device has been lacking5,6,13. Here we describe niobium dioxide (NbO2) Mott memristors each less than 100 nanometres across that exhibit both a nonlinear-transport-driven current-controlled negative differential resistance and a Mott-transition-driven temperature-controlled negative differential resistance. Mott materials have a temperature-dependent metal–insulator transition that acts as an electronic switch, which introduces a history-dependent resistance into the device. We incorporate these memristors into a relaxation oscillator14 and observe a tunable range of periodic and chaotic self-oscillations15. We show that the nonlinear current transport coupled with thermal fluctuations at the nanoscale generates chaotic oscillations. Such memristors could be useful in certain types of neural-inspired computation by introducing a pseudo-random signal that prevents global synchronization and could also assist in finding a global minimum during a constrained search. We specifically demonstrate that incorporating such memristors into the hardware of a Hopfield computing network can greatly improve the efficiency and accuracy of converging to a solution for computationally difficult problems.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    , & Neurons are poised near the edge of chaos. Int. J. Bifurc. Chaos 22, 1250098 (2012)

  2. 2.

    & Real-time computation at the edge of chaos in recurrent neural networks. Neural Comput. 16, 1413–1436 (2004)

  3. 3.

    & Lambda and the edge of chaos in recurrent neural networks. Artif. Life 21, 55–71 (2015)

  4. 4.

    Requirements for evolvability in complex systems: orderly dynamics and frozen components. Physica D 42, 135–152 (1990)

  5. 5.

    , , & Chaotic Boltzmann machines. Sci. Rep. 3, 1610 (2013)

  6. 6.

    Between order and chaos. Nat. Phys. 8, 17–24 (2012)

  7. 7.

    Complex systems: order out of chaos. Nature 436, 905–907 (2005)

  8. 8.

    & Chaotic simulated annealing by a neural network model with transient chaos. Neural Netw. 8, 915–930 (1995)

  9. 9.

    , , & in Memristor Networks (eds & ) 351–364 (Springer, 2013)

  10. 10.

    , & Chaos computing: ideas and implementations. Phil. Trans. R. Soc. Lond. A 366, 653–664 (2008)

  11. 11.

    , , & Chaotic memristor. Appl. Phys. A 102, 885–889 (2011)

  12. 12.

    , , , & A chaotic oscillator based on HP memristor model. Math. Probl. Eng. 2015, 561901 (2015)

  13. 13.

    & Simplest chaotic circuit. Int. J. Bifurc. Chaos 20, 1567–1580 (2010)

  14. 14.

    & Sub-100 fJ and sub-nanosecond thermally driven threshold switching in niobium oxide crosspoint nanodevices. Nanotechnology 23, 215202 (2012)

  15. 15.

    & Phase transitions enable computational universality in neuristor-based cellular automata. Nanotechnology 24, 384002 (2013)

  16. 16.

    et al. An accurate locally active memristor model for S-type negative differential resistance in NbOx. Appl. Phys. Lett. 108, 023505 (2016)

  17. 17.

    . & Local Activity Principle (Imperial College Press, 2013)

  18. 18.

    , , , & Nonlinear dynamics of a locally-active memristor. IEEE Trans. Circ. Syst. 62, 1165–1174 (2015)

  19. 19.

    . & Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields 117–165 (Springer, 1983)

  20. 20.

    , & Chua corsage memristor oscillator via Hopf bifurcation. Int. J. Bifurc. Chaos 26, 1630009 (2016)

  21. 21.

    Memristor, Hodgkin–Huxley, and edge of chaos. Nanotechnology 24, 383001 (2013)

  22. 22.

    Local activity is the origin of complexity. Int. J. Bifurc. Chaos 15, 3435–3456 (2005)

  23. 23.

    Chaos in Dynamical Systems (Cambridge Univ. Press, 2002)

  24. 24.

    , , , & Coexistence of memristance and negative differential resistance in a nanoscale metal-oxide-metal system. Adv. Mater. 23, 1730–1733 (2011)

  25. 25.

    & “Neural” computation of decisions in optimization problems. Biol. Cybern. 52, 141–152 (1985)

  26. 26.

    ., ., ., . & Computational Intelligence: A Methodological Introduction Ch. 8, 131–157 (Springer, 2016)

  27. 27.

    . et al. Dot-product engine for neuromorphic computing: programming 1T1M crossbar to accelerate matrix-vector multiplication. In IEEE Conf. Design Automation (IEEE, 2016)

  28. 28.

    et al. Spatially uniform resistance switching of low current, high endurance titanium–niobium-oxide memristors. Nanoscale 9, 1793–1798 (2017)

  29. 29.

    et al. ISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars. In Proc. 43rd Int. Symp. Computer Architecture 14–26, (IEEE Press, 2016)

Download references

Acknowledgements

The research is in part based on work supported by the Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA), via contract number 2017-17013000002. We thank L. O. Chua for reviewing the manuscript, discussions and data analysis. We also thank G. Gibson for discussions and insights.

Author information

Affiliations

  1. Hewlett Packard Labs, 1501 Page Mill Road, Palo Alto, California 94304, USA

    • Suhas Kumar
    • , John Paul Strachan
    •  & R. Stanley Williams

Authors

  1. Search for Suhas Kumar in:

  2. Search for John Paul Strachan in:

  3. Search for R. Stanley Williams in:

Contributions

All authors contributed to the conception of the idea, design of experiments, construction of the model, data analysis and writing of the manuscript. S.K. primarily set up experiments and collected experimental data. S.K. and J.P.S. together ran the simulations of the models. R.S.W. conceptualized the static model, the inclusion of thermal noise in the dynamical model, and determined the relevance of chaos in computational systems. J.P.S. had the specific idea of using chaos for accelerating solutions in Hopfield networks.

Competing interests

The authors declare no competing financial interests.

Corresponding authors

Correspondence to Suhas Kumar or R. Stanley Williams.

Reviewer Information Nature thanks W. Ditto, Z. Toroczkai and the other anonymous reviewer(s) for their contribution to the peer review of this work.

Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

PDF files

  1. 1.

    Supplementary information

    This file contains Supplementary Text and Data and Supplementary Figures 1-20.

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/nature23307

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.