Article | Published:

Stochastic phase-change neurons

Nature Nanotechnology volume 11, pages 693699 (2016) | Download Citation

Abstract

Artificial neuromorphic systems based on populations of spiking neurons are an indispensable tool in understanding the human brain and in constructing neuromimetic computational systems. To reach areal and power efficiencies comparable to those seen in biological systems, electroionics-based and phase-change-based memristive devices have been explored as nanoscale counterparts of synapses. However, progress on scalable realizations of neurons has so far been limited. Here, we show that chalcogenide-based phase-change materials can be used to create an artificial neuron in which the membrane potential is represented by the phase configuration of the nanoscale phase-change device. By exploiting the physics of reversible amorphous-to-crystal phase transitions, we show that the temporal integration of postsynaptic potentials can be achieved on a nanosecond timescale. Moreover, we show that this is inherently stochastic because of the melt-quench-induced reconfiguration of the atomic structure occurring when the neuron is reset. We demonstrate the use of these phase-change neurons, and their populations, in the detection of temporal correlations in parallel data streams and in sub-Nyquist representation of high-bandwidth signals.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from $8.99

All prices are NET prices.

References

  1. 1.

    , , , & Principles of Neural Science (McGraw-Hill, 2000).

  2. 2.

    Neuromorphic electronic systems. Proc. IEEE 78, 1629–1636 (1990).

  3. 3.

    , , & Principles of Computational Modelling in Neuroscience (Cambridge Univ. Press, 2011).

  4. 4.

    , , & Neuronal Dynamics (Cambridge Univ. Press, 2014).

  5. 5.

    , & A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity. IEEE Trans. Neural Networks 17, 211–221 (2006).

  6. 6.

    , & Wafer-scale integration of analog neural networks. Proc. Int. Joint Conf. Neural Networks 431–438 (2008).

  7. 7.

    et al. Neuromorphic silicon neuron circuits. Front. Neurosci. 5, 1–23 (2011).

  8. 8.

    et al. Silicon neurons that compute. Lect. Notes Comput. Sci. 7552, 121–128 (2012).

  9. 9.

    et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science 345, 668–673 (2014).

  10. 10.

    , , , & Integration of nanoscale memristor synapses in neuromorphic computing architectures. Nanotechnology 24, 384010 (2013).

  11. 11.

    , & Direct measurement of specific membrane capacitance in neurons. Biophys. J. 79, 314–320 (2000).

  12. 12.

    , & Neural correlations, population coding and computation. Nature Rev. Neurosci. 7, 358–366 (2006).

  13. 13.

    Noise as a resource for computation and learning in networks of spiking neurons. Proc. IEEE 102, 860–880 (2014).

  14. 14.

    & Information theory and neural coding. Nature Neurosci. 2, 947–957 (1999).

  15. 15.

    , , & Information processing with population codes. Nature Rev. Neurosci. 1, 125–132 (2000).

  16. 16.

    et al. Cognitive computing. Commun. ACM 54, 62–71 (2011).

  17. 17.

    Resistance switching memories are memristors. Appl. Phys. A 102, 765–783 (2011).

  18. 18.

    et al. Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. Nature Mater. 10, 591–595 (2011).

  19. 19.

    , , & Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. Nano Lett. 12, 2179–2186 (2012).

  20. 20.

    et al. Experimental demonstration and tolerancing of a large-scale neural network (165 000 synapses) using phase-change memory as the synaptic weight element. IEEE Trans. Electron Dev. 62, 3498–3507 (2015).

  21. 21.

    Analog neurons and neurosynaptic networks. US patent 6,999,953 B2 (2006).

  22. 22.

    , , , & Arithmetic and biologically-inspired computing using phase-change materials. Adv. Mater. 23, 3408–3413 (2011).

  23. 23.

    , & A scalable neuristor built with Mott memristors. Nature Mater. 12, 114–117 (2013).

  24. 24.

    et al. Phase change memory technology. J. Vac. Sci. Technol. B 28, 223 (2010).

  25. 25.

    , , & Low-power switching of phase-change materials with carbon nanotube electrodes. Science 332, 568–570 (2011).

  26. 26.

    , & Crystal growth within a phase change memory cell. Nature Commun. 5, 4314 (2014).

  27. 27.

    et al. Novel lithography-independent pore phase change memory. Proc. IEEE Symp. VLSI Technol. 100–101 (2007).

  28. 28.

    , & Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neurosci. 3, 919–926 (2000).

  29. 29.

    & Synaptic plasticity taming the beast. Nature Neurosci. 3, 1178–1183 (2000).

  30. 30.

    , , & Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. J. Neurosci. 23, 3697–3714 (2003).

  31. 31.

    , & Structural origin of resistance drift in amorphous GeTe. Phys. Rev. B 93, 115201 (2016).

  32. 32.

    et al. Distribution of nanoscale nuclei in the amorphous dome of a phase change random access memory. Appl. Phys. Lett. 104, 071907 (2014).

  33. 33.

    , & Atomic force microscopy measurements of crystal nucleation and growth rates in thin films of amorphous Te alloys. Appl. Phys. Lett. 84, 5240–5242 (2004).

  34. 34.

    & Models for phase-change of Ge2Sb2Te5 in optical and electrical memory devices. J. Appl. Phys. 95, 504–511 (2004).

  35. 35.

    & Sub-Nyquist sampling bridging theory and practice. IEEE Signal Process. Mag. 28, 98–124 (2011).

  36. 36.

    & Neuromorphic sensory systems. Curr. Opin. Neurobiol. 20, 288–295 (2010).

  37. 37.

    , , , & Decision making and perceptual bistability in spike-based neuromorphic VLSI systems. Proc. IEEE Int. Symp. Circuits Syst. 2708–2711 (2015).

  38. 38.

    , & Probabilistic inference in general graphical models through sampling in stochastic networks of spiking neurons. PLoS Comput. Biol. 7, e1002294 (2011).

  39. 39.

    , & Twitter mood predicts the stock market. J. Comput. Sci. 2, 1–8 (2011).

  40. 40.

    , , & Context aware computing for the internet of things—a survey. IEEE Commun. Surv. Tutorials 16, 414–454 (2014).

  41. 41.

    et al. Synthesizing cognition in neuromorphic electronic systems. Proc. Natl Acad. Sci. USA 110, E3468–E3476 (2013).

  42. 42.

    Which model to use for cortical spiking neurons? IEEE Trans. Neural Networks 15, 1063–1070 (2004).

  43. 43.

    & Variability, compensation and homeostasis in neuron and network function. Nature Rev. Neurosci. 7, 563–574 (2006).

  44. 44.

    , , & Memristors empower spiking neurons with stochasticity. IEEE J. Emerg. Sel. Top. Circ. Syst. 5, 242–253 (2015).

  45. 45.

    , , , & Stochastic memristive devices for computing and neuromorphic applications. Nanoscale 5, 5872–5878 (2013).

  46. 46.

    et al. Spin-transfer torque magnetic memory as a stochastic memristive synapse. IEEE Trans. Biomed. Circ. Syst. 1, 1074–1077 (2014).

  47. 47.

    et al. Integrated all-photonic non-volatile multi-level memory. Nature Photon. 9, 725–732 (2015).

  48. 48.

    & The parallel approach. Nature Phys. 9, 200–202 (2013).

  49. 49.

    , , , & A collective relaxation model for resistance drift in phase change memory cells. IEEE Int. Rel. Phys. Symp. Proc. MY.5.1–MY.5.6 (2015).

Download references

Acknowledgements

The authors thank F. Zipoli for the molecular dynamics simulations, L. Kull and M. Stanisavljevic for the electrical circuit design and simulations, W. W. Koelmans, S. Wozniak and G. Cherubini for discussions and C. Bolliger for help with preparation of the manuscript.

Author information

Affiliations

  1. IBM Research-Zurich, CH-8803 Rüschlikon, Switzerland

    • Tomas Tuma
    • , Angeliki Pantazi
    • , Manuel Le Gallo
    • , Abu Sebastian
    •  & Evangelos Eleftheriou
  2. ETH Zurich, CH-8092 Zurich, Switzerland

    • Manuel Le Gallo

Authors

  1. Search for Tomas Tuma in:

  2. Search for Angeliki Pantazi in:

  3. Search for Manuel Le Gallo in:

  4. Search for Abu Sebastian in:

  5. Search for Evangelos Eleftheriou in:

Contributions

T.T., A.S., A.P. and E.E. conceived the idea of stochastic phase-change neurons. T.T., M.L. and A.P. performed the experiments. All authors contributed to the analysis and interpretation of results. T.T. and A.S. co-wrote the manuscript based on the input from all authors. E.E. supervised the work.

Competing interests

The authors declare no competing financial interests.

Corresponding authors

Correspondence to Tomas Tuma or Evangelos Eleftheriou.

Supplementary information

PDF files

  1. 1.

    Supplementary information

    Supplementary information

About this article

Publication history

Received

Accepted

Published

DOI

https://doi.org/10.1038/nnano.2016.70