Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

An atomic Boltzmann machine capable of self-adaption

Nature Nanotechnology volume 16, pages 414–420 (2021)Cite this article

Subjects

Abstract

The quest to implement machine learning algorithms in hardware has focused on combining various materials, each mimicking a computational primitive, to create device functionality. Ultimately, these piecewise approaches limit functionality and efficiency, while complicating scaling and on-chip learning, necessitating new approaches linking physical phenomena to machine learning models. Here, we create an atomic spin system that emulates a Boltzmann machine directly in the orbital dynamics of one well-defined material system. Utilizing the concept of orbital memory based on individual cobalt atoms on black phosphorus, we fabricate the prerequisite tuneable multi-well energy landscape by gating patterned atomic ensembles using scanning tunnelling microscopy. Exploiting the anisotropic behaviour of black phosphorus, we realize plasticity with multi-valued and interlinking synapses that lead to tuneable probability distributions. Furthermore, we observe an autonomous reorganization of the synaptic weights in response to external electrical stimuli, which evolves at a different time scale compared to neural dynamics. This self-adaptive architecture paves the way for autonomous learning directly in atomic-scale machine learning hardware.

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Learn more

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Neural dynamics from coupled cobalt atoms on BP.
Fig. 2: Construction of a binary atomic synapse via anisotropic coupling.
Fig. 3: Multi-valued synapses.
Fig. 4: Synaptic dynamics and self-adaption.

Data availability

The data from this work can be obtained from the corresponding author upon reasonable request.

References

  1. Strukov, D. B., Snider, G. S., Stewart, D. R. & Williams, R. S. The missing memristor found. Nature 453, 80–83 (2008).

    Article  CAS  Google Scholar 

  2. Chen, T. et al. Classification with a disordered dopant-atom network in silicon. Nature 577, 341–345 (2020).

    Article  CAS  Google Scholar 

  3. Bose, S. K. et al. Evolution of a designless nanoparticle network into reconfigurable Boolean logic. Nat. Nanotechnol. 10, 1048–1052 (2015).

    Article  CAS  Google Scholar 

  4. Torrejon, J. et al. Neuromorphic computing with nanoscale spintronic oscillators. Nature 547, 428–431 (2017).

    Article  CAS  Google Scholar 

  5. Romera, M. et al. Vowel recognition with four coupled spin-torque nano-oscillators. Nature 563, 230–234 (2018).

    Article  CAS  Google Scholar 

  6. Grollier, J., Querlioz, D. & Stiles, M. D. Spintronic nanodevices for bioinspired computing. proceedings of the IEEE. Inst. Electr. Electron. Eng. 104, 2024–2039 (2016).

    Article  Google Scholar 

  7. McMahon, P. L. et al. A fully programmable 100-spin coherent ising machine with all-to-all connections. Science 354, 614–617 (2016).

    Article  CAS  Google Scholar 

  8. Prezioso, M. et al. Training and operation of an integrated neuromorphic network based on metal-oxide memristors. Nature 521, 61–64 (2015).

    Article  CAS  Google Scholar 

  9. Burr, G. W. et al. Neuromorphic computing using non-volatile memory. Adv. Phys. X 2, 89–124 (2017).

    Google Scholar 

  10. Borders, W. A. et al. Integer factorization using stochastic magnetic tunnel junctions. Nature 573, 390–393 (2019).

    Article  CAS  Google Scholar 

  11. Feldmann, J., Youngblood, N., Wright, C. D., Bhaskaran, H. & Pernice, W. H. P. All-optical spiking neurosynaptic networks with self-learning capabilities. Nature 569, 208–214 (2019).

    Article  CAS  Google Scholar 

  12. Wang, Z. et al. Fully memristive neural networks for pattern classification with unsupervised learning. Nat. Electron. 1, 137–145 (2018).

    Article  Google Scholar 

  13. Ishii, M. et al. On-Chip Trainable 1.4M 6T2R PCM Synaptic Array with 1.6K Stochastic LIF Neurons for Spiking RBM. In IEEE International Electron Devices Meeting (IEDM) 14.2.1–14.2.4 (IEEE, 2019).

  14. Kieferová, M. & Wiebe, N. Tomography and generative training with quantum boltzmann machines. Phys. Rev. A 96, 062327 (2017).

    Article  Google Scholar 

  15. Amin, M. H., Andriyash, E., Rolfe, J., Kulchytskyy, B. & Melko, R. Quantum boltzmann Machine. Phys. Rev. X 8, 021050 (2018).

    CAS  Google Scholar 

  16. Kappen, H. J. Learning quantum models from quantum or classical data. J. Phys. A: Math. Theor. 53, 214001 (2020).

    Article  Google Scholar 

  17. Hinton, G. & Sejnowski, T. Optimal perceptual inference. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 448–453 (IEEE, 1983).

  18. Hertz, J., Krough, A. & Palmer, R. G. Introduction to the Theory of Neural Computation (CRC Press, 1991).

  19. Edwards, S. F. & Anderson, P. W. Theory of spin glasses. II. J. Phys. F. 6, 1927 (1976).

    Article  Google Scholar 

  20. Edwards, S. F. & Anderson, P. W. Theory of spin glasses. J. Phys. F. 5, 965 (1975).

    Article  Google Scholar 

  21. Sherrington, D. & Kirkpatrick, S. Solvable model of a Spin-Glass. Phys. Rev. Lett. 35, 1792 (1975).

    Article  Google Scholar 

  22. Hirjibehedin, C. F., Lutz, C. P. & Heinrich, A. J. Spin coupling in engineered atomic structures. Science 312, 1021–1024 (2006).

    Article  CAS  Google Scholar 

  23. Khajetoorians, A. A., Wiebe, J., Chilian, B. & Wiesendanger, R. Realizing all-spin–based logic operations atom by atom. Science 332, 1062–1064 (2011).

    Article  CAS  Google Scholar 

  24. Khajetoorians, A. A. et al. Atom-by-atom engineering and magnetometry of tailored nanomagnets. Nat. Phys. 8, 497–503 (2012).

    Article  CAS  Google Scholar 

  25. Toskovic, R. et al. Atomic spin-chain realization of a model for quantum criticality. Nat. Phys. 12, 656–660 (2016).

    Article  CAS  Google Scholar 

  26. Loth, S., Baumann, S., Lutz, C. P., Eigler, D. M. & Heinrich, A. J. Bistability in atomic-scale antiferromagnets. Science 335, 196–199 (2012).

    Article  CAS  Google Scholar 

  27. Khajetoorians, A. A. et al. Current-Driven spin dynamics of artificially constructed quantum magnets. Science 339, 55–59 (2013).

    Article  CAS  Google Scholar 

  28. Kiraly, B. et al. An orbitally derived single-atom magnetic memory. Nat. Commun. 9, 3904 (2018).

    Article  Google Scholar 

  29. Kiraly, B. et al. Anisotropic Two-Dimensional screening at the surface of black phosphorus. Phys. Rev. Lett. 123, 216403 (2019).

    Article  CAS  Google Scholar 

  30. Prishchenko, D. A., Mazurenko, V. G., Katsnelson, M. I. & Rudenko, A. N. Coulomb interactions and screening effects in few-layer black phosphorus: a tight-binding consideration beyond the long-wavelength limit. 2D Mater. 4, 025064 (2017).

    Article  Google Scholar 

  31. Baldassi, C., Braunstein, A., Brunel, N. & Zecchina, R. Efficient supervised learning in networks with binary synapses. Proc. Natl Acad. Sci. USA 104, 11079–11084 (2007).

    Article  CAS  Google Scholar 

  32. Purves, D. et al. Neuroscience (Sinauer Associates, 2019).

  33. Heskes, T. M. & Kappen, B. Learning processes in neural networks. Phys. Rev. A 44, 2718–2726 (1991).

    Article  CAS  Google Scholar 

  34. Fuechsle, M. et al. A single-atom transistor. Nat. Nanotechnol. 7, 242–246 (2012).

    Article  CAS  Google Scholar 

  35. Rudenko, A. N., Keil, F. J., Katsnelson, M. I. & Lichtenstein, A. I. Adsorption of cobalt on graphene: electron correlation effects from a quantum chemical perspective. Phys. Rev. B 86, 075422 (2012).

    Article  Google Scholar 

  36. Kolmus, A., Katsnelson, M. I., Khajetoorians, A. A. & Kappen, H. J. Atom-by-atom construction of attractors in a tunable finite size spin array. New J. Phys. 22, 023038 (2020).

    Article  CAS  Google Scholar 

  37. Lavielle, M. Using penalized contrasts for the change-point problem. Signal Process. 85, 1501–1510 (2005).

    Article  Google Scholar 

  38. Killick, R., Fearnhead, P. & Eckley, I. A. Optimal detection of changepoints with a linear computational cost. J. Am. Stat. Assoc. 107, 1590–1598 (2012).

    Article  CAS  Google Scholar 

Download references

Acknowledgements

This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant no. 818399). This research was funded in part by ONR grant no. N00014-17-1-2569. A.A.K. and E.J.K. acknowledge the NWO-VIDI project ‘Manipulating the interplay between superconductivity and chiral magnetism at the single-atom level’ with project no. 680-47-534. B.K. acknowledges NWO-VENI project ‘Controlling magnetism of single atoms on black phosphorus’ with project no. 016.Veni.192.168.

Author information

Author notes

  1. These authors contributed equally: Brian Kiraly, Elze J. Knol.

Authors and Affiliations

  1. Institute for Molecules and Materials, Radboud University, Nijmegen, the Netherlands

    Brian Kiraly, Elze J. Knol, Werner M. J. van Weerdenburg & Alexander A. Khajetoorians

  2. Donders Institute for Neuroscience, Radboud University, Nijmegen, the Netherlands

    Hilbert J. Kappen

Authors
  1. Brian Kiraly
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Elze J. Knol
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Werner M. J. van Weerdenburg
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hilbert J. Kappen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Alexander A. Khajetoorians
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

B.K. and E.J.K. performed the experiments under the direction and supervision of A.A.K. B.K. and E.J.K. developed the data analysis, while B.K., E.J.K., H.J.K. and A.A.K. participated in the scientific analysis. W.M.J.v.W. developed the a.c. experimental setup. H.J.K. performed the Boltzmann machine modelling. A.A.K. and H.J.K. designed the experiments. The manuscript was written by B.K., E.J.K., H.J.K. and A.A.K.

Corresponding author

Correspondence to Alexander A. Khajetoorians.

Ethics declarations

Competing interests

The authors declare no competing interests.

Additional information

Peer review information Nature Nanotechnology thanks Giuseppe Carleo, Matthew Ellis and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary Information

Supplementary Figs. 1–12, Discussion and Tables 1–3.

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kiraly, B., Knol, E.J., van Weerdenburg, W.M.J. et al. An atomic Boltzmann machine capable of self-adaption. Nat. Nanotechnol. 16, 414–420 (2021). https://doi.org/10.1038/s41565-020-00838-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41565-020-00838-4

This article is cited by

Search

Advanced search

Quick links

Find nanotechnology articles, nanomaterial data and patents all in one place. Visit Nano by Nature Research