Neuromorphic systems are currently experiencing a rapid upswing due to the fact that today's CMOS (complementary metal oxide silicon) based technologies are increasingly approaching their limits. In particular, for the area of machine learning, energy consumption of today's electronics is an important limitation, that also contributes toward the ever-increasing impact of digitalization on our climate. Thus, in order to better meet the special requirements of unconventional computing, new physical substrates for bio-inspired computing schemes are extensively exploited. The aim of this Guest Edited Collection is to provide a platform for interdisciplinary research along three main lines: memristive materials and devices, emulation of cellular learning (neurons and synapses), and unconventional computing and network schemes.
Neuromorphic engineering goes back to the 1980s to its inventor Carver Mead, who used the at this time relatively new VLSI (very-large-scale integration) technology to implement biologically inspired systems for information processing1. The idea was to find ways to transfer biological learning and memory processes to electronic circuits2. Today, this field has gained considerable new interest and expanded massively3. This development of the field is driven especially by improvements in the power efficiency of neuromorphic architectures, and the potential of new hardware, better tailored to meet the needs of machine learning4. An important contribution is made by non-volatile memory technologies (memristive technologies) that form the backbone of neuromorphic systems, since they allow us to mimic very precisely the learning and memory processes in hardware3,4. This Guest Edited Collection tries to bundle work in three main thematic areas of neuromorphic computing: memristive materials and devices, emulation of cellular forms of memory and learning, and neuromorphic computing (cf. Fig. 1). Since a continuous expansion of this collection is desired, the papers mentioned in this article can be considered a 'taster' for what is yet to come.
Emulation of the central nervous system’s decentralized information processing, in which information is learned and stored locally, is the essential basis for bio-inspired computing3. This calls for novel memristive devices that are tailored to meet these specific requirements (cf. Fig. 1). In this respect, Vahl et al.5 investigate the nanoscale memristive properties of individual noble metal alloy nanoparticles that are sparsely encapsulated in a thin SiO2 dielectric matrix. They show evidence that alloy nanoparticles-based devices have reproducible diffusive switching characteristics and offer a high design versatility to tune such switching properties. The form of the resistance state is crucial for the successful training of artificial neural networks; Nikam et al.6 present a Li ion synaptic transistor with high ionic conductivity that allows linear conductance switching with several discrete non-volatile states. Also in7 the impact of Li-based devices for the emulation of synaptic behaviour is shown. The integration of cellular learning forms into the design of memristive components is shown by Zenya et al.8. Here, a 4-terminal device is presented that can simulate hetero-synaptic plasticity. Furthermore, Serb et al.9 were able to emulate the transmission and plasticity properties of real synapses by connecting memristive devices between brain and silicon spiking neurons. The aspect of biocompatibility is taken into account by investigating parylene-based memristive devices in Minnekhanov et al.10. Those devices can be used to emulate spike-timing-dependent plasticity (STDP) and based on this the authors implement a simple neuromorphic network model of classical conditioning.
For a successful transition, from the level of individual memristive devices to a multidimensional network level, the reconstruction of biological information processing by neurons and synapses is necessary11. This requires adapting the biological paradigms of information processing in such a way that they account for the special requirements of memristive devices11. In this respect, Ahmed et al.12 show how to implement different synaptic learning rules by utilizing a CMOS-compatible memristive approach, while Manicka et al. follow the question of how non-neural tissues could process information13. Stoliar et al.14 investigate the relationship between the STDP characteristics and spike types using ferroelectric-tunnel-junctions. In terms of neural functionalities, Rozenberg et al.15 introduce an ultra-compact leaky-integrate-and-fire neuron which has only three active devices but already emulates biologically realistic features. Furthermore, the authors claim that the ultimate ultra-compact limit can be reached by using materials which have a Mott transition. This advantage of Mott materials is used by del Valle et al.16 for emulating neural functionalities in the framework of a neuristor model.
It is the possibility of a parallel vector matrix multiplication within memristive crossbar arrays that enables energy-efficient in-memory computing, i.e. a decentralized computing in which information is processed and stored locally17. In this respect, Kingra et al.18 present a methodology to implement memory and logic operations simultaneously. Efficient hardware implementation of logic operation using memristive devices allows us to reduce the number of computation steps, as shown by Siemon et al.19. Kathmann et al.20 present a completely new methodology for logic operation which employs the heat flux exchanged in the near-field regime in nanoparticle networks. More biologically inspired approaches include supervised and unsupervised networks, oscillator systems, and stochastic computing. In this respect, Araujo et al.21 discuss the role of non-linear data processing on a speech recognition task, while Chou et al.22 report on an analogue computing system with coupled non-linear oscillators which is capable of solving complex combinatorial optimization problems. Nandakumar et al.23 demonstrate experimentally a supervised learning scheme using spiking neurons and phase change materials, while in24,25 photonic based-neuromorphic computing schemes are presented. For a significant reduction in power consumption, wake-up systems are of interest, which only switch on the more complex computing structures when they are needed. Gupta et al.26 shows an implementation of such a system using CMOS–MoS2 memtransistors.
The hope is that this Collection can give an overview of the complexity of the topic and show where the successes already achieved, but also the challenges of this topic, lie. Many thanks to all authors for their contributions to this Collection.
Mead, C. Neuromorphic electronic systems. Proc. IEEE 78, 1629–1636 (1990).
Cauwenberghs, G. Reverse engineering the cognitive brain. Proc. Natl. Acad. Sci. 110(39), 15512–15513 (2013).
Ziegler, M., Wenger, Ch., Chicca, E. & Kohlstedt, H. Tutorial: concepts for closely mimicking biological learning with memristive devices: principles to emulate cellular forms of learning. J. Appl. Phys. 124, 152003 (2018).
Jeong, D. S. & Hwang, C. S. Nonvolatile memory materials for neuromorphic intelligent machines. Adv. Mater. 30, 1704729 (2018).
Vahl, A., Carstens, N., Strunskus, T., Faupel, F. & Hassanien, A. Diffusive memristive switching on the nanoscale, from individual nanoparticles towards scalable nanocomposite devices. Sci. Rep. 9(1), 1–10 (2019).
Nikam, R. D. et al. Near ideal synaptic functionalities in Li ion synaptic transistor using Li3POxSex electrolyte with high ionic conductivity. Sci. Rep. 9(1), 1–11 (2019).
Ioannou, P. S. et al. Evidence of biorealistic synaptic behavior in diffusive Li-based two-terminal resistive switching devices. Sci. Rep. 10(1), 1–10 (2020).
Nagata, Z. et al. Gate tuning of synaptic functions based on oxygen vacancy distribution control in four-terminal TiO2−x memristive devices. Sci. Rep. 9(1), 1–7 (2019).
Serb, A. et al. Memristive synapses connect brain and silicon spiking neurons. Sci. Rep. 10(1), 1–7 (2020).
Minnekhanov, A. A. et al. Parylene based memristive devices with multilevel resistive switching for neuromorphic applications. Sci. Rep. 9(1), 1–9 (2019).
Jeong, D. S., Kim, I., Ziegler, M. & Kohlstedt, H. Towards artificial neurons and synapses: a materials point of view. RSC Adv. 3(10), 3169–3183 (2013).
Ahmed, T. et al. Time and rate dependent synaptic learning in neuro-mimicking resistive memories. Sci. Rep. 9(1), 1–11 (2019).
Manicka, S. & Levin, M. Modeling somatic computation with non-neural bioelectric networks. Sci. Rep. 9(1), 1–17 (2019).
Stoliar, P., Yamada, H., Toyosaki, Y. & Sawa, A. Spike-shape dependence of the spike-timing dependent synaptic plasticity in ferroelectric-tunnel-junction synapses. Sci. Rep. 9(1), 1–10 (2019).
Rozenberg, M. J., Schneegans, O. & Stoliar, P. An ultra-compact leaky-integrate-and-fire model for building spiking neural networks. Sci. Rep. 9(1), 1–7 (2019).
del Valle, J., Salev, P., Kalcheim, Y. & Schuller, I. K. A caloritronics-based Mott neuristor. Sci. Rep. 10(1), 1–10 (2020).
Xia, Q. & Yang, J. J. Memristive crossbar arrays for brain-inspired computing. Nat. Mater. 18(4), 309–323 (2019).
Kingra, S. K. et al. SLIM: simultaneous logic-in-memory computing exploiting bilayer analog OxRAM devices. Sci. Rep. 10(1), 1–14 (2020).
Siemon, A. et al. Stateful three-input logic with memristive switches. Sci. Rep. 9(1), 1–13 (2019).
Kathmann, C., Reina, M., Messina, R., Ben-Abdallah, P. & Biehs, S. A. Scalable radiative thermal logic gates based on nanoparticle networks. Sci. Rep. 10(1), 1–11 (2020).
Araujo, F. A. et al. Role of non-linear data processing on speech recognition task in the framework of reservoir computing. Sci. Rep. 10(1), 1–11 (2020).
Chou, J., Bramhavar, S., Ghosh, S. & Herzog, W. Analog coupled oscillator based weighted Ising machine. Sci. Rep. 9(1), 1–10 (2019).
Nandakumar, S. R. et al. Experimental demonstration of supervised learning in spiking neural networks with phase-change memory synapses. Sci. Rep. 10(1), 1–11 (2020).
Sun, S. et al. cLeAR: a holistic figure-of-merit for post-and predicting electronic and photonic-based compute-system evolution. Sci. Rep. 10(1), 1–9 (2020).
Robertson, J. et al. Ultrafast optical integration and pattern classification for neuromorphic photonics based on spiking VCSEL neurons. Sci. Rep. 10(1), 1–8 (2020).
Gupta, S. et al. Low power, CMOS-MoS2 memtransistor based neuromorphic hybrid architecture for wake-up systems. Sci. Rep. 9(1), 1–9 (2019).
Financial support by the Deutsche Forschungsgemeinschaft through FOR 2093 and the Carl Zeiss Foundation through MemWerk is gratefully acknowledged.
The author declares no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Ziegler, M. Novel hardware and concepts for unconventional computing. Sci Rep 10, 11843 (2020). https://doi.org/10.1038/s41598-020-68834-1