Physical neural networks made of analog resistive switching processors are promising platforms for analog computing. State-of-the-art resistive switches rely on either conductive filament formation or phase change. These processes suffer from poor reproducibility or high energy consumption, respectively. Herein, we demonstrate the behavior of an alternative synapse design that relies on a deterministic charge-controlled mechanism, modulated electrochemically in solid-state. The device operates by shuffling the smallest cation, the proton, in a three-terminal configuration. It has a channel of active material, WO3. A solid proton reservoir layer, PdHx, also serves as the gate terminal. A proton conducting solid electrolyte separates the channel and the reservoir. By protonation/deprotonation, we modulate the electronic conductivity of the channel over seven orders of magnitude, obtaining a continuum of resistance states. Proton intercalation increases the electronic conductivity of WO3 by increasing both the carrier density and mobility. This switching mechanism offers low energy dissipation, good reversibility, and high symmetry in programming.
Deep learning based on neural networks has raised tremendous attention as an approach to accelerate machine learning applications, such as computer vision and natural language processing1,2. However, using state-of-the-art GPU/CPU (Graphics Processing Unit/Central Processing Unit) based on CMOS (Complementary Metal–Oxide–Semiconductor) circuits to simulate neural networks requires large memory space and high power consumption3. This is limited by the traditional von-Neuman structure of current computer systems, which requires the transfer of large amount of data between memory and CPU4. New hardware structures and algorithms, such as in-memory computing, have been proposed to tackle these issues5,6,7,8. As demonstrated by Jo et al.9, crossbar-type arrays containing two-terminal resistive switches (or memristors) enable energy-efficient and fast-processing physical neural networks10,11,12. The core component of this physical neural network is the resistive switch, whose electronic conductance can be modulated electrically8,13,14. This modulation emulates the strengthening and weakening of synapses in the brain. Capturing this synaptic strengthening or weakening, so-called potentiation or depotentiation behavior, respectively15, is essential to brain-inspired analog computing, and can accelerate complex computation where precision is less critical2,16,17. Arrays of resistive switching units have also been demonstrated for image recognition, for example, of faces and hand-written digits18,19.
There are two main types of resistive switching mechanisms discussed and used in literature to change the conductance, both of them relying on two-terminal configurations20. The conductive-filament (CF) mechanism is based on the formation of a narrowly confined conducting path (made of metal atoms or oxygen vacancies) inside an insulating matrix, typically an insulating oxide21,22,23,24. The phase-change mechanism (PCM) is realized by changing the material between its conducting and insulating phases, such as the Ge-Sb-Te chalcogenides, controlled by Joule heating25,26. Both resistive switching mechanisms have been demonstrated in artificial intelligence applications, but the CF mechanism suffers from lack of reproducibility, while the PCM suffers from high energy dissipation and drift10,27,28. As a result, the performance of such two-terminal devices in a memory matrix environment is still far from the desired specifications for reliable, fast and energy-efficient training of neural networks29. A fundamentally new working mechanism is desirable for enabling new opportunities to address these challenges.
Recently, three-terminal electrochemical resistive switches demonstrated by Fuller et al. exhibit promising characteristics, in particular multistate capability and low energy consumption30. This concept relies on a configuration similar to a Li-ion solid-state battery. LiCoO2 was employed as the switching media, whose conductivity can be modulated by the extent of Li intercalation. Gated by a Si layer and separated from the LiCoO2 channel by a Li+ conducting solid electrolyte, Li+ was pumped into and out of the LiCoO2 active material reversibly. Electrochemical control of Li+ concentration in LiCoO2 enables a large and continuous modulation of electronic resistance. Tang et al. also demonstrated high speed and low power modulation of WO3 channel conductance by Li+ intercalation using 5 ns pulses31. The major challenge preventing the scale up of this concept is the utilization of Li as the doping ion. Li is not compatible with current CMOS processing due to its high volatility and manufacturing tool contamination concerns.
Being a smaller and faster diffusing cation than Li+, employing protons (H+) as the doping ion presents potential advantages. The Shannon–Prewitt crystal ionic radius of H+ is −0.04 Å, in contrast to 0.90 Å of Li+. The advantages of using protons include lower energy consumption, higher operation speed, better compatibility with Si technology, and longer lifetime due to enhanced structural stability of the active material as a result of volume change with successive ion insertion/extraction steps30,31,32. Electrochemical proton shuffling has been implemented by van de Burgt et al.32 using organic electrode materials, in a three-terminal electrochemical resistive switch configuration. This device demonstrated greater energy efficiency (390 aJ/µm2) and operating speed (order of ms) than its Li counterpart (~37 nJ/µm2, order of seconds)30. Array-level device demonstrations based on this working mechanism have also been reported, for face recognition and hand-written digit recognition18,19. However, the organic nature of the active channel material presents challenges in Si-compatible device fabrication and in long-term stability. While these reports are encouraging, it is desirable to work with a new material system that offers both compatibility with current semiconductor processing protocols and is capable of implementing highly energy efficient analog neural networks. Advancing towards such a technology needs insights from fundamental studies of material atomic and electronic behavior during the resistance modulation process, as well as development of an appropriate gating protocol and device geometry optimization.
In this work, we demonstrate proton intercalation in inorganic materials as a basis for emulating synapse behavior with low energy cost, long retention, and good symmetry. This system offers a deterministic, charged-controlled mechanism that uniformly switches the channel conductance. Thus, it should not pose issues related to lack of reproducibility that heavily depends on the microstructural and chemical heterogeneities in the high-k dielectric materials used in two-terminal CF devices. In addition, if the intercalating ion and the chosen materials are suitable, the energy consumption of the switching process can be very small, as demonstrated in this work. We quantify the protonation-conductance relationship of this artificial electrochemical synapse, providing insights into the proper selection of operating window for the chosen material, WO3. We adopt the constant current gating, and propose that it is more suitable than the constant voltage gating for such three-terminal electrochemical resistive switches because it offers better controllability, reproducibility, and symmetry. X-ray absorption and photoelectron spectroscopy, together with first-principles calculations, reveal that the electronic carrier density and mobility contribute to the conductivity change as a function of protonation in WO3.
Material selection and device configuration
A variety of metal oxides are known to change their electronic conductivity upon cation intercalation, including WO317, MoO333, VO234, and SrCoO235. We chose WO3 as a prototypical proton intercalation host because it is a semiconductor in its undoped state (band gap 2.8~3.2 eV)36. We can precisely tune the conductivity by the degree of proton intercalation in this material due to the accompanied filling of electrons into the conduction band37,38. With a high concentration of protonation, a tungsten bronze phase (HxWO3) is expected to form that turns the material metallic31,39,40. WO3 is also compatible with Si technology41. Protonation of such oxides in the past has been demonstrated from gas-phase H2, through an aqueous electrolyte, by hydrolysis of water adsorbed in a porous solid, or through an ionic liquid electrolyte17,42,43. Reliance on protonation from gas-phase hydrogen or from water is not conducive to controllable, reversible, and technologically feasible devices. Instead, we use a solid, inorganic and reversible hydrogen reservoir, palladium hydride, PdHx, that is integrated into a three-terminal device as the gate electrode.
The three-terminal source-drain-gate configuration of the device in this work is shown in Fig. 1a, b. The source and drain electrodes are two gold metal contacts deposited on SiO2 coated Si gapped by a 100 µm long channel. This channel is filled with a 50 nm thick WO3 film by reactive sputtering as the active material. On top of the channel material, a proton-conductive solid-polymer electrolyte (Nafion-117) is deposited by spin coating, resulting in 300–400 nm thickness. This electrolyte layer is electronically insulating but protonically conductive, with the proton conductivity around 0.09 S/cm at room temperature under 100% relative humidity44. The gate electrode in this device serves the dual role of reservoir of protons and electrons. Metals with high electronic conductivity and high hydrogen solubility are desirable for this purpose45. Palladium metal, which can absorb hydrogen effectively even at room temperature46, was selected as gate in this demonstration. After the deposition of Pd, hydrogen was introduced to form PdHx by exposing the device to 5% forming gas at room temperature prior to and during the test.
The conductance between the source and drain electrodes represents the strength of the synapse in a neural network. In this demonstration, a small constant voltage (Vds = +0.1 V) is applied between the source and drain electrodes. The corresponding current signal (Id) is recorded to calculate the conductance (G = Id/Vds). To modulate the conductance, positive or negative gate current pulses (Ig) are applied to drive protons into or out of the channel material, respectively.
When Ig > 0, PdHx is electrochemically oxidized and releases protons to the Nafion electrolyte. The protons diffuse through the Nafion electrolyte toward the channel oxide, under the driving force of the gating voltage (Vgs) between the gate and channel. Once the protons reach the surface of WO3, they intercalate into the WO3 with the simultaneous electron injection from the outer circuit (Supplementary Fig. 1). This process is fully reversible and can be expressed with the following electrochemical reaction:
where e−(circuit) are electrons that are metered and pumped via the outer circuit. The net effect after this positive gate current Ig biasing is the intercalation of hydrogen (proton + electron) into the WO3 channel material. Electrons and protons must enter/exit the channel material simultaneously to maintain global charge neutrality. When the external circuit is cut off (gate is open circuit), the electronic insulating nature of the electrolyte prevents the back flow of electrons, and consequently that of protons too. This retention of protons and electrons in the channel material is key to realizing the nonvolatile nature of this device.
The proton as a small cation could reside in the interconnected channels of the WO3 lattice and bond with the oxygen ion to form OHO defect in these channel sites (Fig. 1c). There is a main difference here with respect to the conductive filament (CF) or phase change mechanism (PCM) approach. That is, the intercalation of the protons involves a high degree of spatial homogeneity within the channel material. This means that the active material (HxWO3) can stay single-phase during the intercalation due to the high equilibrium solubility limit of H in the solid solution phase.
As discussed above, and unlike the previous protonation of oxides which rely on the electrolysis of water to generate the protons47, our device is a closed system with proton shuffling between the solid-state gate and the channel material. This not only reduces the energy consumption by avoiding the water hydrolysis reaction, but also improves the controllability. In a practical device, this electrochemical synapse should be encapsulated by insulating layers that are also proton barriers in order to prevent the long-term loss of protons or ingress of oxygen into the system, essential for device endurance. (See Supplementary Figs. 6 and 14 for demonstration of the encapsulated device).
The full range of the conductivity dependence on the hydrogen concentration in WO3 (HxWO3) that is measured in our device is shown in Fig. 2a. A potentiation pulse train was applied to the device with constant current (0.5 μA) and fixed width (5 ms) for each pulse. Between two pulses, the gating circuit was at open circuit for 1 s, during which both the channel conductance (G) and the open circuit potential (OCP, between the gate and channel) were measured. With this process, we increased the H content (x) from nominally 0 as in WO3 (W6+) to the theoretical maximum of 1 as in HWO3 (W5+). The H content (x) was estimated from the net charge transferred by the gate, which was evaluated by integrating the gate current over the pulse time and assuming 100% Coulombic efficiency. As demonstrated in Fig. 2a, over seven orders of magnitude change in conductivity was achieved across the full protonation range.
The slope of conductivity vs. x is not a constant across the full range. When the conductivity is plotted in log scale, as done in Fig. 2a, there are clear changes in the slope at x = 0.03, 0.15, and 0.5. We ascribe these to the boundaries between three different regimes of protonation, that correspond to a low conductance regime, a medium conductance regime, and a high conductance regime. These are designated as Low G, Mid G and High G, respectively, on Fig. 2a. The dependence of the conductance slope on the hydrogen concentration implies different conduction mechanisms. This can arise from factors such as defect–defect interactions as the proton concentration increases, or crystal structure change. The slope of the OCP also changes as a function of protonation regime, as seen in Fig. 2a. This implies the involvement of phase change as transitioning from one regime to another (Supplementary Discussion 3 in Supplementary Information).
The electrical response of the device, including the ratio of the maximum to minimum conductance achieved (Gmax/Gmin) and the symmetry of potentiation–depression, depend on the degree of protonation in WO3, or the corresponding conductivity regime, as shown in more detail in Fig. 2b–d. The low hydrogen content (low conductance, Fig. 2b) regime offers better symmetry and higher Gmax/Gmin ratio. The high hydrogen content (high conductance) regime features larger changes in the absolute conductivity per pulse (per the same amount of change in the H quantity) at the cost of poor symmetry. These results guide the choice of an operating window for the device that depends on the performance matrix that is most desirable.
To demonstrate reversibility, constant current pulse trains containing different polarity but the same amplitude (0.5 µA) and width (5 ms) were applied between the gate and the channel. When the protonation of WO3 is confined to the low conductance regime shown in Fig. 2b, after 100 positive gating pulses, the conductance of the channel increased from 1 μS to 22 μS, demonstrating a continuum of 100 states and a Gmax/Gmin ratio of more than 22 (black trace). Upon the application of an identical but negative current pulse train, the conductance decreased to the original low state, accomplishing the depression process. The number of states achieved during this process can be tuned with different number of pulses, and with the pulse height–width that control the degree of protonation in each operation. The states need to be distinguishable from each other by the electronic resistance measurement apparatus. Based on the current device and experimental set up, we have demonstrated 1000 states, with an average ΔG/G of 0.3% per pulse and an overall Gmax/Gmin of 30, as shown in Fig. 1d. These values are in line with the desirable specifications of resistive processing units as assessed by Gokmen et al.29, and can be further improved with optimization of device geometry and electronic measurement sensitivity. The Gmax/Gmin ratio also depends on the pulse number, being 2, 4, 8, and 22, for the 10 (Green), 20 (Red), 50 (Blue) and 100 (Black) pulses, respectively, in the low-G regime as shown in Fig. 2b.
An identical procedure in the medium and high conductance regimes (higher H content) gives smaller Gmax/Gmin ratios, as shown in Fig. 2c, d, respectively. Taking the switching behavior of 100 pulses as an example, the three regimes denoted as Low G, Mid G, and High G result in distinctly different Gmax/Gmin ratio of 22, 8, and 4, respectively. In addition, a less symmetrical shape was observed in the higher conductance regime. Comparing the 10, 20, 50, and 100 pulse behavior in either protonation regime, a shallower protonation/deprotonation in WO3 allows better reversibility (the potentiation/depression symmetry). But this comes at the expense of a smaller conductance Gmax/Gmin ratio. When compared with the symmetry behavior in prior demonstrations of the two-terminal conductive filament resistive switches9,48, a significant improvement of symmetry is observed here.
There is still a small extent of hysteresis in our potentiation–depression data. This originates from the long time scale of the equilibration of the protonated state due to proton diffusion from the Nafion-WO3 interface to the bulk of WO3 layer (and vice versa). With the same sampling period applied to all measurements, we had to acquire the non-equilibrated states at higher H content regimes which took longer time to equilibrate. Reducing the channel layer thickness (smaller diffusion length) and reducing the pulse width and height (smaller amount of H exchange per pulse) will help to accelerate the kinetics of relaxation and improve the symmetry further. As seen in Fig. 1d, when the pulse amplitude is 200 nA, the inserted hydrogen amount during each pulse is less, and the equilibration is faster, thus giving a more symmetric potentiation/depression behavior even with 1000 pulses, compared with the behavior in Fig. 2 obtained by 0.5 μA pulse amplitude.
The average voltage resulting from the gating pulses is shown in Fig. 3a. With the pulse current of ±0.5 μA, the resulting gate voltage in each potentiation step, Vgs is smaller than ±0.5 V. The energy consumption per unit change in conductance, ΔG, during the gating process can be estimated by the integration of the charge vs. voltage. With the average gating voltage of 0.25 V resulting from current pulses of 0.5 μA and 5 ms, an average ΔG of 48 nS, and an area of 0.6 × 1.2 mm2, the average energy cost per unit area per unit conductance change is only 18 aJ/(μm2 × nS). This value is significantly smaller than the energy consumption of the conductive filament or phase change mechanisms, and similar to that of state-of-the-art protonic organic devices recorded in the literature32.
The low operating voltage of <0.5 V also proves that wo do not rely on the water electrolysis to supply the protons. To electrolyze water, a minimum of 1.23 V is necessary to meet the thermodynamic requirement and an additional 0.5–0.7 V is needed to break the kinetic overpotential49, even on the best electrocatalysts. So, we can confidently rule out the possibility of water electrolysis here.
Two features of this protonic electrochemical synapse discussed here enable this low operating energy. First, the cation employed here to modulate the conductivity is the smallest and lightest cation, the proton, needing low energy to migrate and transfer at interfaces. Second, the electrochemical potentials of the gate and channel materials are close, resulting in a small open-circuit potential, as shown in Fig. 2a. This means that the device is operated only within a small voltage window. The first feature minimizes the kinetic contribution to the energy consumption, while the second one minimizes the thermodynamic contribution. In addition, the small but non-zero open-circuit potential change after gating indicates that a selector component may be needed to program individual synapses in an array, as demonstrated in ref. 19, and to avoid cross-talk of individual synapses when not gating.
To demonstrate the endurance of the device, a repeated potentiation and depression cycling test was performed and shown in Fig. 3b. Each cycle contains 100 potentiation and 100 depression pulses. This process was repeated 100 times. The Gmax/Gmin ratio remained consistent around 3 across the 100 cycles, demonstrating a device endurance >20,000 pulses. Additional endurance tests at different conductivity regimes, number of states, and encapsulation of the device are provided in Supplementary Figs. 3–6. Potential failure mode of this type of device are the ingression of oxygen, out diffusion of hydrogen, <100% Faradic efficiency, and electrode degradation. Each of these modes of failure can be overcome by proper encapsulation, that warrants future work. (See Supplementary Discussion 2).
Resistance modulation mechanism
To probe how protonation changes the electronic structure of WO3, we investigated its valence band structure by X-ray photoelectron spectroscopy (XPS). Before proton intercalation, the valence band of pristine WO3 features a broad peak located around 7 eV below the Fermi level (Fig. 4a)37. The extrapolation of the upper edge of this band leads to a valence band maximum located ~2.5 eV below the Fermi level (binding energy = 0 eV) and the photoelectron emission is nearly zero at the Fermi level. This measurement confirms the semi-conductive nature of unprotonated WO3, with the Fermi level positioned within the band gap. After proton intercalation (~H0.08WO3, see details in Supplementary Figs 7–8 for sample configuration used in X-ray spectroscopy experiments), a new prominent peak appears at nearly 0.5 eV below the Fermi level, indicating the filling of electrons in W 5d(t2g). The photoelectron emission is also non-zero at the Fermi level. These two observations indicate the filling of electrons into the previously empty conduction band and transition to a metallic conduction mechanism4.
The oxidation state of W was probed by the W 4f photoelectron peaks in Fig. 4b. For the unprotonated WO3, the binding energy of the of W 4f7/2 and W 4f5/2 peaks are located at 35.9 eV and 38.0 eV, respectively. This spectrum is consistent with W6+ 50. After protonation, a new W 4f7/2 component at 33.8 eV was identified. This lower binding energy corresponds to the reduced W oxidation state of 5+ 51. Deconvolution of the peaks reveals the ratio between W5+ and W6+ to be 1:11.4, corresponding to H0.08WO3.
From the analysis of the valence band and the W 4f photoelectron peak, we can conclude that, upon intercalation of protons, new in-gap states form, gradually lowering the effective bandgap of WO3 to 0. This process is accompanied by the injection of electrons, which pushes the Fermi level toward the conduction band. When the quantity of injected electrons is significant enough, the Fermi level completely shifts into the conduction band. Consistent with electron injection and n-type doping, the oxidation state of W is reduced. As a result, we expect a continuous increase of electronic conductivity with increasing protonation level in HxWO3, as shown in Fig. 2a.
In addition to the increase in carrier density, the protonation of WO3 could result in an increase in the mobility of the electronic charge carriers, that may arise from the increase in hybridization of W–O bonds. In operando X-ray absorption spectroscopy of the O K-edge region measured during the protonation of WO3 provides strong evidence for this effect. The O K-edge spectra of WO3 prior to and after protonation is shown in Fig. 4c (see sample configuration in Supplementary Fig. 7). A prominent absorption peak denoted as A/B at the photon energy of c.a. 530 eV corresponds to electron excitation from core level O 1 s to the empty states in O 2p, which is created by W 5d(t2g)-O 2p hybridization52,53. The intensity of this peak is positively correlated with the hybridization level (covalency) of the W–O bonds54. After protonation (Trace 2, blue), the A/B peak intensity increases compared with the state prior to protonation (Trace 1, black). This indicates a higher level of hybridization after protonation. Because this hybridization is featured by electron donation from the O 2p orbital in the valence band to the W 5d(t2g) orbital in the conduction band, the increased hybridization results in a larger extent of electron delocalization55, which is usually accompanied by higher electron mobility56. In addition, the peaks at c.a. 535–537 eV (C/D) reflect the hybridization of the W 5d(eg)-O 2p states, and these peaks are sensitive to the O 2p-H 1 s interaction52. The increase of intensity in C/D peaks after protonation is a direct evidence of proton intercalation into WO3. The observed changes in the O K-edge are reversible upon cycling between protonation and deprotonation. The peak intensities of the A/B and C/D regions decrease with deprotonation (Trace 3, red), and increase again with a subsequent protonation (Trace 4, orange) (Supplementary Fig. 8 for details). This modulation of the degree of W 5d(t2g)-O 2p hybridization changes the extent of electron delocalization, and thus, the electron mobility.
First-principles calculations of electronic structure also give evidence to the increase of charge carrier density and mobility upon increased protonation in WO338. The evolution of the electronic structure in monoclinic HxWO3 upon hydrogenation (x = 0–0.125) is shown in Fig. 5. The calculated direct band gap of pure monoclinic WO3 is 2.82 eV, in good agreement with the available experimental data36 and Supplementary Fig. 9. As it is seen from Fig. 5b, the conduction band of monoclinic WO3 is mainly composed of unoccupied W 5d orbitals, while O 2p orbitals dominate in the valence band region.
Insertion of protons at the channel sites as shown in Fig. 1c, followed by subsequent charge balancing leads to the formation of in-gap states (Fig. 5d), at 0.28 eV below the conduction band for x = 0.0156. At low hydrogen concentrations, the excess electrons are localized over several adjacent W atoms located in the same plane forming a large 2D polaron with a radius of ≥15 Å, as shown in Fig. 5c.
With increasing protonation, the localized in-gap states monotonically approach the conduction band minima, decreasing the ionization energy from 0.28 eV at x = 0.0156 to 0.08 eV at x = 0.0625. Further protonation up to x = 0.125 leads to a metallic behavior of H0.125WO3, as shown in Fig. 5e, f. The computed changes in electronic structure correlate well with the decreased oxidation state of W and the disappearance of the band gap at x = 0.08 probed by XPS shown in Fig. 4a–c.
At higher protonation levels (x > 0.1), the distortion of the lattice may actually change the crystal structure57, and thus, its band structure. To study this, we performed in operando X-ray diffraction to study the structure evolution. Prior to protonation, WO3 exhibits the most stable monoclinic structure57, as shown by the red pattern denoted as WO3 in Fig. 4d, with three major diffraction peaks at 23.1°, 23.6°, and 24.3°. They correspond to the (002), (020), and (200) planes (JCPDS 83-0950). During continuous biasing with Ig = +1 µA, the (002) and (200) peaks of WO3 shifted toward lower angles after 10 min (x = 0.05). After 54 min of biasing (x = 0.26 by assuming 100% Coulombic efficiency, see Supplementary Table 1), these two peaks eventually shift to 22.9° and 24.1°, corresponding to +1.29% and 0.95% lattice expansion, respectively. These two peaks can be related to the (001) and (110) planes of the tetragonal H0.23WO3 (JCPDS 85-0967, Supplementary Fig. 8 for higher angle XRD data). The original (020) peak of monoclinic WO3 at 23.6° disappeared during the process because of increased symmetry. The total unit cell volume expanded only a very small amount, +0.28% for 0.23 H per unit WO3. For comparison, the c-axis change from Li0CoO2 to Li0.25CoO2 is nearly 9.3%58. The reduction of lattice stress further highlights the advantage of H+ over Li+ in terms of structural stability59.
As a result of this in situ XRD analysis, we can conclude that, with the insertion of protons into the channel sites, the WO6 octahedra become more ordered and the crystal structure becomes more symmetrical, as seen from the monoclinic to tetragonal transition in Fig. 4d. The increased symmetry can arise from increased concentration of electronic charge in WO3, namely W5+/W6+ polarons. We have also found that the interaxial angles approach 90° upon proton insertion in WO3 (see Supplementary Fig. 11 in Supplementary Information.) The increased symmetry of the structure can also contribute to a change of the band structure60 and eventually the conductive behavior39,57.
Gating strategy of electrochemical synapses
Gating through the application of a voltage is widely adopted in the literature to induce resistive switching (also demonstrated in Supplementary Fig. 12 on our device)61. Typical reported gating voltage values range from several volts to tens of volts. Very often, the gating voltage is used as a descriptor to indicate the final state of the sample49,62. Here we emphasize that, in such an electrochemical synapse (or ionic gating) devices, there can be a significant difference between the gating voltage applied and the change in the open-circuit potential of the device due to polarization. That is, the equilibrium chemical potential of the active material does not necessarily follow the applied gating voltage precisely63. Such difference could be a major reason for the lack of consistency of the gating voltages reported in the literature17,40,49,64.
There are two major points to consider. First, the voltage applied during the ionic gating is spent on several contributions; the chemical potential difference between the gate and the channel electrodes, ionic ohmic loss across the electrolyte, and the Nernst overpotential to drive the electron-ion exchange at the electrode–electrolyte interface. The steady-state chemical potential of the active material achieved after the constant voltage gating represents only the first part, and the latter two are the kinetic loss terms.
Second, even if the correlation between the gating voltage and the chemical potential at the electrode–electrolyte interface can be properly established, the time needed to reach equilibrium within the bulk of the channel material is non-negligible. This is due to the finite diffusion time of ions in solids (Supplementary Fig. 13).
Based on these considerations, we propose two directions to evade the issue related to voltage gating. First, as adopted in this paper, constant current gating, rather than constant voltage gating, should provide a deterministic switching behavior, by using the accumulated charge as the descriptor for the status of the channel. Second, employing cations with high diffusivity, such as the proton, and reducing the thickness of the channel layer, should minimize the diffusion time and the resulting time-dependent relaxation of the channel conductance.
In summary, we have designed and demonstrated a protonic electrochemical synapse as an all-solid-state device, with very low energy consumption (18 aJ/(μm2 × nS)), nearly symmetrical potentiation (protonation)/depotentiation (deprotonation) behavior, long cycling lifetime, and featuring small changes in OCP. The core material system comprising WO3 as the channel and PdHx as the gate electrode (solid proton reservoir), were chosen in order to be CMOS compatible. In the complete range from 0 to 1 H per WO3, we achieved continuous modulation of the conductance and a high Gmax/Gmin ratio of 107. The lower protonation regime features higher potentiation/depotentiation symmetry. The higher protonation regime features small OCP change and large ΔG per unit amount of proton insertion. This understanding provides guidance for selection of an operating window to achieve desired device properties. In addition, we confirmed the topotactic nature of the conductivity modulation of our device through electronic and atomic structure analysis, with the observed volume change much smaller than Li-intercalation compounds, thus promising smaller residual stress and longer cycle life. The inorganic protonic electrochemical synapse demonstrated here, and the understanding generated from this study, provide a path to low-energy and reliable artificial synapses as hardware for artificial neural networks that are capable of accelerating artificial intelligence development.
The device adopted a three-terminal thin-film transistor configuration. The source and drain electrodes composed of 40 nm thick Au was deposited by RF sputtering. A channel with a width of 500 µm and length of 100 µm between the source and drain electrodes was patterned by shadow mask. This channel was further filled by 50 nm thick WO3, which was deposited by reactive RF sputtering from W metal target with the Ar:O2 ratio of 9.3:2.7 at 3 mtorr. The deposited film was further annealed at 450 °C for 1 h in air to achieve crystalized monoclinic WO3 phase. Spin coating was employed to apply Nafion-117 resin solution (Sigma-Aldrich) on top of WO3 as solid proton conductor layer. The thickness of the proton electrolyte layer can be adjusted by the spin speed and concentration to achieve 300–400 nm in thickness. After drying the Nafion layer in ambient air followed by 100 °C baking, the device was transferred back to the sputtering chamber for Pd top gate electrode deposition patterned by shadow mask.
The as-fabricated device was transferred into a moisturized chamber filled with 5% hydrogen in argon atmosphere and nearly 100% relative humidity at room temperature. The hydrogen absorption by Pd can be observed by continuous open circuit measurement of WO3 (channel) vs. Pd (Gate), which changes from negative to positive, due to the electrochemical potential change when Pd is converted into PdHx. The electrical test was performed inside the chamber without exposing to the ambient air. A constant voltage of +100 mV was applied between the source and drain, the corresponding current (Id) was recorded by Keithley 2460 to calculate the conductance level. A constant current pulse train with ±0.5 µA amplitude, 5 ms width and 1 s interval were applied by Gamry reference 3000 potentiostat or Keithley 2400 source meter to the gate to induce the potentiation and depression characteristic behavior of resistive switching. The gate voltage was recorded every 1 ms during the pulse to calculate the energy consumption per pulse. Between pulses, the gate electrode was set at open circuit condition (high impedance mode) for OCP measurement for 1 s.
X-ray diffraction pattern was collected on Rigaku Smartlab diffractometer (Cu Kα λ = 1.5406 Å) in situ. A device with the same configuration as described above but with larger size (WO3 pad: 8.3 mm × 5 mm × 100 nm) was prepared for this test to ensure the intensity of diffraction signal to be strong enough. The device was encapsulated in a sample holder with X-ray transparent windows made by Mylar film. The chamber was filled with 5% H2 in Argon and the electric bias was applied by Keithley 2460.
The ambient pressure soft XAS data was collected at the 23-ID-2 (IOS) beamline at the National Synchrotron Light Source II (NSLS-II) at Brookhaven National Laboratory. Partial fluorescence yield signal, measured using a Vortex EM silicon drift detector, was chosen as the signal to be collected due to its relatively large probing depth (~100 nm). With this probing depth, we consider the data collected to be sensitive to the bulk of film, given that our film is typically 50 nm thick. Detection area was carefully chosen at the edge of the WO3-Au interface (See Supplementary Fig. 7). The device was first transferred into the in operando ambient pressure XAS chamber, after which 5 mTorr H2O and 400 mTorr H2 was introduced into the chamber. A reference spectrum was collected without external bias, and denoted as WO3 in Fig. 4c. A continuous negative current was further applied on the WO3 through the Au contact. It is expected that hydrogen will split into hydrogen atom on the Pd side, which can be electrochemically pumped into WO3 through the electrolyte, even under such low hydrogen partial pressure.
The XPS measurement and valence band measurement were collected by PHI Versaprobe II spectrometer with Al Kα source. XPS measurement was taken ex situ for the same sample after XAS measurement at the protonated state.
The cross-sectional samples were prepared by FEI Helios Nanolab 600 focused ion beam system and imaged in the same instrument by electron beam.
Density functional theory calculations
First-principles calculations were performed within the density functional theory formalism using the projector augmented wave potentials65 as implemented in the Vienna Ab initio Simulation Package 66. The screened Heyd-Scuseria-Ernzerhof hybrid functional for solids67 was employed to accurately describe many-electron interactions, charge localization, and lattice parameters The calculation were performed for monoclinic WO3 (space group P21/n) supercell of 14.70 Å × 15.01 Å × 15.41 Å (β = 90.17°) with multiple H atoms to simulate the concentration range of x = 0–0.125. A mesh of 4 × 4 × 4 k-points and a 500 eV cut-off energy were employed for supercell calculations.
The data that support the findings of this study are available from the corresponding authors upon request.
Essera, S. K. et al. Convolutional networks for fast energy-efficient neuromorphic computing. Proc. Natl Acad. Sci. U. S. A. 113, 11441–11446 (2016).
Tang, J. et al. Bridging biological and artificial neural networks with emerging neuromorphic devices: fundamentals, progress, and challenges. Adv. Mater. 31, 1902761 (2019).
Suleiman, A., Chen, Y., Emer, J. & Sze, V. in 2017 IEEE International Symposium on Circuits and Systems (ISCAS). 1–4 (IEEE, 2017).
Sebastian, A. et al. Temporal correlation detection using computational phase-change memory. Nat. Commun. 8, 1115 (2017).
Wong, H. S. P. & Salahuddin, S. Memory leads the way to better computing. Nat. Nanotech. 10, 191–194 (2015).
Ambrogio, S. et al. Equivalent-accuracy accelerated neural-network training using analogue memory. Nature 558, 60–67 (2018).
Burr, G. W. et al. Neuromorphic computing using non-volatile memory. Adv. Phys. 2, 89–124 (2017).
Ielmini, D. & Wong, H. S. P. In-memory computing with resistive switching devices. Nat. Electron. 1, 333–343 (2018).
Jo, S. H. et al. Nanoscale memristor device as synapse in neuromorphic systems. Nano Lett. 10, 1297–1301 (2010).
Yang, J. J. S., Strukov, D. B. & Stewart, D. R. Memristive devices for computing. Nat. Nanotech 8, 13–24 (2013).
Sheridan, P. M. et al. Sparse coding with memristor networks. Nat. Nanotech. 12, 784–789 (2017).
Wang, Z. et al. Capacitive neural network with neuro-transistors. Nat. Commun. 9, 3208 (2018).
Strukov, D. B., Snider, G. S., Stewart, D. R. & Williams, R. S. The missing memristor found. Nature 453, 80–83 (2008).
Linn, E., Rosezin, R., Kügeler, C. & Waser, R. Complementary resistive switches for passive nanocrossbar memories. Nat. Mater. 9, 403–406 (2010).
Ohno, T. et al. Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. Nat. Mater. 10, 591–595 (2011).
Haensch, W., Gokmen, T. & Puri, R. The next generation of deep learning hardware: analog computing. P. IEEE 107, 108–122 (2019).
Yang, J.-T. et al. Artificial synapses emulated by an electrolyte-gated tungsten-oxide transistor. Adv. Mater. 30, 1801548 (2018).
Liu, Q. et al. Fully printed all-solid-state organic flexible artificial synapse for neuromorphic computing. ACS Appl. Mater. Interfaces 11, 16749–16757 (2019).
Fuller, E. J. et al. Parallel programming of an ionic floating-gate memory array for scalable neuromorphic computing. Science 364, 570–574 (2019).
Wouters, D. J., Waser, R. & Wuttig, M. Phase-change and redox-based resistive switching memories. P. IEEE 103, 1274–1288 (2015).
Waser, R. & Aono, M. Nanoionics-based resistive switching memories. Nat. Mater. 6, 833–840 (2007).
Du, H. C. et al. Nanosized conducting filaments formed by atomic-scale defects in redox-based resistive switching memories. Chem. Mater. 29, 3164–3173 (2017).
Lanza, M. et al. Recommended methods to study resistive switching devices. Adv. Electron. Mater. 5, 1800143 (2019).
Wang, Z. et al. Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. Nat. Mater. 16, 101–108 (2017).
Zhang, W., Mazzarello, R., Wuttig, M. & Ma, E. Designing crystallization in phase-change materials for universal memory and neuro-inspired computing. Nat. Rev. Mater. 4, 150–168 (2019).
Kuzum, D., Jeyasingh, R. G., Lee, B. & Wong, H.-S. P. Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. Nano Lett. 12, 2179–2186 (2011).
Ielmini, D. Resistive switching memories based on metal oxides: mechanisms, reliability and scaling. Semicond. Sci. Technol. 31, 063002 (2016).
Waser, R., Dittmann, R., Staikov, G. & Szot, K. Redox-based resistive switching memories - nanoionic mechanisms, prospects, and challenges. Adv. Mater. 21, 2632–2663 (2009).
Gokmen, T. & Vlasov, Y. Acceleration of deep neural network training with resistive cross-point devices: design considerations. Front. Neurosci. 10, 333 (2016).
Fuller, E. J. et al. Li-Ion synaptic transistor for low power analog computing. Adv. Mater. 29, 1604310 (2017).
Tang, J. et al. in 2018 IEEE International Electron Devices Meeting (IEDM). 13.11.11–13.11.14 (IEEE, 2018).
van de Burgt, Y. et al. A non-volatile organic electrochemical device as a low-voltage artificial synapse for neuromorphic computing. Nat. Mater. 16, 414–418 (2017).
Julien, C. & Nazri, G. A. Transport properties of lithium-intercalated MoO3. Solid State Ion. 68, 111–116 (1994).
Yoon, H. et al. Reversible phase modulation and hydrogen storage in multivalent VO2 epitaxial thin films. Nat. Mater. 15, 1113–1119 (2016).
Lu, N. et al. Electric-field control of tri-state phase transformation with a selective dual-ion switch. Nature 546, 124–128 (2017).
Vemuri, R. S., Engelhard, M. H. & Ramana, C. V. Correlation between Surface Chemistry, Density, and Band Gap in Nanocrystalline WO3 Thin Films. ACS Appl. Mater. Interfaces 4, 1371–1377 (2012).
Niklasson, G. A. & Granqvist, C. G. Electrochromics for smart windows: thin films of tungsten oxide and nickel oxide, and devices based on these. J. Mater. Chem. 17, 127–156 (2007).
Hjelm, A., Granqvist, C. G. & Wills, J. M. Electronic structure and optical properties of WO3, LiWO3, NaWO3, and HWO3. Phys. Rev. B 54, 2436–2445 (1996).
Kamal, H., Akl, A. A. & Abdel-Hady, K. Influence of proton insertion on the conductivity, structural and optical properties of amorphous and crystalline electrochromic WO3 films. Phys. B 349, 192–205 (2004).
Leng, X. et al. Insulator to metal transition in WO3 induced by electrolyte gating. npj Quantum Mater. 2, 35 (2017).
Cai, F. et al. A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations. Nat. Electron. 2, 290–299 (2019).
Nishihaya, S. et al. Evolution of insulator–metal phase transitions in epitaxial tungsten oxide films during electrolyte-gating. ACS Appl. Mater. Interfaces 8, 22330–22336 (2016).
Altendorf, S. G. et al. Facet-independent electric-field-induced volume metallization of tungsten trioxide films. Adv. Mater. 28, 5284–5292 (2016).
Sone, Y., Ekdunge, P. & Simonsson, D. Proton Conductivity of Nafion 117 as Measured by a Four‐Electrode AC Impedance Method. J. Electrochem. Soc. 143, 1254–1259 (1996).
Rusman, N. A. A. & Dahari, M. A review on the current progress of metal hydrides material for solid-state hydrogen storage applications. Int. J. Hydrog. Energy 41, 12108–12126 (2016).
Li, Y. & Cheng, Y.-T. Hydrogen diffusion and solubility in palladium thin films. Int. J. Hydrog. Energy 21, 281–291 (1996).
Zhu, L. Q., Wan, C. J., Guo, L. Q., Shi, Y. & Wan, Q. Artificial synapse network on inorganic proton conductor for neuromorphic systems. Nat. Commun. 5, 3158 (2014).
Jiang, H. et al. Sub-10 nm Ta channel responsible for superior performance of a HfO2 memristor. Sci. Rep. 6, 28525 (2016).
Katase, T., Onozato, T., Hirono, M., Mizuno, T. & Ohta, H. A transparent electrochromic metal-insulator switching device with three-terminal transistor geometry. Sci. Rep. 6, 25819 (2016).
Katrib, A., Hemming, F., Wehrer, P., Hilaire, L. & Maire, G. The multi-surface structure and catalytic properties of partially reduced WO3, WO2 and WC + O2 or W + O2 as characterized by XPS. J. Electron Spectrosc. Relat. Phenom. 76, 195–200 (1995).
ViolBarbosa, C. et al. Transparent conducting oxide induced by liquid electrolyte gating. Proc. Natl Acad. Sci. U. S. A. 113, 11148–11151 (2016).
Purans, J., Kuzmin, A., Parent, P. & Laffon, C. Study of the electronic structure of rhenium and tungsten oxides on the O K-edge. Phys. B 259–261, 1157–1158 (1999).
Purans, J., Kuzmin, A., Parent, P. & Laffon, C. X-ray absorption study of the electronic structure of tungsten and molybdenum oxides on the O K-edge. Electrochim. Acta 46, 1973–1976 (2001).
de Groot, F. M. F. et al. Oxygen 1s x-ray-absorption edges of transition-metal oxides. Phys. Rev. B 40, 5715–5723 (1989).
Zimmermann, R. et al. Electronic structure of 3d-transition-metal oxides: on-site Coulomb repulsion versus covalency. J. Phys.: Condens. Matter 11, 1657–1682 (1999).
Aubrey, M. L. et al. Electron delocalization and charge mobility as a function of reduction in a metal–organic framework. Nat. Mater. 17, 625–632 (2018).
Cazzanelli, E., Vinegoni, C., Mariotto, G., Kuzmin, A. & Purans, J. Raman study of the phase transitions sequence in pure WO3 at high temperature and in HxWO3 with variable hydrogen content. Solid State Ion. 123, 67–74 (1999).
Li, G., Zhou, S., Wang, P. & Zhao, J. Halogen-doping in LiCoO2 cathode materials for Li-ion batteries: insights from ab initio calculations. RSC Adv. 5, 107326–107332 (2015).
Lubomirsky, I. Stress adaptation in ceramic thin films. Phys. Chem. Chem. Phys. 9, 3701–3710 (2007).
Wang, W., Janotti, A. & Walle, C. G. Vd Phase transformations upon doping in WO3. J. Chem. Phys. 146, 214504 (2017).
Sawa, A. Resistive switching in transition metal oxides. Mater. Today 11, 28–36 (2008).
Shibuya, K. & Sawa, A. Modulation of Metal–Insulator Transition in VO2 by Electrolyte Gating-Induced Protonation. Adv. Electron. Mater. 2, 1500131 (2016).
Valov, I. et al. Nanobatteries in redox-based resistive switches require extension of memristor theory. Nat. Commun. 4, 1771 (2013).
Grey, P. et al. Solid state electrochemical WO3 transistors with high current modulation. Adv. Electron. Mater. 2, 1500414 (2016).
Kresse, G. & Joubert, D. From ultrasoft pseudopotentials to the projector augmented-wave method. Phys. Rev. B 59, 1758–1775 (1999).
Kresse, G. & Furthmüller, J. Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set. Phys. Rev. B 54, 11169–11186 (1996).
Schimka, L., Harl, J. & Kresse, G. Improved hybrid functional for solids: the HSEsol functional. J. Chem. Phys. 134, 024116 (2011).
This work was supported by the MIT Skoltech Program, by the MIT Quest for Intelligence, and by the MRSEC Program of the National Science Foundation under award number DMR - 1419807. The device fabrication was carried out through the use of MIT’s Microsystems Technology Laboratories and MIT.nano. This work made use of the Shared Experimental Facilities supported in part by the MRSEC Program of the National Science Foundation under award number DMR - 1419807. This research used resources of the 23-ID-2 (IOS) beamline of the National Synchrotron Light Source II, a U.S. Department of Energy (DOE) Office of Science User Facility operated for the DOE Office of Science by Brookhaven National Laboratory under Contract No. DE-SC0012704. We acknowledge the Extreme Science and Engineering Discovery Environment (XSEDE) computational resources provided through allocation TG-DMR190038. We thank Dr. John Rozen, IBM, for technical mentorship and support on this research. We thank Jiayue Wang and Younggyu Kim for help with the XAS experiments, and Yanhao Dong for the discussion on gating approach.
The authors declare no competing interests.
Peer review information Nature Communications thanks the anonymous reviewers for their contribution to the peer review of this work. Peer reviewer reports are available.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Yao, X., Klyukin, K., Lu, W. et al. Protonic solid-state electrochemical synapse for physical neural networks. Nat Commun 11, 3134 (2020). https://doi.org/10.1038/s41467-020-16866-6
This article is cited by
Nature Communications (2023)
Nature Electronics (2023)
Nature Electronics (2022)
Science China Materials (2022)
Nature Reviews Materials (2021)