Abstract
Reservoir computing is a brain heuristic computing paradigm that can complete training at a high speed. The learning performance of a reservoir computing system relies on its nonlinearity and short-term memory ability. As physical implementation, spintronic reservoir computing has attracted considerable attention because of its low power consumption and small size. However, few studies have focused on developing the short-term memory ability of the material itself in spintronics reservoir computing. Among various magnetic materials, spin glass is known to exhibit slow magnetic relaxation that has the potential to offer the short-term memory capability. In this research, we have quantitatively investigated the short-term memory capability of spin cluster glass based on the prevalent benchmark. The results reveal that the magnetization relaxation of Co, Si-substituted Lu3Fe5O12 with spin glass behavior can provide higher short-term memory capacity than ferrimagnetic material without substitution. Therefore, materials with spin glass behavior can be considered as potential candidates for constructing next-generation spintronic reservoir computing with better performance.
Introduction
With the society transitioning into the high-speed informatization era, artificial intelligence technology has become crucial as an efficient method of data processing. However, the separation of memory and computation of traditional computers restricts the embedded interaction between artificial intelligence systems and modern devices and significantly increases the power consumption of computing1. In recent years, to overcome this bottleneck, researchers have developed neuromorphic devices with high integration and low power consumption by simulating the function of neurons and synapses2,3,4,5. Among the existing neuromorphic devices, a framework called reservoir computing has been favored by researchers6,7,8. The basic principle is based on mapping data to a high-dimensional space using large reservoir units and learning its characteristics9. For hardware devices, a large number of reservoir units in the reservoir computing software can be easily simulated by time multiplexing a single unit10. In the training process, only the output layer data must be trained using simple linear regression11. In essence, a reservoir computing system is mainly required to have two characteristics: short-term memory ability and nonlinearity12. Short-term memory refers to a small amount of external input information that remains a transient active state in the memory system for a short time 13. The short-term memory ability can cause the historical information entering the reservoir to gradually decay and disappear with time. As another key characteristic, nonlinearity can be easily realized in various physical devices. Therefore, reservoir computing is simple in terms of training, fast convergence, and easy physical implementation.
So far, physical reservoir computing has been developed based on various systems14,15,16, including electronic systems17,18, mechanical systems19,20, optical systems21,22, spintronics devices23,24. Among them, magnetic-tunnel-junction based spintronic devices are considered to be a promising choice for physical reservoir computing, owing to their non-volatility, read/write endurance, high-speed operation, low power consumption and low size25,26,27,28. Besides, spin wave29,30, skyrmion31, antiferromagnetic systems32 are also used for constructing spintronics reservoir computing systems with different physical principles. Nontheless, whether it is based on magnetic tunnel junction or other spintronics systems, the present spintronic reservoir computing realizes the required short-term memory ability through the relaxation process originates from certain physical phenomena27,28 or the delay module in the system29,30. The nonlinearity can be simply provided by the magnetic materials and the spin dynamics28,29,30. Interestingly, when the short-term memory and nonlinearity are simultaneously provided from multiple components, the abilities of the entire system intensify more than those of a single component28,29,33. Therefore, in an ideal case, it is expected that all components in spintronic reservoir computing can provide short-term memory ability and nonlinearity. However, in the existing studies, the magnetic characteristics of ferromagnets used in spintronic devices mainly contribute to the nonlinearity28,29. Among various magnetic materials, spin glasses are disordered magnets, where spin-freezing state occurs below the spin-freezing temperature (Tg), and exhibit characteristic memory and aging effects related to the slow magnetic relaxation. From the perspective of the mean-field theory, this characteristic property of spin glass is explained by the multi-valley potential, which is caused by the randomness of incoming atoms and the frustration between spin interactions34,35. Although a number of spin glasses have been reported to show memory effects, particularly pertaining to memorizing the thermal and/or magnetic field history36,37,38, there are no quantitative studies discussing their connection with short-term memory ability in physical reservoir computing.
To address this research gap, we quantitatively tested the short-term memory capacity of Lu3Fe4Co0.5Si0.5O12 (LFCS), which has demonstrated spin cluster glass behaviors of memory effect with high Tg39, through the short-term memory task commonly used by reservoir computing. It is well-known that there is an upper limit on the amount of new information for the memory system to remember in a short time 40. This limit is the short-term memory capacity, also known as memory span. For a reservoir computing system, the memory span can be quantitatively evaluated by two different methods. The first is benchmarking the system on short-term memory task with quantitatively defined short-term memory capacity as an index41. The second method is using information processing capacity to comprehensively evaluate the nonlinear and linear capacities of the binary input-driven reservoir computing system42,43. Because we mainly focus on the short-term memory capacity of spin glass, the first method is chose in this work. Numerical simulation and experimental results showed that the short-term memory capacity of LFCS magnetization is higher than that of typical ferrimagenetic material of Lu3Fe5O12 (LuIG). Specifically, when the input binary sequence is mapped from {0, 1} to applied magnetic field {0, 100 Oe} and the working temperature is 150 K immediately below Tg, the magnetization of spin glass has an short-term memory capacity around 2. In contrast, LuIG does not have an effective short-term memory capability. We also found that the short-term memory ability in the experimental results is attenuated compared with the ideal simulation that can be attributed to the relaxation introduced by noise and the measurement system. In addition, the relationship between the amplitude of external write magnetic field for LFCS and the short-term memory ability is explored. It was revealed that the short-term memory ability of LFCS is suitable for utilization under a field strength of approximately 100 Oe. Because the aging memory behaviors of LFCS are common in the spin glass family 37,44,45, the conclusions of this work can be similarly extended to typical spin glass materials. These results contribute a quantitative connection between the spin glass behavior and the short-term memory capacity of reservoir computing. Hence, this work is expected to offer a potentail material candidate for improving the spintronics reservoir computing.
Material and methods
Spin cluster glass of Lu3Fe4Co0.5Si0.5O12
The sample preparation and spin cluster glass behaviors of LFCS have already been reported35,36,46. The general chemical formula of rare-earth iron garnet is (R3) [Fe2] a[Fe3]dO12 (where R denotes the rare-earth elements). Octahedral a-sites and tetragonal d-sites are occupied by 16 and 24 Fe3+ ions, respectively, whereas the dodecahedral c-sites are occupied by 24 R3+ ions. Among various rare-earth iron garnets, magnetic moments in Fe3+ in octahedral and tetragonal sites are dominant in the magnetization of lutetium iron garnet (Lu3Fe5O12, LuIG) because the 4f. level is filled in Lu3+. The magnetic moments of Fe3+ in octahedral and tetragonal sites are antiferromagnetically aligned with each other; hence, the net moment corresponds to that for one Fe3+ per formula unit, resulting in ferrimagnetism. Among various magnetic materials, LuIG and YIG (Y3Fe5O12) show exceptionally low damping constants for spin wave propagation, which means long lifetime and free path. The small magnetic loss is necessary for spin wave application including reservoir computing. Although typical magnetic materials such as permalloy, CoFeB, and Heusler alloys show the damping constants of 10–3, LuIG and YIG show one digit or more smaller values as 10–5–10–447. Both LuIG and YIG are garnet-structured magnetic insulator and composed of the spectroscopic S-state of all the ions that carry the magnetic moment, which result in very small spin–orbit interaction and magnetic loss. Therefore, LuIG and YIG are commonly used candidates for spin wave devices. Because spin glass behaviors have been reported in Co and Si-doped LuIG in addition to the characteristics of spin wave propagation 39, we selected LuIG in this work. According to previous studies39, Co2+ and Si4+ prefer to substitute the octahedral and tetrahedral sites, respectively. The incorporation of anisotropic Co2+ and nonmagnetic Si4+ induces randomness and frustration of magnetic interactions. Thus, similar spin cluster glass behavior as that previously reported in spinel-type ferrimagnets, was observed48,49. LuIG and LFCS films were deposited on Y3Al5O12 (111) substrates through pulsed laser deposition using an ArF excimer laser. The source targets were prepared using a conventional solid-state reaction. Powders of Lu2O3 (99.9%), α-Fe2O3 (99.99%), CoO (99.9%), and SiO2 (99.9%) were mixed stoichiometrically and sintered at 1400 °C for 6 h. During the film growth, the substrate temperature and ambient oxygen pressure were maintained at 750 °C and 1 Pa, respectively. The as-grown films were post-annealed in air at 800 °C for 2 h to improve their crystallinity.
Figure 1a shows the temperature dependence of magnetization in zero-field-cooling (ZFC) and field-cooling (FC) procedures. The irreversibility given by the divergence between ZFC and FC magnetization is a characteristic of spin glass indicating spin freezing state at temperature lower than Tg. As illustrated at inset of Fig. 1a, randomly spin frozen state and ferrimagnetic state are realized at low temperature under ZFC and FC protocols, respectively. Prior to the measurements, the sample was heated up to 400 K for demagnetization to ensure uniformity of the initial state. Thereafter, it was cooled from 400 to 10 K in the absence of field, and the magnetization was recorded based on the ZFC procedure upon heating to 400 K in the weak fields (that is, 50 or 200 Oe). Subsequently, the magnetization was recorded upon cooling to 10 K based on the FC procedure. The magnetization in the ZFC shows a steep decrease at low temperatures that is a characteristic of spin glass. The ZFC curves exhibit cusps at blocking temperatures that are defined as the spin-freezing temperature Tg. The Tg shifts systematically from 220 to 150 K as the applied magnetic field increases from 50 to 200 Oe that is a typical characteristic of spin cluster glass. Generally, the time-dependent magnetic relaxation can be fitted based on the stretched exponential function39:
where \({M}_{0}\) and \({M}_{1}\) are constants which can reflect the glassy component of magnetization and initial remnant magnetization. \(\beta\) is the stretching exponent. \(\tau\) represents the relaxation time constant that reflects the duration of the relaxation behavior. \(A\) is the amplitude of external magnetic field, which can influence the \(\tau\) and \(\beta\). Because the initialization of the curve fit affects the specific value of T, we compared the order of \(\tau\) at different temperatures under the normalization condition. As shown in Fig. 1 (b), among the measured temperature conditions of LFCS, \(\tau\) reaches the maximum value at 150 K with an external magnetic field of 100 Oe. With an increase in temperature over 190 K which is the Tg under applied magnetic field of 100 Oe39, \(\tau\) gradually decreases. At 300 K, \(\tau\) decreases by two orders of magnitude compared with \(\tau\) at 150 K. This can be attributed to the ferrimagnetic behavior of LFCS at room temperature39, which reveals that magnetization is independent of time. If the temperature drops to 80 K and 10 K, \(\tau\) is significantly reduced by nearly an order of magnitude, owing to the deeper frozen state of the system at lower temperatures. Figure 1 (c) displayed the experimental magnetic relaxation data with the fitting curve, which is more intuitive to reveal the effect of \(\tau\) on spin glass relaxation. The index used to assess the goodness of fit is the root mean square error. The small RMSE given in Fig. 1c shows the accuracy of our fitting calculation.
(a) Temperature dependence of magnetization of LFCS film measured by ZFC and FC procedures under the applied magnetic fields of 50 Oe and 200 Oe. (b) Normalized \(\tau\) in FC procedure at 10, 80, 150, 225, and 300 K under the applied magnetic fields of 100 Oe. (c) The magnetic relaxation data with the fitting curve at 10, 80, 150, 225, and 300 K under the applied magnetic fields of 100 Oe.
Implementation of reservoir computing
Similar to the simplest artificial neural network, traditional reservoir computing comprises three basic parts50: the input layer, intermediate layer (reservoir), and output layer, as illustrated in Fig. 2a. At a certain time \(t\), the state of the reservoir is described by the following formula:
where \(\overrightarrow{x}\) and \(\overrightarrow{u}\) are the state vector and input vector of the reservoir, respectively. Suppose \(J\) and \(L\) are the dimensions of the input and output layers respectively, and \(K\) is the number of internal nodes in reservoir. \({W}_{\mathrm{in}}\) is the \(K\)-by-\(J\) input weight matrix. \(f\) and \(W\) are the nonlinear mapping function and \(K\)-by-\(K\) internal connection matrix of the reservoir, respectively. If the matrix containing \(\overrightarrow{x}\left(t\right)\) at all time steps is defined as \(X\), the relationship between \(X\) and the target data matrix \(Y\) can be written as follows:
where \({W}_{\mathrm{out}}\) is the \(L\)-by-\(K\) output weight matrix and the training target. Once \({W}_{\mathrm{out}}\) is obtained, one can use Eqs. (2) and (3) to obtain the target results with any input.
(a) Schematic of traditional reservoir computing. After receiving the input information, the reservoir state is dynamically updated internally. (b) Schematic of physical reservoir computing with time-multiplexing approach. The physical reservoir is completed by time multiplexing the physical system response. Each unit in the physical reservoir is equivalent to a sampling point. (c) Schematic of physical reservoir computing based on spin cluster glass. Connection of its internal nodes is determined by the complex interaction among spins of the material.
In contrast to traditional reservoir computing implemented by software, the physical reservoir computing system with time-multiplexing approach depicted in Fig. 2b relies on a unique technique called masking to realize the function of the input matrix Win51,52. However, in the following short-term memory tasks, it is not necessary to preprocess the input by masking. Moreover, to reduce energy consumption, a physical reservoir computing system generally has only one physical unit. Therefore, it is necessary to sample the continuous response of the physical system and treat each sampling point as a virtual node33. It is noteworthy that \(f\) and \(W\) are determined by the inherent characteristics of the spin cluster glass as a physical reservoir computing system, as shown in Fig. 2c.
Figure 3 shows the experimental schematic of realizing the above training process in spin cluster glass material. Firstly, the input training sequence \(\overrightarrow{u}\left(t\right)\) and input weight matrix \({W}_{\mathrm{in}}\) are generated by computer. Then, the masked input sequence \({W}_{\mathrm{in}}\overrightarrow{u}\left(t\right)\) is converted into a series of applied magnetic field signal and the magnetic relaxation is recorded as \(\overrightarrow{x}\left(t\right)\) by the physical property measurement system with vibrating sample magnetometer (PPMS-VSM). After collecting all the \(\overrightarrow{x}\left(t\right)\) containing at all time step, we can obtain \(X\). Finally, according to the initial determined target data matrix \(Y\) and obtained \(X\), \({W}_{\mathrm{out}}\) can be calculated offline in the computer.
Short-term memory benchmark
Short-term memory, also known as fading memory, is the premise for reservoir computing to complete the above training correctly33. Similar to the principle of transmitter depletion in the human brain53,54, short-term memory is the key that enables reservoir computing to process and encode the received information. To test the short-term memory ability, an input binary sequence \({s}_{in}\in [0, 1]\) should be randomly generated. In our work, the binary input \({s}_{in}\) follows the Bernoulli distribution that takes 0 and 1 with probabilities \(p=50\%\) and \((1-p)=50\%\), respectively. Thereafter, the target sequence \(y(N, d)\) can be obtained using the following formula:
where \(N\) and \(d\) are the \(N\) th data and delay distance, respectively, that are positive integers. In this study, \({s}_{\mathrm{in}}\) contains 200 randomly generated binary codes, 30 of which are used for washout, 130 for training, and 40 for verification. In order to avoid the error caused by the large linear correlation of some variables in \(X\), we use the ridge regression method to calculate Wout55. The calculation formula is as follows:
where \(I\) represents the identity matrix and \(\lambda\) is a constant which is equal to \({10}^{-8}\). Thereafter, the prediction output \({y}_{p}(N)\) corresponding to the test set can be obtained using Eq. (3). To characterize the performance of the short-term memory task, the square of the correlation coefficient between the predicted target and real target is calculated as33:
where \(Cov[{y}_{\mathrm{p}}\left(N\right), y\left(N,d\right)]\) is the covariance between \({y}_{\mathrm{p}}\left(N\right)\) and \(y\left(N,d\right)\). \(Cov[{y}_{\mathrm{p}}\left(N\right)]\) and \(Cov[y\left(N,d\right)]\) are equivalent to \(Cov[{y}_{\mathrm{p}}\left(N\right),{y}_{p}\left(N\right)]\) and \(Cov[y\left(N,d\right),y\left(N,d\right)]\), respectively. \({{r}_{STM} (d)}^{2}\in [\mathrm{0,1}]\) is proportional to the short-term memory ability of reservoir computing when the delay distance is \(d\). Thereafter, the short-term memory capacity can be obtained by
In this work, when \({d}_{max}>20\), the value of \({{r}_{\mathrm{STM}} (d)}^{2}\) is less than 0.01. Hence, we take \({d}_{max}=20\). To ensure reliability, 10 independent experiments were performed. It is noteworthy that each binary input is a continuous signal of equal duration in the physical reservoir computing. Therefore, it is necessary to sample the output signal of the physical reservoir computing for the training process. In this short-term memory test, each binary code lasts for 100 s and is input by PPMS-VSM in the form of an in-plane magnetic field. In addition, the binary code {0, 1} is mapped to {0, \(A\) Oe}, where \(A\) is the amplitude of the magnetic field. For the duration of each code, the amplitude of the input magnetic field \(A\) consists of a bias term \({A}_{bias}\) and binary random data \({A}_{p}{s}_{in}\):
The sampling frequency in the training process was 1 Hz.
Results and discussion
Simulation evaluation for short-term memory capability of spin glass relaxation
In order to numerically test the short-term memory ability of the relaxation term of the spin glass, we first randomly generate binary sequence with 200 codes. Each code contains 100 points to simulate the discrete sampling physical signal, which indicates that the virtual node number of the spin glass system is 100. Thereafter, we determine the time of each positive magnetization relaxation and negative magnetization relaxation according to the binary code. According to Eq. (1), we can then obtain the relaxation sequence of spin glass for the corresponding binary input sequence. Notably, as the premise of simulation, we need to carry out the magnetization relaxation measurement experiment described in Section "Spin cluster glass of Lu3Fe4Co0.5Si0.5O12" to determine the relaxation parameters under specific temperature scheme. Since \({M}_{0}\) and \({M}_{1}\) can be normalized during training, accurate \(\tau\) and \(\beta\) are more important. Because the magnetization relaxation characteristic of spin glass is the strongest near Tg, we extracted \(\tau\) and \(\beta\) at a constant temperature of Tg using Eq. (1). The obtained \([\tau ,\beta ]\) values for the FC and ZFC relaxations under an external applied magnetic field of \(A=100\) Oe are [2741 s, 0.60] and [3848 s, 0.53], respectively39. In contrast, the short-term memory benchmark was also tested on tanh function. The tanh function is representative of the threshold activation function in reservoir computing56 as well as other artificial neural networks57,58,59, which is used to simulate the excitation and inhibition of human neurons. In this work, tanh can be used to numerically simulate the magnetodynamics of LuIG.
The time-domain responses of three systems to random binary sequences are shown in Fig. 4a. It can be seen that when the input signal is switched between 0 and 1, the output of the tanh function reaches the steady state instantaneously without any relaxation transition. Different from the tanh without relaxation behavior, spin glass in the form of ZFC and FC form shows a relatively long-time relaxation duration. Generally, the shorter the relaxation time, the weaker is the short-term memory capability29. Moreover, in Fig. 4b, the relationship between the input and output of the spin glass forms a loop, whereas that of the tanh function forms a straight line. The loop relationship between input and output is the embodiment of the system memory effect60,61,62. Therefore, from Fig. 4a and b, we can qualitatively understand the short-term memory capability comparison of the three systems. Specifically, the tanh function has no short-term memory capability. It should be noted that when the relaxation time \(\tau\) is shortened, the relaxation of spin glass will weaken and approach the output by tanh function. Thereby, one can expect that the short-term memory capacity of spin glass will decrease when the temperature is significantly higher / lower than Tg.
(a) Input binary sequence and the output from the spin glass relaxation term of FC condition, ZFC condition, and tanh function, respectively. Each binary code is sampled into 100 discrete points. (b) Relationship curve between input binary sequence and the output from each system. (c) short-term memory capacity and (d) \({{r}_{\mathrm{STM}} (d)}^{2}\) of each system.
For further quantitative analysis, Fig. 4c and d show the short-term memory benchmark test results of the three systems. Consistent with the qualitative analysis, the short-term memory capability of spin glass in both the ZFC and FC relaxation states is better than that of the tanh function, which is 0. In Fig. 4d, \({{r}_{STM} (d)}^{2}\) of the spin glass under both ZFC and FC condition first decreases with the delay distance, and thereafter fluctuates near 0. Although there is no significant difference in the attenuation rate of \({{r}_{STM} (d)}^{2}\), the \({{r}_{STM} (d)}^{2}\) of ZFC state is higher than that of FC state at \(d=1\), which contributes to the short-term memory difference between the two conditions. In essence, the different short-term memory capacities under ZFC and FC condition can be attributed to different magnetization relaxation processes caused by different external magnetic field conditions. Specifically, under the condition of FC, the magnetization of the spin glass is subject to additional constraints compared with that of ZFC, which also weakens the response to the binary input, resulting in a lower short-term memory capacity. From the simultaneous relaxation performance, the relaxation amplitude of spin glass in FC is less than that in ZFC63.
Experimental testing for short-term memory capability of spin glass relaxation
When \(A=100\) Oe, the short-term memory benchmark was experimentally tested on LFCS and LuIG. Figure 5a and b show the short-term memory capacities of the two materials at different temperatures and cooling conditions. First, it can be seen that for the LFCS of ZFC or FC relaxation, its short-term memory capacity is the best at 150 K. This can be explained by the effect of the change in thermal energy on the height of the potential barrier resulting from the multivalley potential34. At a low temperature of 10 K, the potential barrier is high, and the spin state is completely frozen, with almost no change in the magnetic field. In contrast, at temperatures around 300 K, the potential barrier reduces, the metastable state is lost, and the spin-glass-like characteristic is lost. Therefore, the short-term memory capacity is expected to be small at 10 K and 300 K. However, at around 150 K, the temperature is slightly less than the spin-freezing temperature in the magnetic field64, therefore the short-term memory capacity is expected to be larger because the magnetic field causes a slow magnetic relaxation that slowly exceeds the potential barrier of the magnetic state. Similar to the simulation results in Fig. 5 (a), the short-term memory capacity of FC relaxation at 150 K is lower than that of ZFC. Moreover, from Fig. 5 (c), one can expect the difference in short-term memory capacity under the two conditions is mainly contributed by \({{r}_{\mathrm{STM}} (d=1)}^{2}\). Therefore, the short-term memory capability of LFCS under ZFC relaxation is better than that of FC relaxation that is consistent with the simulation results. Notably, a delay distance of 1 means a time scale of 1 s, which is the minimum measurement interval of PPMS-VSM. For the traditional spintronics RC, its short-term memory can only maintain microsecond level29. In contrast, the LFCS can maintain the short-term memory ability at the second level. It implies that even for the high-speed signal in a shorter time scale, the spin cluster glass can still be expected to provide considerable short-term memory capacity.
Furthermore, for LuIG, the short-term memory capability should be close to the tanh function in theory because of the extremely short relaxation time of ferrimagnetic materials65. In Fig. 5b, one can show that the short-term memory capacity fluctuates sharply under the tested conditions. In Fig. 5d, for almost every \(d\), the error of \({{r}_{\mathrm{STM}} (d)}^{2}\) is large compared to its average value. Hence, it can be considered that the short-term memory capacity of LuIG is extremely low and the measurement result indicates the error fluctuation caused by the environment and equipment disturbance.
Although the aforementioned results preliminarily prove that LFCS has a short-term memory capacity around 2 at 150 K, there is a noticeable gap between the experimental results and simulation. To further analyze the source of this gap, the ideal input and the input magnetic field applied by PPMS-VSM under the same binary test sequence are depicted in Fig. 6a and b. In the ideal case, the binary sequence should be instantaneously switched between 0 and 1, without transition values. In the actual case, the externally applied physical signal cannot be changed instantaneously, which will produce a transition state, such as the scattered points in Fig. 6b. The positions of these scattered points are irregular, and the intervals are not uniform; thus, random relaxation independent of input information is introduced. In addition, it can be observed that in the magnetization curves measured by PPMS-VSM (Fig. 6c), regardless of FC or ZFC relaxation, the magnetization of spin glass is markedly disturbed by noise during the relaxation process. This implies that noise also introduces random relaxation independent of the input information. The directions of input relaxation and noise relaxation are shown in Fig. 6d. In the ideal condition of the simulation, the input–output curve with short-term memory capability should form a rectangle (Fig. 4b). However, the random relaxation caused by the input and noise obviously distorted the input–output relationship curve. Comparing the durations of the two types of random relaxation, when \(A=100\) Oe, one can expect that the duration of the input relaxation is approximately 3–4 s, which is significantly shorter than the duration (100 s) of a binary code. However, noise relaxation is always present. In addition, in a previous study28, the short-term memory capacity of physical reservoir computing was increased by approximately 1 after the system noise was suppressed. Therefore, it can be perceived that the main reason behind the difference in the short-term memory capability of spin glass between the experimental and simulation results, is the random relaxation introduced by noise. For the input relaxation, it is difficult to completely eliminate its negative influence due to the inevitable transition process of the physical system. As a feasible method, we can reduce the effect of input relaxation by increasing the duration of each input code to decrease the proportion of the transition process in the whole signal input process. For reducing the impact of noise, filters and time-domain averaging techniques are effective methods which has been widely used in other reservoir computing systems 28,66.
(a) Randomly generated binary sequence. In the ideal case, binary code only takes two values—0 and 1. (b) Input magnetic field applied by PPMS-VSM according to the binary sequence. The scattered points between 0 and 100 Oe are caused by the non-transient magnetic field applied by the system. (c) Magnetization (a.u.) of FC and ZFC relaxation in LFCS at 150 K. (d) Relationship curve between input magnetic field and the output magnetization (a.u.) of FC and ZFC relaxation in LFCS.
Finally, we determine whether the mapping relationship between the binary code and the external magnetic field, that is, the value of \(A\), affects the short-term memory capability of the spin glass. We experimentally evaluated the performance of spin glass on the short-term memory benchmark at 150 K when {0, 1} binary codes were mapped to {0, 50 Oe}, {0, 100 Oe} and {0, 200 Oe}, respectively. The test results are shown in Fig. 7.
Figure 7 shows that with an increase in the external magnetic field, the short-term memory capacity of spin glass first increases, subsequently reaching saturation or even slightly decreasing. When the magnetic field amplitude is small, spin glass is more susceptible to noise due to weaker magnetization. However, with the increase in the magnetic field, the transition time in the input signal is extended, that is, the input relaxation intensifies. The stronger input relaxation limits the growth of short-term memory capacity, which results in the trend shown in Fig. 7. Notably, although the short-term memory capacity of LFCS is saturated to about 1 in a noisy environment, this value should not be considered a small value. For many traditional spintronics reservoir computing device, the short-term memory capacity in noisy environment is about 2 to 328,29. Because the overall short-term memory capacity and nonlinearity of a physical reservoir computer are jointly contributed by each component 28,29,67, using spin glass as the basic material has the potential to increase the overall short-term memory capacity of traditional spintronics reservoir computing devices by about 1/3 to 1/2 at most.
Conclusion
Based on the short-term memory benchmark commonly used in physical reservoir computing, we quantitatively evaluated the short-term memory ability of magnetization in LFCS, both numerically and experimentally. Under ideal conditions, the short-term memory capability of LFCS is approximately 2 and comparable to some physical reservoir computing systems with a single node28,33. Although in the experiment, we found that the additional irregular relaxation caused by noise and the measurement system degenerate the short-term memory capacity of LFCS, its short-term memory capacity is still larger than that of ferrimagnetic LuIG without spin glass behavior.
It is worth noting that the above conclusions are not intended to encourage the development of a physical reservoir computing system that depends only on the relaxation behavior of spin cluster glass materials. Rather, the conclusion of this study should be understood as providing an improved basic material candidate for spintronic reservoir computing based on magnetodynamic relaxation. When combining spin glass with existing spintronic reservoir computing systems, some additional physical considerations need to be taken into account according to the specific system. For example, if combing the spin glass with spin wave equipment, it should be careful to consider the change of damping constant after replacing materials, which affects the shape designing of the spin cluster glass. Because the nonlinearity and short-term memory capability of the spintronic reservoir computing result from the interaction of various components in the system28,29, choosing a material that can provide short-term memory capability will undoubtedly be more conducive to the enhancement of spintronic reservoir computing performance. However, an optimal short-term memory capacity of LFCS is obtained near 150 K. Therefore, it is a challenging and an important task in future research to realize materials exhibiting spin glass behavior at higher temperatures.
Data availability
The datasets measured during and/or analyzed during the current study are available from the corresponding author upon reasonable request.
References
Big data needs a hardware revolution. Nature 554, 145–146 (2018).
Shastri, B. J. et al. Photonics for artificial intelligence and neuromorphic computing. Nat. Photon. 15, 102–114 (2021).
Roy, K., Jaiswal, A. & Panda, P. Towards spike-based machine intelligence with neuromorphic computing. Nature 575, 607–617 (2019).
van De Burgt, Y., Melianas, A., Keene, S. T., Malliaras, G. & Salleo, A. Organic electronics for neuromorphic computing. Nat. Electron. 1, 386–397 (2018).
Liao, Z. et al. Phase locking of ultra-low power consumption stochastic magnetic bits induced by colored noise. Chaos, Solitons Fractals 151, 111262 (2021).
Schrauwen, B., Verstraeten, D. & Van Campenhout, J. In Proceedings of the 15th European Symposium on Artificial Neural Networks. p. 471–482 2007. 471–482.
Nakajima, K. Physical reservoir computing—an introductory perspective. Jpn. J. Appl. Phys. 59, 060501 (2020).
Tanaka, G. et al. Recent advances in physical reservoir computing: A review. Neural Netw. 115, 100–123 (2019).
Jaeger, H. & Haas, H. Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science 304, 78–80 (2004).
Appeltant, L. et al. Information processing using a single dynamical node as complex system. Nat. Commun. 2, 1–6 (2011).
Liao, Z., Wang, Z., Yamahara, H. & Tabata, H. Low-power-consumption physical reservoir computing model based on overdamped bistable stochastic resonance system. Neurocomputing 468, 137–147 (2021).
Lukoševičius, M. & Jaeger, H. Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3, 127–149 (2009).
Jaeger, H. Short term memory in echo state networks. Vol. 5 (GMD-Forschungszentrum Informationstechnik, 2001).
Dale, M., Miller, J. F., Stepney, S. & Trefzer, M. A. In International Conference on Unconventional Computation and Natural Computation. 49–61 (Springer).
Govia, L., Ribeill, G., Rowlands, G., Krovi, H. & Ohki, T. Quantum reservoir computing with a single nonlinear oscillator. Phys. Rev. Res. 3, 013077 (2021).
Takahashi, H., Yasuda, S., Yada, Y. & Kanzaki, R. Reservoir computing with dissociated neuronal culture. Front. Neurosci. 27 (2016).
Soriano, M. C. et al. Delay-based reservoir computing: Noise effects in a combined analog and digital implementation. IEEE Transact. Neural Netw. Learn. Syst. 26, 388–393 (2014).
Haynes, N. D., Soriano, M. C., Rosin, D. P., Fischer, I. & Gauthier, D. J. Reservoir computing with a single time-delay autonomous Boolean node. Phys. Rev. E 91, 020801 (2015).
Urbain, G., Degrave, J., Carette, B., Dambre, J. & Wyffels, F. Morphological properties of mass–spring networks for optimal locomotion learning. Front. Neurorobot. 11, 16 (2017).
Caluwaerts, K. & Schrauwen, B. in 2nd International conference on Morphological Computation (ICMC 2011).
Rafayelyan, M., Dong, J., Tan, Y., Krzakala, F. & Gigan, S. Large-scale optical reservoir computing for spatiotemporal chaotic systems prediction. Phys. Rev. X 10, 041037 (2020).
Van der Sande, G., Brunner, D. & Soriano, M. C. Advances in photonic reservoir computing. Nanophotonics 6, 561–576 (2017).
Hon, K. et al. Numerical simulation of artificial spin ice for reservoir computing. Appl. Phys. Express 14, 033001 (2021).
Nakane, R., Tanaka, G. & Hirose, A. Reservoir computing with spin waves excited in a garnet film. IEEE Access 6, 4462–4469 (2018).
Grollier, J. et al. Neuromorphic spintronics. Nat. Electron. 3, 360–370 (2020).
Torrejon, J. et al. Neuromorphic computing with nanoscale spintronic oscillators. Nature 547, 428–431. https://doi.org/10.1038/nature23011 (2017).
Marković, D. et al. Reservoir computing with the frequency, phase, and amplitude of spin-torque nano-oscillators. Appl. Phys. Lett. 114, 012409 (2019).
Tsunegi, S. et al. Physical reservoir computing based on spin torque oscillator with forced synchronization. Appl. Phys. Lett. 114, 164101 (2019).
Watt, S. & Kostylev, M. Reservoir computing using a spin-wave delay-line active-ring resonator based on yttrium-iron-garnet film. Phys. Rev. Appl. 13, 034057 (2020).
Watt, S., Kostylev, M. & Ustinov, A. B. Enhancing computational performance of a spin-wave reservoir computer with input synchronization. J. Appl. Phys. 129, 044902 (2021).
Jiang, W. et al. Physical reservoir computing using magnetic skyrmion memristor and spin torque nano-oscillator. Appl. Phys. Lett. 115, 192403 (2019).
Kurenkov, A., Fukami, S. & Ohno, H. Neuromorphic computing with antiferromagnetic spintronics. J. Appl. Phys. 128, 010902 (2020).
Furuta, T. et al. Macromagnetic simulation for reservoir computing utilizing spin dynamics in magnetic tunnel junctions. Phys. Rev. Appl. 10, 034063 (2018).
Mydosh, J. Spin glasses: Redux: An updated experimental/materials survey. Rep. Prog. Phys. 78, 052501 (2015).
Binder, K. & Young, A. P. Spin glasses: Experimental facts, theoretical concepts, and open questions. Rev. Mod. Phys. 58, 801 (1986).
Muraoka, Y., Tabata, H. & Kawai, T. Effects of light-irradiation on spin-glass state and magnetoresistive properties of Zn0.5Co0.5Fe2O4 spinel ferrite films. Solid state Commun. 120, 255–258 (2001).
Bag, P., Baral, P. & Nath, R. Cluster spin-glass behavior and memory effect in Cr 0.5 Fe 0.5 Ga. Phys. Rev. B 98, 144436 (2018).
Lundgren, L., Nordblad, P. & Sandlund, L. Memory behaviour of the spin glass relaxation. EPL 1, 529 (1986).
Yamahara, H., Seki, M. & Tabata, H. High temperature spin cluster glass behavior in Co-and Si-substituted garnet ferrite thin films. J. Magn. Magn. Mater. 501, 166437 (2020).
Miller, G. A. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol. Rev. 63, 81 (1956).
Shi, Z., Liao, Z. & Tabata, H. Boosting learning ability of overdamped bistable stochastic resonance system based physical reservoir computing model by time-delayed feedback. Chaos, Solitons Fract. 161, 112314 (2022).
Kubota, T., Takahashi, H. & Nakajima, K. Unifying framework for information processing in stochastically driven dynamical systems. Phys. Rev. Res. 3, 043135. https://doi.org/10.1103/PhysRevResearch.3.043135 (2021).
Tanaka, K. et al. Self-organization of remote reservoirs: Transferring computation to spatially distant locations. Adv. Int. Syst. 4, 2100166. https://doi.org/10.1002/aisy.202100166 (2022).
Ghara, S., Jeon, B.-G., Yoo, K., Kim, K. H. & Sundaresan, A. Reentrant spin-glass state and magnetodielectric effect in the spiral magnet Bi Mn Fe 2 O 6. Phys. Rev. B 90, 024413 (2014).
Khan, N., Mandal, P. & Prabhakaran, D. Memory effects and magnetic relaxation in single-crystalline La 0.9 Sr 0.1 CoO 3. Phys. Rev. B 90, 024421 (2014).
Adachi, M., Seki, M., Yamahara, H., Nasu, H. & Tabata, H. Long-term potentiation of magnonic synapses by photocontrolled spin current mimicked in reentrant spin-glass garnet ferrite Lu3Fe5− 2xCoxSixO12 thin films. Appl. Phys. Express 8, 043002 (2015).
Chumak, A., Serga, A. & Hillebrands, B. Magnonic crystals for data processing. J. Phys. D Appl. Phys. 50, 244001 (2017).
Yamahara, H. et al. Spin-glass behaviors in carrier polarity controlled Fe3− x Ti x O4 semiconductor thin films. J. Appl. Phys. 118, 063905 (2015).
Muraoka, Y., Tabata, H. & Kawai, T. Room-temperature spin glass and its photocontrol in spinel ferrite films. Appl. Phys. Lett. 77, 4016–4018 (2000).
Öztürk, M. M., Cankaya, I. A. & Ipekci, D. Optimizing echo state network through a novel fisher maximization based stochastic gradient descent. Neurocomputing 415, 215–224 (2020).
Schneider, B., Dambre, J. & Bienstman, P. Using digital masks to enhance the bandwidth tolerance and improve the performance of on-chip reservoir computing systems. IEEE Transact. Neural Netw. Learn. Syst. 27, 2748–2753 (2015).
Appeltant, L., Van der Sande, G., Danckaert, J. & Fischer, I. Constructing optimized binary masks for reservoir computing with delay systems. Sci. Rep. 4, 1–5 (2014).
Mongillo, G., Barak, O. & Tsodyks, M. Synaptic theory of working memory. Science 319, 1543–1546 (2008).
Grossberg, S. Pavlovian pattern learning by nonlinear neural networks. Proc. Natl. Acad. Sci. 68, 828–831 (1971).
Liao, Z., Wang, Z., Yamahara, H. & Tabata, H. Echo state network activation function based on bistable stochastic resonance. Chaos, Solitons Fractals 153, 111503 (2021).
Doan, N. A. K., Polifke, W. & Magri, L. Physics-informed echo state networks. J. Comput. Sci. 47, 101237 (2020).
Gao, L., Sun, K., Zheng, H. & Zhao, Y. A deep-learning approach to the dynamics of landau-zenner transitions. Adv. Theory Simul. 4, 2100083 (2021).
Duan, L., Duan, F., Chapeau-Blondeau, F. & Abbott, D. Stochastic resonance in Hopfield neural networks for transmitting binary signals. Phys. Lett. A 384, 126143 (2020).
Jafar-Zanjani, S., Salary, M. M., Huynh, D., Elhamifar, E. & Mosallaei, H. TCO-based active dielectric metasurfaces design by conditional generative adversarial networks. Adv. Theory Simul. 4, 2000196 (2021).
Cheng, S. et al. Highly controllable and silicon-compatible ferroelectric photovoltaic synapses for neuromorphic computing. Iscience 23, 101874 (2020).
Kahn, O. & Martinez, C. J. Spin-transition polymers: From molecular materials toward memory devices. Science 279, 44–48 (1998).
Mohan, S. & Banerjee, A. Modelling of minor hysteresis loop of shape memory alloy wire actuator and its application in self-sensing. Smart Mater. Struct. 30, 055011 (2021).
Mathieu, R., Jönsson, P., Nam, D. & Nordblad, P. Memory and superposition in a spin glass. Phys. Rev. B 63, 092401 (2001).
Palai, R., Huhtinen, H., Scott, J. & Katiyar, R. Observation of spin-glass-like behavior in SrRuO 3 epitaxial thin films. Phys. Rev. B 79, 104413 (2009).
Caspari, M. & Ray, F. High-temperature electronic relaxation at the rare-earth ions in garnets. J. Appl. Phys. 37, 1326–1327 (1966).
Bueno, J., Brunner, D., Soriano, M. C. & Fischer, I. Conditions for reservoir computing performance using semiconductor lasers with delayed optical feedback. Opt. Express 25, 2401–2412 (2017).
Fujii, K. & Nakajima, K. Harnessing disordered-ensemble quantum dynamics for machine learning. Phys. Rev. Appl. 8, 024030 (2017).
Acknowledgements
Zhiqiang Liao would like to acknowledge support from the Quantum Science and Technology Fellowship Program of the University of Tokyo. This research was partially supported by Institute for AI and Beyond for the University of Tokyo, JST-CREST (JPMJCR22O2) and JSPS KAKENHI [Grant Number JP20H05651, 19K15022].
Author information
Authors and Affiliations
Contributions
Z.L. and H.Y. designed the study and performed the experiments. Z.L., H.Y., and K.T. conducted the data analyzing. Z.L., H.Y., and K.T. wrote the manuscript. Z.L. and K. M visualized all the data. All authors discussed the results and commented on the manuscript. H.Y. and H.T. supervised the research.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liao, Z., Yamahara, H., Terao, K. et al. Short-term memory capacity analysis of Lu3Fe4Co0.5Si0.5O12-based spin cluster glass towards reservoir computing. Sci Rep 13, 5260 (2023). https://doi.org/10.1038/s41598-023-32084-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-32084-8
This article is cited by
-
Advancing the Production of Clinical Medical Devices Through ChatGPT
Annals of Biomedical Engineering (2023)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.