Abstract
Coherent Ising machines (CIMs) constitute a promising approach to solve computationally hard optimization problems by mapping them to ground state searches of the Ising model and implementing them with optical artificial spinnetworks. However, while CIMs promise speedups over conventional digital computers, they are still challenging to build and operate. Here, we propose and test a concept for a fully programmable CIM, which is based on optoelectronic oscillators subjected to selffeedback. Contrary to current CIM designs, the artificial spins are generated in a feedback induced bifurcation and encoded in the intensity of coherent states. This removes the necessity for nonlinear optical processes or large external cavities and offers significant advantages regarding stability, size and cost. We demonstrate a compact setup for solving MAXCUT optimization problems on regular and frustrated graphs with 100 spins and can report similar or better performance compared to CIMs based on degenerate optical parametric oscillators.
Introduction
Recent advances in optical and quantum computing are paving the way for new computational paradigms, which may soon replace conventional digital computers in challenging tasks. Of particular interest are combinatorial optimization problems, which are often known to be NPhard and thus considered hard to solve efficiently on digital computers^{1}. To speed up calculation time compared to digital hardware, different nonvon Neumann architectures have been proposed that attempt to solve optimization problems by mapping them to Ising models. Finding the optimal solution then becomes equivalent to finding the ground state of the Ising model^{2}, which is implemented with networks of coupled artificial Ising spins that can be realized with various physical systems, e.g. Josephson junctions, trapped ions, or optical states^{3,4,5,6,7,8,9}. The energy function of these socalled Ising machines is proportional to the Ising Hamiltonian, so that they will naturally evolve to the ground state of the Ising model and thus to the optimal solution. As the evolution to the ground state typically occurs on very fast timescales, Ising machines promise a considerable speed up over conventional algorithms in finding solutions to optimization problems^{10,11}, which will have significant implications for various important areas such as finance, pharmaceutics, logistics, or machine learning.
Among the different concepts, coherent Ising machines (CIMs) have attracted recent interest^{12}. CIMs use the formal similarities between the Ising Hamiltonian and the Hamiltonian of bistable interfering coherent optical states to realize largescale Ising machines with networks of coupled optical states. This offers a number of advantages over other Ising machines such as quantum annealing, as CIMs are able to operate at room temperature, can be constructed from offtheshelf photonic components, and are capable of implementing arbitrary coupling topologies^{12}. CIMs are also gaindissipative systems, which makes them efficient in escaping local energy minima and thus suitable for solving optimization problems^{13}. The optimal solution then represents the lowest loss configuration and can be found by driving the system close to the minimum gain threshold, where other local energy minima are not stable yet. Based on this, various types of CIMs have been proposed that implement Ising spin networks with bistable coherent optical states, such as coupled lasers^{7,14} and degenerate optical parametric oscillators (DOPOs)^{8}. Current stateoftheart CIMs based on DOPOs have demonstrated their ability as global optimizers for various largescale problems^{11,15,16,17}. By taking advantage of the large bandwidth of optical systems, they can operate at high speed and have shown speedups over conventional algorithms^{11,18}.
However, the generation, interference and detection of the coherent optical states is phasesensitive and thus makes stable operation technically challenging. In DOPObased CIMs, artificial Ising spins are represented by the optical phase of short laser pulses that are generated by nonlinear optical processes and circulated inside a 1 km long ring fiber cavity^{8}. This requires phasestability for the whole length of the cavity and makes the system highly susceptible to external perturbations, often leading to cases where unstable conditions deteriorate performance^{16,19}. Furthermore, the nonlinear DOPO generation process demands powerful laser systems and temperaturecontrolled nonlinear materials, which results in large and complex optical setups. These drawbacks make CIMs challenging to build and operate and hinder realization as small and cost efficient devices, e.g. as photonic integrated circuits.
Here, to improve the stability and decrease the footprint of CIMs, we introduce a different concept by implementing a CIM based on optoelectronic oscillators (OEOs) subjected to selffeedback. OEOs are an attractive choice since they can easily be built from few offthe shelf components or as photonic integrated circuits and are known for their inherent stability and complex nonlinear dynamics, which are used in various applications, e.g. cryptography, microwave generation, and optical neuronal computing^{20}. We demonstrate how the rich bifurcation structure of OEOs can be used to generate arbitrarily large controllable artificial spin networks. Our concept results in a more compact experimental setup, which requires only a few components. We test its performance in solving optimization problems with up to 100 spins and find that it is suitable as a solver for MAXCUT optimization problems with a similar or better performance compared to DOPObased CIMs. Contrary to DOPObased CIMs, our machine does not require external cavities or nonlinear optical processes, which drastically decreases its cost and its footprint, while also enhancing its stability. This demonstrates the large potential of feedback systems in general to be used for computation of the Ising model.
Results
Implementing artificial Ising spin network with OEOs
The Ising model describes an ensemble of binary spins σ_{n}, which are either in the spin up σ_{n} = 1 or the spin down state σ_{n} = −1. Interaction of the spins is achieved by coupling them using the spin coupling topology J_{mn}. The energy function of an ensemble of N coupled spins is then given by the Ising Hamiltonian
As shown in ref. ^{21}, the Hamiltonian of interfering optical coherent states is analogous to the Ising model, where the spin coupling J_{mn} corresponds to the optical phase difference Δφ and the optical coupling strength of the interfering states. For example, the Ising Hamiltonian corresponds to coupled DOPOs^{21}, where the phase difference is fixed to Δφ = {0, π}. Due to this phase degeneracy, the electrical field is real valued with a positive or negative amplitude. Motivated by this, we suggest to remove the phase sensitivity in CIMs with an OEO, which consists of an optical and an electrical pathway (see Fig. 1a). The optical pathway implements a nonlinearity by feeding the output of a laser diode through a Mach–Zehnder modulator (MZM) and detecting it with a photodiode. The electrical pathway creates timediscrete feedback by sampling the photovoltage and feeding it back to the input of the MZM. Inside the MZM, the coherent input is split and interfered with itself. A phase difference corresponding to the feedback signal is set within one of the arms by a phase modulator and the output of the MZM is then the squared inphase component of the interfering electrical fields. In the Methods section, we show how this output approximates the coherent superposition of DOPO pulses in DOPObased CIMs. By coupling the output of multiple OEOs together, either electrically or optically^{22,23}, a network of bistable optical states can thus be generated to represent an ensemble of Ising spins. Contrary to DOPObased CIMs however, generation, interference, and detection of the optical states is fully contained within the MZM and the feedback system. All information about the optical states is encoded in the light intensity outside of the MZM and therefore phase sensitivity is removed.
To map the OEO network to a network of Ising spins, we exploit the nonlinear nature of the optoelectronic feedback system. For an ensemble of coupled OEOs with timediscrete feedback, the time evolution of the nth OEO x_{n}[k] during iteration step k is given by the following nonlinear map^{23}:
Gaussian white noise ζ_{n}[k] and a constant bias of −π/4 are applied to the system. The feedback term f_{n}[k] is calculated according to
f_{n}[k] includes both selffeedback to each oscillator x_{n}[k] with the feedback strength α as well as mutual coupling with the coupling matrix J_{mn} and the coupling strength β. Without mutual coupling (β = 0), it can easily be shown by linear stability analysis that the system undergoes a pitchfork bifurcation at α = 1. Below the bifurcation point, the system has only one stable fixed point \(x_1^ \ast = 0\), while above the bifurcation point the system has two stable fixed points \(x_{2,3}^ \ast = \left\{ {  a_0,a_0} \right\}\) and one unstable fixed point \(x_1^ \ast = 0\). The pitchfork bifurcation results in a symmetrical bistability, where there is an equal probability that a single oscillator will end up in either of the two stable fixed points when the system is initially in the unstable fixed point. Ising spin networks are then generated by mapping the photovoltage x_{n}[k] to the Ising spins σ_{n} by σ_{n} = sig_{n}(x_{n}[k]). As DOPObased CIMs have to implement this kind of bistability with a phasesensitive nonlinear optical amplification process, using the nonlinearity of an MZM subjected to selffeedback presents a significantly easier and more stable approach to realizing largescale spin networks.
To facilitate the realization and coupling of several OEOs, we employ a timemultiplexing scheme that allows us to emulate a large ensemble of oscillators with a single system. For a network of N spins, the feedback signal is divided into N equal intervals, where each individual interval represents a single artificial spin (see Fig. 1b). The feedback signal and the photovoltage are then represented by piecewise constant functions and are generated and read out sequentially. Similar to DOPObased CIMs, we employ a hybrid computing scheme where multiplexing and coupling are performed by digital hardware while the nonlinear system is implemented with the optical system. For each iteration, the photovoltage x_{n} and the feedback signal f_{n} for each spin n are updated in a twostage process, namely a sampling and a processing stage (see Fig. 1b). In the sampling stage, the multiplexed feedback signal is injected from a digital–analog converter (DAC) to the MZM and the resulting photovoltage is sampled by an analog–digital converter (ADC). In the processing stage, the signal is demultiplexed, a matrix multiplication is performed to facilitate the spin coupling and the resulting feedback signal is multiplexed again for the next iteration. This hybrid computing scheme presents a good compromise as it allows to implement arbitrary networks while taking advantage of some of the high bandwidth of the optical system. In DOPObased CIMs, this enables fast computation times at rates of hundreds of megahertz per spin, which can already outperform other heuristic methods^{11,18}. However, an alloptical approach could remove any slowdown of the digital I/O system and take full advantage of the optical system to further increase the rate to tens of gigahertz.
We test the behavior of the OEObased CIM as an artificial spin network by emulating an ensemble of 100 uncoupled spins (J_{mn} = 0). Figure 2a shows the amplitude distribution for all spins after 50 iterations as we increase the feedback strength α from below to above the bifurcation point. Below the bifurcation point, only the trivial fixed point \(x_1^ \ast = 0\) is stable and the artificial spins are distributed around \(x_1^ \ast\). As the feedback strength increases above α = 1, the trivial fixed point becomes unstable and the artificial spins bifurcate into the two new stable fixed points \(x_{2,3}^ \ast = \pm a_0\). As expected for a pitchfork bifurcation, the amplitude a_{0} of the stable fixed points increases with the feedback strength, which also agrees well with simulations of the nonlinear map (2) (orange dots in Fig. 2a). For higher feedback strengths, we observe a deviation from the nonlinear map (2) as the spin amplitude starts to saturate due to load limitations of the DAC. Figure 2b shows two exemplary time evolutions for all spins below (α = 0.8) and above (α = 1.3) the bifurcation point. At α = 0.8, we observe how the spins are fluctuating around the stable fixed point \(x_1^ \ast\) as a consequence of the system’s noise. At α = 1.3, the noise drives the spins away from the now unstable fixed point \(x_1^ \ast\) as the spin amplitude bifurcates into the new stable fixed points \(x_{2,3}^ \ast\). From the histogram, we see that 49 spins are in the spin up state and 51 spins are in the spin down state, which exemplifies that there is an equal probability for both configurations. For 50 independent measurements, we find that the average probability for the spin up and spin down configuration are P_{up} = 0.49 ± 0.08 and P_{down} = 0.51 ± 0.08, thereby corroborating that the artificial spins are emulating the correct behavior of independent Ising spins.
Solving MAXCUT optimization problems with OEObased CIMs
To demonstrate the capability of OEObased CIMs as general solvers for optimization problems, we perform different benchmarks for the MAXCUT problem. MAXCUT is the task of dividing a graph J_{mn} into two subsets with a maximal number of connecting edges between both subsets and is known to be an NPhard problem^{1}. MAXCUT problems can easily be transformed to an Ising model by implementing the graph structure J_{mn} and setting each nonzero edge to be antiferromagnetic (J_{mn} = −1). The energy minimum of the Ising Hamiltonian is then equivalent to the maximal cut^{11}. In the following, we perform ground state searches for MAXCUT problems in various graph structures to demonstrate that OEObased CIMs can find the correct solution. As a first instance, we consider a square lattice, where the spins are organized in a twodimensional (2D) grid structure and coupled to their four nearest neighbors. The ground state is given by a checkerboard pattern, where neighboring spins are alternating between the spin up and down configuration.
We implement a 10 by 10 square lattice with periodic boundary conditions and study the ground state evolution. In Fig. 3a, we show the time evolution of each spin’s amplitude and the corresponding Ising energy. Starting from the unstable fixed point \(x_1^ \ast\), the system is driven across the threshold of the pitchfork bifurcation where the spins start to bifurcate into the two stable fixed points \(x_{2,3}^ \ast\). The mutual coupling drives the spins to reorder themselves, which is accompanied by a drop in the Ising energy. This process continues until after 28 iterations, the ground state energy has been reached. To better understand the evolution to the ground state, we show snapshots ((i)–(iv) in Fig. 3b) of the spin amplitude during the ground state search. The spins are color coded, so that yellow indicates spin up and blue indicates spin down. We find that, as the artificial spins start to bifurcate, they organize themselves into small circular domains ((i) in Fig. 3b). Within these domains, spins are already organized in a checkerboard pattern. At the boundaries, domain walls are formed, which create a mismatch in the pattern (indicated by magenta lines). As the ground state search progresses, the domain walls start to move and the domains merge and shrink ((ii)–(iii) in Fig. 3b) until all of them eventually vanish and the ground state is reached ((iv) in Fig. 3b). It is interesting to note here that these domain evaporation dynamics are likewise observed in DOPObased CIMs^{17,24}.
MAXCUT performance in regular and frustrated graphs
To assess the performance of the OEObased CIM, we evaluate the success rate to reach the ground state in 50 independent experiments. This indicates whether it is likely that the machine becomes trapped in local energy minima. In Fig. 4a, we show the time evolution of the success rate for the square lattice. After around 100 iterations, 90% of the instances are able to reach the ground state, which indicates a high probability to escape local minima. Only 10% of the calculations get stuck in local energy minima, so that all instances are within 76% of the ground state energy (indicated by shades of blue in Fig. 4a and the histogram in Fig. 4b). While the square lattice can be considered as an easy problem that can be efficiently solved by computer algorithms^{25}, we also evaluate the performance in frustrated lattice structures, where competing spin interactions lead to a disordering and results in more complex ground state patterns. Typically, frustrated lattices can be more challenging to solve due to local energy minima and critical slowing down and thus present a challenge to conventional solvers such as Monte Carlo methods and Hopfield networks^{26,27}. In the following, we consider the Möbius ladder graph, which is a cubic ring graph, where each spin is also connected to its neighbor on the opposite site of the ring. When N/2 is an even number for N spins, competing spin interactions due to the antiferromagnetic coupling to neighboring spins cause lattice frustrations. In Fig. 4c, we show the time evolution of the success rate for a Möbius ladder graph with 100 spins. After 100 iterations, the CIM achieves a success rate of 34%. From the timeseries, we can also observe that the system can escape from the global energy minimum, so that the overall success rate is higher when we consider the total number of instances that have reached the ground state at some point. In this case, the CIM achieves an overall success rate of 59% (indicated by the dotted line in Fig. 4), which is almost three times higher than previously reported values for DOPObased CIMs^{15}. For the distribution of energies, we find that all unsuccessful calculations lie within 90% of the correct ground state energy, which presents a good approximation of the global minimum (see Fig. 4d). Similar or enhanced performance can also be observed for other frustrated graphs. In Fig. 4e and g, we test the success rate to reach the ground state for the triangular lattice and a 2D random lattice. In the triangular lattice, frustrations are caused by coupling of each spin to its six nearest neighbors. This results in various degenerate ground states, which for example relate to the ground state in quantum spin liquids in YbZnGaO_{4} (ref. ^{28}). For a 10 by 10 triangular lattice, the CIM achieves a success rate of 52% after 100 iterations, while almost all other instances are a good approximation at 94% of the ground state energy (see Fig. 4f). In a 2D random lattice, frustrations are caused by randomly choosing between ferromagnetic and antiferromagnetic coupling for each edge. We evaluate the success rate for a randomly generated graph and find that the CIM achieves an overall success rate of 58%. This is an improvement when compared to the success rate reported for DOPObased CIMs, where an average of 28% was reported for various 2D random graphs^{17}. The remaining states all fall within 96% of the correct solution and thus again present a good approximation (see Fig. 4h).
We also investigate how the graph properties influence the success rate of the CIM. For the Moebius ladder graph, we consider the scaling of the overall success rate with the graph size N in Fig. 5a. As the graph size decreases, the success rate quickly increases to around 100% for N ≤ 72 spins. This overall success rate is higher when compared to DOPObased CIMs, where a 100% success rate for the Möbius ladder graphs was reported only for N ≤ 16 spins^{15}. This advantage becomes more pronounced in comparison to classical Hopfield networks, which we have implemented with the Metropolis–Hastings algorithm at low temperatures. In that case, for the smallest graph N = 16, only 34% of 50 independent instances reach the ground state. As the graph size is increased, the success rate for the Hopfield network quickly drops to zero so that no instance is able to find the correct ground state for N = 100. This demonstrates that the CIM can be more efficient in escaping local energy minima. This is also corroborated by the energy histograms in Fig. 4, where all calculations end up in configurations at or very close to the global minimum.
Another important measure which influences the success rate is the density of edges in a graph. For quantum annealing for example, the embedding of dense or complete graphs can be challenging so that the success rate is poor compared to CIMs or classical algorithms^{16}. Here, we consider sparse and dense random graphs, where each node has the same number of randomly distributed links. In Fig. 5b, we show the average success rate for five random graphs with N = 40 spins after 200 iterations as the edge density d is increased from a sparse connectivity to an almost complete graph. We find that the success rate is mostly unaffected by the edge density and reaches over 50% in most instances, which is also comparable to previous results in DOPObased CIMs and significantly more successful than quantum annealing based machines^{16}. It has to be stressed here that the DOPObased CIM applies an annealing scheme in ref. ^{16}, where the system is slowly driven above the gain threshold with a linear annealing schedule. While we observe similar performance without the need for annealing, we expect that the success rate could be further increased at the cost of longer calculation times by adapting the same annealing technique. Overall, our benchmarks demonstrate that the OEObased CIM is capable of finding the optimal solution for various difficult optimization problems and achieves similar or even better performance than current stateoftheart CIMs.
Discussion
We have proposed and implemented a CIM, which is built from a compact optoelectronic feedback system. Compared to quantum annealing devices, our machine benefits from the same advantages as DOPObased CIMs, while having a more compact and more controllable setup. OEObased CIMs do not require an external ring fiber cavity and nonlinear optical processes and the overall footprint and cost can be significantly decreased. As OEOs can be fabricated as photonic integrated circuits^{29,30}, they will enable miniaturization of cheap, fast and fully programmable CIMs. OEObased CIMs also provide a significant enhancement in regard to the overall stability of CIMs. While the phasesensitive setup of DOPObased CIMs can deteriorate performance and requires filtering of the results^{16}, the OEObased machine encodes spins in the light intensity. As a consequence, we can report stable conditions over several hours of operation without the need for active stabilization or additional filtering of results. This increased stability allows to operate the CIM closer to the gain threshold, which results in high success rates. It also opens up CIMs to other fields of study, for example the statistical properties of artificial spin networks with strong injected noise.
The performance of OEObased CIMs as a general solver for optimization problems was demonstrated by solving various difficult MAXCUT problems. We find that the machine is able to find the correct ground state for all graphs, even in the presence of lattice frustrations where simple Hopfield networks are stuck in local energy minima. Compared to DOPObased machines, we can report similar or increased performance in the success rate for all graphs. Similar to DOPObased CIMs, we expect that the overall success rate can be further increased by gradually increasing the feedback and the coupling strength^{16}, which suggests that similar good performance can be expected for various tasks. In terms of computational speed, our system is interesting from different perspectives. On the one hand, as the dynamical equations are significantly simpler compared to those of other CIM systems^{7,21}, they are considerably more efficient to simulate on digital computers and provide a fast general purpose method for solving optimization problems on conventional hardware. On the other hand, the high bandwidth of the optical system allows for computation speeds that can potentially surpass conventional methods. While fast calculation times per iteration are not the focus of our current setup, the compact optical system is designed to be compatible with the fast field programmable gated array (FPGA)based measurementfeedback systems of DOPObased CIMs. By using an FPGA system, ground state searches within only a few milliseconds are possible in the future^{11,15} and further improvements could be achieved by using faster optoelectronic components or sampling from several OEOs in parallel.
Due to the general nature of our proposed system, our work shows that it should be possible to realize similar CIMs with other nonlinear feedback systems. Since the cos^{2} nonlinearity can be approximated with various functions, a realization with analog electronics for example could be easy to implement and provide similar speed. Nonlinear feedback systems as a whole thus become interesting for the study of optimization problems and will be an intriguing alternative to other artificial Ising spin systems. However, the advantages of using an optical feedback system to implement Ising spin networks will prevail in an alloptical setup. Since OEObased CIMs can be implemented as integrated photonic circuits, it will be possible to combine them with the recent development of programmable silicon photonic circuits to realize flexible spin coupling all optically^{31}. This will enable building programmable and energy efficient CIMs as a single photonic integrated circuit and remove the digital I/O system altogether, hence taking full advantage of the high bandwidth of the optical system and yielding a significant speed up over existing CIM concepts. Combining a cheap and compact setup with the performance of DOPObased CIMs, OEObased CIMs thus make CIMs more accessible and promise to overcome important hurdles towards their practical application.
Methods
OEObased CIM
For the OEObased CIM, we employ a single timemultiplexed feedback loop, which was similarly employed to study synchronization phenomena in arbitrary networks^{23}. The coherent signal is emitted from a singlemode wavelengthstabilized DFB laser diode at a wavelength of λ = 1.55 μm. The laser is operated at around two times its threshold current at an optical power of 0.3 mW. The optical signal is transmitted through singlemode optical fibers. To reduce the negative effects of optical feedback to the laser, all optical fibers use angled connectors and an additional optical isolator is inserted directly behind the laser. We use a 13 GHz Lithium Niobate MZM to modulate the optical signal. The angle of polarization for the laser light is adjusted by a polarization controller in front of the modulator. To shift the bias phase Δφ of the modulator, a constant DC bias of \(V_{{\mathrm{bias}}} = \frac{1}{4}V_\pi\) is applied. It has to be noted here that this results in a positive bias of \({\mathrm{\Delta }}\varphi = \frac{\pi }{4}\) instead of a negative bias as in Eq. (2). The cos^{2} is symmetric under change of sign (cos^{2}(Δφ) = cos^{2}(−Δφ)); however, since the slope of cos^{2} is antisymmetric (−2sin(Δφ) = 2sin(−Δφ)), the sign of the feedback strength α and the coupling strength β has to be inverted to implement the correct spin interaction. To relate the coupling and feedback strength in the experiment to α and β, we rescale the voltage signals with the voltage at the bifurcation point obtained in Fig. 2a.
For the signal generation and subsequent sampling, we use an USB data acquisition interface which is coupled to a computer. In the sampling stage, the feedback signal is generated by a 14bit DAC from the stored values of the previous iteration at a sampling rate of 6000 Sa/s. The optical signal from the MZM is detected and transformed to an electrical signal by a photodiode with a 150 MHz bandwidth and sampled at 6000 Sa/s by a 14bit ADC. To ensure synchronous generation and sampling, the data acquisition is triggered by an external signal generator operating at 1 Hz. This results in a computation time of 1 s per iteration. We want to remark that this long computation is primarily due to the data acquisition interface and can be performed much faster with more sophisticated hardware.
During the data acquisition, a network of N spin is generated by timemultiplexing, where the acquisition time is divided into N intervals. The artificial spins are then represented by a piecewise constant function, where each interval consists of 20 samples. To prevent transient effects during the sample generation and the signal detection, only the last value of the 20 samples is used. In the processing stage, the signal is then processed to obtain the spin amplitude x_{n}[k] by digitally subtracting the DC component, which is separately measured before each experiment from the light intensity passing through the modulator without any feedback signal. To calculate f_{n}[k], a matrix multiplication is performed on the spin amplitude x_{n}[k] according to Eq. (3). Due to the low intrinsic noise of the system, additional Gaussian white noise ζ_{n} with a standard deviation of σ_{ζ} = 0.04 is digitally injected. This could likewise be achieved by driving the system closer to the laser threshold or by adding electronic noise.
Analogy between OEObased and DOPObased CIMs
To understand the analogy between DOPObased and OEObased CIMs, we are considering the equations of motion for a DOPObased CIM^{21}:
The equations of motion describe the temporal evolution of the inphase component c_{n} and the quadrature component s_{n} of the optical field of the nth DOPO for a network of N DOPO pulses that circulate in a ring cavity. p refers to the pump parameter, where p = 1 represents the threshold of the pitchfork bifurcation and is thus analogous to the feedback strength α in the OEObased CIM. A_{s} is the saturation amplitude and \(\frac{{{\mathrm{d}}\zeta }}{{{\mathrm{d}}t}}\) is a Gaussian white noise term. The Ising model is implemented by coherently coupling the DOPO pulses. In measurementfeedback based CIMs, this is achieved by measuring the inphase component \(\tilde c_n[k]\) of each DOPO pulse during the roundtrip k with balanced homodyne detection and then using this signal to generate an electronic feedback signal \(\tilde f_n\) that is injected back into the cavity by modulating a train of optical pulses^{11,17}. The homodyne signal \(\tilde c_n\) corresponds to the coherent superposition
where Δφ_{n} is the phase difference between the DOPOs and the local oscillator and β is the coupling strength. For DOPOs, the phase difference is degenerate and can only be Δφ = {0, π}. All phase terms in the coherent superposition thus reduce to cos(Δφ) = ±1, so that the electrical field of the DOPOs is real valued with a positive or negative amplitude. This allows to calculate the coherent superposition inside a FPGA, which generates the feedback signal \(\tilde f_n\):
After performing one roundtrip in the cavity, this signal is injected back into the cavity to implement the coupling. In the equations, this corresponds to adding the feedback signal \(\tilde f_n[k]\) to the inphase component after each roundtrip. During the roundtrip, the time evolution of the DOPOs is given by Eqs. (4) and (5). It is important to mention here that although their general operating principle is different, DOPObased CIMs with purely optical coupling can be described by the same set of equations^{21}.
It has been shown that arbitrary Ising Hamiltonians can be mapped to the dynamics of Eqs (4)–(6)^{21}. In the following, we show that the equations of motion of DOPObased CIMs and OEObased CIMs become analogous when the CIM is operating close to the threshold, so that the Ising model can be mapped to the OEObased CIM in the same way as for DOPObased CIMs. As a first step, we further simplify the equations of motion for the DOPObased CIM. In Eqs. (4) and (5), the noise term is multiplicative, i.e. its amplitude depends on c_{n} and s_{n}. Since the noise amplitude is small compared to the spin amplitude above threshold, variations in the noise amplitude become neglectable so that we use a noise term \(\frac{{\mathrm{{d}}\tilde \zeta _n}}{{{\mathrm{{d}}}t}}\) with a constant amplitude instead. Also above threshold, it is safe to neglect the quadrature component s_{n}. This is reasonable since the feedback signal has no complex component and since Eq. (5) undergoes no bifurcation at p = 1, so that s_{n} always remains below threshold and thus \(c_n \gg s_n\). This leads to the following simplified equation of motion for the inphase component, which is equivalent to the normal form of a pitchfork bifurcation at p = 1 with the two stable fixed points \(c_{2,3}^ \ast = \pm \sqrt {p  1}\):
This continuous differential method can be transformed into a discrete map by approximating it with the Euler method. For a single Euler step c_{n}[k + 1] = c_{n}[k] + hf(t_{n}, c_{n}(t_{n})) with step size h, we assume a large time step of h = 1 that corresponds to performing one entire cavity roundtrip. This assumes that c_{n} only changes slowly during each roundtrip, which is true for DOPOs close to the threshold^{17,32}. Adding the feedback signal after each roundtrip results in the following iterative map:
Using the assumption that the spin amplitude x_{n} is small close to the threshold, we now demonstrate that the equation of motion for OEObased CIMs can be reduced to the same pitchfork normal form. Focusing solely on the behavior close to the threshold (α = p ≈ 1) is a reasonable assumption, since it is well known that CIMs and other gaindissipative systems achieve the highest performance close to the threshold^{13}. We can thus expand the cos^{2} in Eq. (2) as a Taylor series around x_{n} = 0 to the third order. This results in the following expression:
We are assuming that any terms related to selffeedback are in general larger than any terms related to mutual coupling, so that \(\alpha x_n[k] \gg \beta \mathop {\sum}\nolimits_m {J_{mn}} x_m[k]\). While this may not be true for all cases, we will see in the following that it still presents a reasonable approximation close to the threshold. Using this assumption, we neglect the thirdorder terms in the feedback strength. Similarly, any higher orders terms for the noise are disregarded, which leaves us with the following relation:
We find that this corresponds to the approximated DOPO model in Eq. (9). Particularly, the coupling term in the OEO model is the same as the coherent superposition of DOPO pulses in Eq. (6), showing that the output of the MZM approximates the homodyne signal for small spin amplitudes. Similar to the simplified equation of motion for the DOPObased CIM, the simplified OEO model exhibits the same pitchfork at α = 1 with the stable fixed points \(x_{2,3}^ \ast = \pm \sqrt {3/2(\alpha  1)}\). Although the expression for the nonlinear transfer function contains an additional factor in the thirdorder term, we find that it still presents a good approximation close to the threshold. In Fig. 6a, we compare the nonlinear transfer functions for the OEObased CIM (Eqs. (2) and (11)) and the DOPObased CIM (Eq. (9)) close to the threshold at α = p = 1.1 and β = 0 and find that all expressions agree well for all values of the spin amplitude between the fixed points. We also assess the similarities between both models by comparing the time evolution of the spin amplitude x_{n} and the inphase component c_{n} close to the threshold. In Fig. 6b, c, we show the time evolution for a network of 100 uncoupled artificial spins in the OEObased CIM and in the DOPObased CIM at α = p = 1.1 and β = 0. In the upper panel, we show the results from the simulations using the full model while the lower panel contains the results of the simplified Eqs. (9) and (11). For simulation of the full DOPOmodel, we use the same set of parameters as in ref. ^{17}. Comparing the full models with the approximated models, we find that both the OEO models and the DOPO models agree very well. Furthermore, when comparing the dynamics of the OEObased CIM to the DOPObased CIM, we find that they are almost indistinguishable. In all models, we can observe the spin states bifurcating to the same fixed points at very similar timescales. Due to the demonstrated analogy of the equations of motion, it can thus be shown that an OEObased CIM operates analogous to a DOPObased CIM, which is for example also reflected in the domain dynamics that we observe for the 2D Ising model in Fig. 3. An OEObased CIM thus possesses the same capability to implement arbitrary Ising Hamiltonians as its DOPObased counterpart, which is also supported by our benchmarks.
Monte Carlo simulations
The Monte Carlo simulations were performed using the Metropolis–Hastings algorithm, which is a local update method. For each iteration, a single spin is flipped and the change in energy ΔE is considered. If the energy decreases, the spin remains flipped. If the energy increases, the spin remains flipped with a probability of
The spins are flipped sequentially in a typewriter ordering, which is known to be effective for 2D graphs. We also checked the success rate to reach the ground state with a random update order and found that the method performs worse in terms of success rate and calculation time. To implement a Hopfield network, we have set the temperature to T = 0.01. At this low temperature, the update mechanism only flips a spin if the overall energy decreases, which is identical to the deterministic update rule of Hopfield networks. To reach the lowest energy state, 300,000 iterations were performed for each simulation.
To verify the ground states found by the CIM, we have also implemented simulated annealing by gradually decreasing the temperature of the Metropolis–Hastings algorithm at each iteration k. We have applied an exponential temperature schedule T[k] = 2 exp(−0.0001 k) and simulated the spin network until the energy remained unchanged. For long annealing times, it is known that simulated annealing can converge to the global minimum.
Data Availability
The authors declare that all relevant data are included in the manuscript. Additional data are available from the corresponding author upon reasonable request.
References
Garey, M. & Johnson, D. S. Computers and Intractability; A Guide to the Theory of NPCompleteness. (W. H. Freeman & Co., New York, NY, USA, 1990).
Lucas, A. Ising formulations of many NP problems. Front. Phys. 2, 5 (2014).
Johnson, M. et al. Quantum annealing with manufactured spins. Nature 473, 194–198 (2011).
Salathé, Y. et al. Digital quantum simulation of spin models with circuit quantum electrodynamics. Phys. Rev. X 5, 021027 (2015).
Barends, R. et al. Digitized adiabatic quantum computing with a superconducting circuits. Nature 534, 222–226 (2016).
Kim, K. et al. Quantum simulation of frustrated Ising spins with trapped ions. Nature 465, 590–593 (2010).
Utsonomiya, S., Takata, K. & Yamamoto, Y. Mapping of Ising models onto injectionlocked laser systems. Opt. Express 19, 18091–18108 (2011).
Wang, Z., Marandi, A., Wen, K., Byer, R. L. & Yamamoto, Y. Coherent Ising machines based on degenerate optical parametric oscillators. Phys. Rev. A 88, 063853 (2013).
Yamaoka, M. et al. A 20kspin Ising chip to solve combinatorial optimization problems with CMOS annealing. IEEE J. SolidState Circuits 51, 303–309 (2016).
Denchev, V. S. et al. What is the computational value of finiterange tunneling? Phys. Rev. X 6, 031015 (2016).
Inagaki, T. et al. A coherent Ising machine for 2000node optimization problems. Science 354, 603–606 (2016).
Yamamoto, Y. et al. Coherent Ising machines—optical neural networks operating at the quantum limit. npj Quantum Inf. 3, 49 (2017).
Leleu, T., Yamamoto, Y., Utsunomiya, S. & Aihara, K. Combinatorial optimization using dynamical phase transitions in driven dissipative systems. Phys. Rev. E 95, 022118 (2017).
Utsunomiya, S. et al. Binary phase oscillations of two mutually coupled semiconductor lasers. Opt. Express 23, 6029–6040 (2015).
McMahon, P. L. et al. A fully programmable 100spin coherent Ising machine with alltoall connections. Science 354, 614–617 (2016).
Hamerly, R. et al. Experimental investigation of performance differences between Coherent Ising machines and a quantum annealer. Sci. Adv. 5, eaau0823 (2019).
Böhm, F. et al. Understanding dynamics of coherent Ising machines through simulation of largescale 2D Ising models. Nat. Commun. 9, 5020 (2018).
Haribara, Y., Ishikawa, H., Utsunomiya, S., Aihara, K. & Yamamoto, Y. Performance evaluation of coherent Ising machines against classical neural networks. Quantum Sci. Technol. 2, 044002 (2017).
Takesue, H., Inagaki, T., Inaba, K., Ikuta, T. & Honjo, T. Largescale coherent Ising machine. J. Phys. Soc. Jpn. 88, 061014 (2019).
Larger, L. Complexity in electrooptic delay dynamics: modelling, design and applications. Philos. Trans. R. Soc. 371, 20120464 (2010).
Haribara, Y., Aihara, K. & Yamamoto, Y. Computational principle and performance evaluation of coherent Ising machines based on degenerate optical parametric oscillators. Entropy 18, 151 (2016).
Murphy, T. E. et al. Complex dynamics and synchronozation of delayedfeedback nonlinear oscillators. Philos. Trans. R. Soc. A 368, 343–366 (2010).
Hart, J. D., Schmadel, D. C., Murphy, T. E. & Roy, R. Experiments with arbitrary networks in timemultiplexed delay systems. Chaos 27, 121103 (2017).
Hamerly, R. et al. Topological defect formation in 1D and 2D spin chains realized by network of optical parametric oscillators. Int. J. Mod. Phys. B 30, 1630014 (2016).
Khoshbakht, H. & Weigel, M. Domainwall excitations in the twodimensional Ising spin glass. Phys. Rev. B 97, 064410 (2018).
Landau, D., Tang, S. & Wansleben, S. MonteCarlo studies of dynamical critial phenomena. J. Phys. Colloq. 49, 1525–1529 (1988).
Chowdhury, D. Spin Glasses and Other Furstrated Systems (Princeton University Press, Princeton, NJ, USA, 1986).
Ma, Z. et al. Spinglass ground state in a triangularlattice compound YbZnGaO4. Phys. Rev. Lett. 120, 087201 (2018).
Zhang, W. & Yao, J. Silicon photonic integrated optoelectronic oscillator for frequencytunable microwave generation. J. Light Technol. 36, 4655–4663 (2018).
Tang, J. et al. Integrated optoelectronic oscillator. Opt. Express 26, 12257–12265 (2018).
Chen, X. et al. Towards an optical FPGA—programmable silicon photonic circuits. Preprint at https://arxiv.org/abs/1807.01656 (2018).
Inagaki, T. et al. Largescale Ising spin network based on degenerate optical parametric oscillators. Nat. Photon. 10, 415–419 (2016).
Acknowledgements
We acknowledge financial support from the Research Foundation Flanders (FWO) a.o. under the grants G028618N and G029519N, the Hercules Foundation, and the Research Council of the Vrije Universiteit Brussel. We would like to thank Ann Dooms for the helpful discussions during the writing of the manuscript.
Author information
Authors and Affiliations
Contributions
F.B. performed the experiments and analyzed the data. F.B., G.V. and G.V.d.S discussed the results and wrote the paper.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Peer review information: Nature Communications thanks the anonymous reviewer(s) for their contribution to the peer review of this work.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Böhm, F., Verschaffelt, G. & Van der Sande, G. A poor man’s coherent Ising machine based on optoelectronic feedback systems for solving optimization problems. Nat Commun 10, 3538 (2019). https://doi.org/10.1038/s41467019114843
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467019114843
This article is cited by

Observation of distinct phase transitions in a nonlinear optical Ising machine
Communications Physics (2023)

Bifurcation behaviors shape how continuous physical dynamics solves discrete Ising optimization
Nature Communications (2023)

Recent progress on coherent computation based on quantum squeezing
AAPPS Bulletin (2023)

A 1,968node coupled ring oscillator circuit for combinatorial optimization problem solving
Nature Electronics (2022)

Multidimensional hyperspin machine
Nature Communications (2022)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.