# Quantum annealing with all-to-all connected nonlinear oscillators

## Abstract

Quantum annealing aims at solving combinatorial optimization problems mapped to Ising interactions between quantum spins. Here, with the objective of developing a noise-resilient annealer, we propose a paradigm for quantum annealing with a scalable network of two-photon-driven Kerr-nonlinear resonators. Each resonator encodes an Ising spin in a robust degenerate subspace formed by two coherent states of opposite phases. A fully connected optimization problem is mapped to local fields driving the resonators, which are connected with only local four-body interactions. We describe an adiabatic annealing protocol in this system and analyse its performance in the presence of photon loss. Numerical simulations indicate substantial resilience to this noise channel, leading to a high success probability for quantum annealing. Finally, we propose a realistic circuit QED implementation of this promising platform for implementing a large-scale quantum Ising machine.

## Introduction

Many hard combinatorial optimization problems arising in diverse areas such as physics, chemistry, biology and social science1,2,3,4 can be mapped onto finding the ground state of an Ising Hamiltonian. This problem, referred to as the Ising problem, is in general NP-hard5. Quantum annealing, based on adiabatic quantum computing (AQC)6,7, aims to find solutions to the Ising problem, with the hope of a significant speedup over classical algorithms. In AQC, a system is evolved slowly from the non-degenerate ground state of a trivial initial Hamiltonian to that of a final Hamiltonian encoding a computational problem. During the time-evolution, the energy spectrum of the system changes and, for the adiabatic condition to be satisfied, the evolution must be slow compared to the inverse minimum energy gap between the instantaneous ground state and the excited states. The scaling behaviour of the gap with problem size, thus, determines the efficiency of the adiabatic annealing algorithm.

In order to perform quantum annealing, the Ising spins are mapped to two levels of a quantum system, that is, a qubit, and the optimization problem is encoded in the interactions between these qubits. Adiabatic optimization with a variety of physical realizations such as nuclear magnetic spins8 and superconducting qubits9,10 has been demonstrated. However, despite great efforts, whether these systems are able to solve large problems in the presence of noise remains an open question11. As a consequence, it is imperative to search for implementations with improved resilience to noise.

A general Ising problem is defined on a fully connected graph of Ising spins. However, efficient embedding of large problems with such long-range interactions is a challenge because physical systems more naturally realize local connectivity. In one approach, a fully connected graph of Ising spins is embedded in a so-called Chimera graph12,13. Alternatively, a more recent embedding scheme was proposed by Lechner, Hauke and Zoller (LHZ)14 in which N logical Ising spins are encoded in M=N(N−1)/2 physical spins with MN+1 constraints. Each physical spin represents the relative configuration of a pair of logical spins. An all-to-all connected Ising problem in the logical spins is realized by mapping the logical couplings onto local fields acting on the physical spins and a problem-independent four-body coupling to enforce the constraints. This simple design requires only precise control of local fields, making it attractive for scaling to large problem sizes.

In the following, we present a physical platform for quantum annealing that is both scalable and shows robustness to noise; here we propose to encode the Ising problem in a network of two-photon-driven Kerr-nonlinear resonators (KNR). In our scheme, a single Ising spin is mapped to two coherent states with opposite phases, which constitute a two-fold degenerate eigenspace of the two-photon-driven KNR in the rotating frame of the drive15. Here we propose to realize quantum adiabatic algorithms by encoding a quantum spin in quasi-orthogonal coherent states. The dominant source of error in this system is single-photon loss from the resonators. However, since coherent states are invariant under the action of the photon jump operator, the encoded Ising spin is stabilized against bit flips. We describe a circuit QED implementation of a quantum annealing platform, where a fully connected graph of Ising spins is embedded using the LHZ scheme, relying on effective local magnetic fields and four-body coupling between KNRs. The adiabatic optimization is carried out by initializing the resonators to vacuum, and varying only single-site drives to adiabatically evolve the system to the ground state of the embedded Ising problem. This realization allows us to encode arbitrary Ising problems with no restriction on connectivity, or on the signs and amplitudes of the spin–spin couplings.

Encoding Ising spins in the phase of coherent states has previously been explored in the context of classical Ising machines16,17,18,19,20,21. The quantum case was considered in ref. 22. However, this previous study focussed on idealized quantum systems without noise analysis and did not consider practical implementations of these ideas. In contrast, our analysis considers the performance of quantum annealing in the presence of single-photon loss, by far the dominant loss mechanism. Crucially, we numerically demonstrate that the probability for the system to jump from the instantaneous ground state to one of its excited states due to photon loss during the adiabatic protocol is greatly suppressed as compared to conventional qubit implementations with equal noise strengths. This resilience to the detrimental effects of photon loss leads to high success probabilities in finding the optimal solution to optimization problems mapped on two-photon-driven KNRs. This noise resilience, in combination with simple initialization and final state detection by homodyne measurement of the resonators’ field amplitudes, opens the door to realizing a large-scale quantum annealer with favourable noise resistance.

## Results

### Adiabatic protocol for quantum annealing

Quantum annealing is executed with the time-dependent Hamiltonian

where is the initial trivial Hamiltonian whose ground state is known, and is the final Hamiltonian at t=τ which encodes an Ising spin problem: . Here, is the Pauli-z matrix for the ith spin and Ji,j is the interaction strength between the ith and jth spin. Crucially, the initial and final Hamiltonian do not commute. For simplicity, we have assumed a linear time dependence, but more complex annealing schedules can be used. The system, initialized to the ground state of , adiabatically evolves to the ground state of the problem Hamiltonian, , at time , where Δmin is the minimum energy gap6.

### Single spin in a two-photon-driven Kerr-nonlinear resonator

The Hamiltonian of a two-photon driven KNR in a frame rotating at the drive frequency is given by , where K is the Kerr-nonlinearity and the strength of the two-photon drive. In a KNR, the coherent states , which are eigenstates of the photon annihilation operator, are stabilized by the two-photon drive with (ref. 15). This statement can be visualized more intuitively by considering the metapotential obtained by replacing the operators and with the complex classical variables x+iy and xiy in the expression for (ref. 23). As shown in Fig. 1a, this metapotential is an inverted double well with two peaks of equal height at (±α0, 0), corresponding to two stable points (see Supplementary Note 1). This is consistent with the quantum picture according to which the coherent states are two degenerate eigenstates of with eigenenergy (ref. 15) (see Methods). Taking advantage of this well-defined two-state subspace, we choose to encode an Ising spin in the stable states . Importantly, this mapping is robust against single-photon loss from the resonator when the rate of single-photon loss is small , a condition than can readily be realized in superconducting circuits15. Moreover, the photon jump operator leaves the coherent states invariant . As a result, if the amplitude α0 is large such that , a single-photon loss does not lead to a spin-flip error.

Having defined the spin subspace, we now discuss the realization of a problem Hamiltonian in this system. As an illustrative example, we first address the trivial problem of finding the ground state of a single spin in a magnetic field. Consider the Hamiltonian of a two-photon-driven KNR with an additional weak single-photon drive of amplitude , . As illustrated in Fig. 1b for small , under this drive, the two peaks located at (±α0, 0) in the metapotential associated to are now of unequal height with the peak at (−α0, 0) lower than the one at (α0, 0) if , and vice versa for . These two states remain stable, but have different energies, indicating that the single-photon drive induces an effective magnetic field on the Ising spins . Indeed, a full quantum analysis shows that if , then remain the eigenstates of but their degeneracy is lifted by (ref. 15). In other words, in the spin subspace, can be expressed as , with . This is the required problem Hamiltonian for a single spin in a magnetic field. This simple observation will play an essential role in the implementation of the LHZ scheme discussed below. Note that for larger , the eigenstates can deviate from coherent states (see Supplementary Note 2). Choosing , however, ensures that are indeed coherent states to an excellent approximation, such that and the encoded subspace remains well protected from the photon loss channel.

Following equation (1), we require an initial Hamiltonian which does not commute with the final problem Hamiltonian and which has a simple non-degenerate ground state. This is achieved by introducing a finite detuning δ0>0 between the drives and resonator frequency. In a frame rotating at the frequency of the drives, the initial Hamiltonian is chosen as with δ0<K. This choice of initial Hamiltonian generates large phase fluctuations that helps maximize quantum tunnelling to states with well-defined phase at the final stages of the adiabatic evolution. In this frame, the ground and first excited states are the vacuum and single-photon Fock state , respectively, and which are separated by an energy gap δ0. If a photon is lost from the resonator, the excited state decays to the ground state which, on the other hand, is invariant under photon loss. Since it is simple to prepare in the superconducting circuit implementation that we consider below, the vacuum state is a natural choice for the initial state.

The time-dependent Hamiltonian required for the adiabatic computation can be realized by slowly varying the two- and single-photon drive strengths and detuning so that , realizing equation (1) for a single-spin. Note that the form of conveniently ensures that the nonlinear Kerr term is time-independent. The time-dependent detuning is achieved by tuning the single- and two-photon drive frequencies (see Methods). By adiabatically controlling the frequency and amplitude of the drives it is possible to evolve the state of the KNR from the vacuum at t=0, to the ground state of a single Ising spin in a magnetic field at t=τ. Figure 2a shows the change of the energy landscape throughout this evolution found by numerically diagonalizing the instantaneous Hamiltonian for , α0=2, and δ0=0.2K. The minimum energy gap Δmin is indicated. As illustrated by the Wigner functions in Fig. 2b, a resonator initialized to the vacuum state at t=0 evolves through highly non-classical and non-Gaussian states towards the ground state at t=τ, with in this example. If, on the other hand, the KNR is initialized to the single-photon Fock state at t=0, then it evolves to the first excited state at t=τ. The average probability to reach the correct ground state is 99.9% for both and . The 0.1% probability of erroneously ending in the excited state arises from non-adiabatic errors and can be reduced by increasing the evolution time. For example, for τ=60/Δmin we find a success probability of 99.99%.

### Effect of single-photon loss

An appealing feature of this implementation is that, at the start of the adiabatic protocol, the ground (vacuum) state is invariant under single-photon loss. Similarly, at the end of the adiabatic protocol at t=τ, irrespective of the problem Hamiltonian (that is, or ) the ground state (coherent states or ) is also invariant under single-photon loss. It follows that towards the beginning and end of the protocol, photon loss will not induce errors. Moreover, we find that, even at intermediate times 0<t<τ, the ground state of remains largely unaffected by photon loss. This can be understood intuitively from the distortion of the metapotential, as shown in Fig. 2c at t=0.2τ for the same parameters as Fig. 2a. While the metapotential still shows two peaks, the region around the lower peak (corresponding to the ground state) is a circle whereas that around the higher peak (corresponding to the excited state) is deformed. This suggests that the ground state is closer to a coherent state and, therefore, more robust to photon loss than the excited state (see also Supplementary Note 3). Quantitatively, the effect of single-photon loss is seen by numerically evaluating24,25 the transition matrix elements , for the duration of the protocol, where and are the ground and excited state of respectively. As shown in Fig. 2d, the transition from the ground to excited state is greatly suppressed throughout the whole adiabatic evolution. This asymmetry in the transition rates distinguishes AQC with two-photon-driven KNRs from implementations with qubits26, something that will be made even clearer below with examples.

### Two coupled spins with driven KNRs

Before going to larger lattices, consider the problem of two interacting spins embedded in a system of two linearly coupled KNRs, each driven by a two-photon drive and given by the Hamiltonian . Here, J1,2 is the amplitude of the single-photon exchange coupling and, for simplicity, the two resonators are assumed to have identical parameters. For small J1,2, this Hamiltonian can be expressed in the basis as the problem Hamiltonian15 The nature of the interaction is encoded in the phase of the coupling with J1,2<0 (J1,2>0) corresponding to the ferromagnetic (anti-ferromagnetic) case. For the initial Hamiltonian, we take and, following equation (1), the full time-dependent Hamiltonian for the two-spin problem is . Although it is possible to tune these parameters in time, with the above form of , both the linear coupling and the Kerr-nonlinearity are fixed throughout the adiabatic evolution.

The ground state of is the vacuum state if the initial detuning is greater than the single-photon exchange rate, δ0>J1,2. On the other hand, at t=τ, the two degenerate ground states for anti-ferromagnetic (ferromagnetic) coupling are . Accordingly, numerical simulations with both resonators initialized to vacuum show the coupled system to reach the entangled state and , under anti-ferromagnetic and ferromagnetic coupling, respectively. In these expressions, is a normalization constant. With the realistic parameters τ=50/Δmin, δ0=K/4, J1,2=K/10 and , corresponding to , the state fidelity is 99.9%. Moreover, the probability that the system is in any one of the states is 99.99%, showing that the evolution is to a very good approximation restricted to this computational subspace.

While the states used in this encoding are tolerant to photon loss, coherence between a superposition of those states is reduced. However the success probability (see Methods) in solving the Ising problem remains high as it depends only on the diagonal elements of the density matrix (for example, ). As an illustration, with the large loss rate κ=50/τ, while the fidelity of the final state to the desired superposition or decreases to 37.6%, the average success probability of the algorithm is 75.2%.

To characterize the effect of noise, a useful figure of merit is the ratio Δmin/κ of the minimum energy gap to the loss rate. The dependence of the average success probability on this ratio is presented in Fig. 3 for the algorithm implemented using KNRs (green squares) with single-photon loss κ or qubits (red squares) with pure dephasing γφ. In practice, the average success probability is computed by varying the loss rates at fixed Δmin and τ=20/Δmin, and is averaged over all instances of the problem of two coupled spins (that is, ferromagnetic and anti-ferromagnetic). In the presence of pure dephasing, the success probability with qubits saturates to 50% for large γφ. This is a consequence of the fact that the steady state of the qubits is an equal weight classical mixture of all possible computational states. On the other hand, for KNRs with a finite κ, the rate at which the instantaneous ground state jumps to the excited state () is small compared to the rate at which the instantaneous excited state jumps to the ground state (). As a result, even with large single-photon loss rate, for example , the success probability is 75%. Consequently, in the presence of equivalent strength noise, a two-photon-driven KNR implementation of AQC has superior performance compared to a qubit implementation (see Methods for details).

### All-to-all connected Ising problem with the LHZ scheme

The above scheme can be scaled up with pairwise linear couplings in a network of KNRs, while still requiring only single-site drives. However, unlike the above one- and two-spin examples, most optimization problems of interest require controllable long-range interactions between a large number of Ising spins. Realizing such highly non-local Hamiltonian is a challenging hardware problem, but it may be solved by embeddings such as the LHZ scheme14 that map the Ising problem on a graph with local interactions only. In this approach, the relative configuration of pairs of N logical spins is mapped to M=N(N−1)/2 physical spins. A pair of logical spins, in which both spins are aligned |0, 0〉 or |1, 1〉 (or anti-aligned |0, 1〉 or |1, 0〉), is mapped on the two levels of the physical spin. The coupling between the logical pairs Ji,j (i=1, ..N) is encoded in local magnetic fields on the physical spins Jk (k=1, …, M). For a consistent mapping, MN+1 energy penalties in the form of four-body coupling are introduced to enforce an even number of spin-flips around any closed loop in the logical spins. It was shown in ref. 14 that a fully connected graph can then be encoded in a planar architecture with only local connectivity. The problem Hamiltonian in the physical spin basis becomes , where denotes the nearest-neighbour spins enforcing the constraint.

We now describe a circuit QED platform implementing the LHZ scheme by embedding the physical spins in the eigenbasis of two-photon-driven KNRs. In practice, KNRs can be realized as a superconducting microwave resonator terminated by a flux-pumped SQUID. The non-linear inductance of the SQUIDs induces a Kerr-nonlinearity, and a two-photon drive is introduced by flux-pumping at twice the resonator frequency. This is the exact same setup that is used to realize Josephson parametric amplifiers (JPAs), and we will therefore refer to this implementation of a KNR as a JPA in the following15,27,28,29. We envision a quantum annealing platform to be built with groups of four JPAs of frequencies ωr,i (i=1, 2, 3, 4) interacting via a single Josephson junction (JJ) as illustrated in Fig. 4a. In the figure, the four different frequencies of the resonators are indicated by four different colours. To realize a time-dependent two-photon drive, the SQUID loop of each JPA is driven by a flux pump with tunable amplitude and frequency. The pump frequency is varied close to twice the resonator frequency, (see Methods). Additional single-photon drives, whose amplitude and frequency can be varied in time, are also applied to each of the JPAs and play the role of effective local magnetic fields. Local four-body couplings are realized through the nonlinear inductance of the central JJ (see Supplementary Note 5). Choosing ωp,k(t)+ωp,l(t)=ωp,m(t)+ωp,n(t) and taking the resonators to be detuned from each other, the central JJ induces a coupling of the form in the instantaneous rotating frame of the two-photon drives. This four-body interaction is an always-on coupling and its strength C is determined by the JJ nonlinearity. Such a group of four JPAs, which we will refer to as a plaquette, is the central building block of our architecture and can be scaled in the form of the triangular lattice required to implement the LHZ scheme14. Note that while JPAs within a plaquette have different frequencies, only four distinct JPA frequencies are required for the entire lattice as illustrated in Fig. 4c. Lastly, the LHZ scheme also requires additional N−2 physical spins at the boundary that are fixed to the up state and which are implemented in our scheme as JPAs stabilized in the eigenstate by two-photon drives. As an illustration, Fig. 4b depicts all the possible interactions in an Ising problem with N=5 logical spins and Fig. 4c shows the corresponding triangular network of coupled JPAs. To implement the adiabatic protocol for a general N-spin Ising problem with the triangular network of M JPAs, the time-dependent Hamiltonian in a frame where each of the JPAs rotate at the instantaneous drive frequency can be written as

where

As mentioned above, M=N(N−1)/2 while Jk is the single-photon drive which induces the local effective magnetic field on the kth resonator and C is the local four-body coupling between the resonators. A final necessary component for a quantum annealing architecture is readout of the state of the physical spin. Here, this is realized by standard homodyne detection which can resolve the two coherent states allowing the determination of the ground state configuration of the spins.

In order to demonstrate the adiabatic algorithm for a non-trivial case, we embed on a plaquette a simple three-spin frustrated Ising problem, in which the spins are anti-ferromagnetically coupled to each other, with J>0. This Hamiltonian has six degenerate ground states in the logical spin basis. Following the LHZ approach, a mapping of N=3 logical spins requires M=3 physical spins (in our case three JPAs) and one physical spin fixed to up state (in our case a JPA initialized to the stable eigenstate ). Since the physical spins encoded in the JPAs constitute the relative alignment of the logical spins, there are three possible solutions in this basis: , and . The time-dependent Hamiltonian for the adiabatic protocol then follows from equation (2) with M=3. The anti-ferromagnetic coupling between the logical spins is represented by the single-photon drives on each JPA with amplitude Jk=J>0. At t=0, the ground state of this Hamiltonian is the vacuum . For appropriate magnitude of the four-body coupling (see Supplementary Note 4), the problem Hamiltonian can be expressed as with . This realizes the required problem Hamiltonian in the LHZ scheme .

To illustrate the performance of this protocol, we numerically simulate the evolution subjected to the Hamiltonian of equation (2) with the three resonators initialized to vacuum and the fourth initialized to the state . With , , J=0.095K, C=0.05K, τ=40/Δmin and κ=0, we find that the success probability to reach the ground state to be 99.3%. The reduction in fidelity arises from the non-adiabatic errors. The probability for the system to be in one of the states is 99.98% indicating that, with high accuracy, the final state is restricted to this subspace. Figure 5a shows the dependence of the success probability on single-photon loss rate (green). It also presents the success probability when the algorithm is implemented with qubits (red) subjected to dephasing noise (see Methods). Again, we find that, in the presence of equal strength noise, the adiabatic protocol with JPAs (or two-photon-driven KNRs) has superior performance with respect to qubits. Figure 5b also shows the success probability for the same problem but without using the LHZ embedding, that is, when the three KNRs (green) or qubits (red) are directly coupled to each other via a two-body interaction of the form with J>0 (see Methods). As with embedding, the success probability with KNRs is higher than with qubits for equal strength noise. For the particular example considered here, the degeneracy of the ground state is higher in the un-embedded problem (six) than for the embedded problem (three). As a result, the likelihood to remain in one of the ground states increases and, in the presence of noise, the un-embedded problem performs slightly better than the embedded problem. These examples of simple frustrated three-spin problems demonstrate the performance of a single plaquette. Embedding of large Ising problems requires more plaquettes connected together as shown in Fig. 4. Even in such a larger lattice, each JPA is connected to only four other JPAs, making it likely that the final state remains restricted to the encoded subspace spanned by the states , .

## Discussion

We have introduced an adiabatic protocol performing quantum annealing with all-to-all connected Ising spins in a network of non-linear resonators with only local interactions. We have analysed the performances of this annealer in the presence of single-photon loss and shown that the success probability is considerably higher compared to qubits with same amount of loss. Although the implementation of the LHZ scheme has been explored here, other embeddings schemes such as minor embedding could be realized by taking advantage of single-photon exchange and the corresponding two-body couplings that it results in. A distinguishing feature of our scheme is that the spins are encoded in continuous-variable states of resonator fields. The restriction to two approximately orthogonal coherent states only happens in the late stage of the adiabatic evolution, and in general each site must be treated as a continuous variable system displaying rich physics, exemplified by non-Gaussian states, with negative-valued Wigner functions. Because the negativity of the Wigner function is directly related to classical non-simulability30,31,32, how this behaviour persists in the presence of photon loss with increasing problem sizes is an interesting question.

Another promising avenue to explore is how the continuous variable nature of our system influences the annealer’s computational capabilities as compared to more conventional approaches based on two-level systems evolving under a transverse field Ising Hamiltonian, that is, where equation (1) is built from and (refs 9, 33). For instance, we showed how the nature of the quantum fluctuations around the instantaneous ground and excited states leads to increased stability of the ground state. As the size of the system increases, these continuous variable states might alter the nature of phase transitions during the adiabatic evolution, something which may lead to changes in computational power34,35. It is also worth pointing out that our circuit QED implementation easily allows for adding correlated phase fluctuations given by interaction terms like (see Supplementary Note 6). These terms do not affect the energy spectrum of the encoded problem Hamiltonian, but may modify the scaling of the minimal gap during the annealing protocol.

Yet another appealing feature that motivates further study is that the time-dependent Hamiltonian of KNRs is generically non-stoquastic in the number basis. A stoquastic Hamiltonian by definition only has real, non-positive off-diagonal entries36, and the Hamiltonians in this class are directly amenable to quantum Monte Carlo simulations (stoquastic Hamiltonians do not have the so-called ‘sign problem’). As an example, the transverse field Ising Hamiltonian, which is the focus of much current experimental efforts9,33, is stoquastic. In contrast, the Hamiltonian of our system has off-diagonal terms in the LHZ embedding (or if this embedding is not used) with problem-dependent signs (note that simply mapping does not solve the problem due to the presence of the quartic terms equation (2)). The same is true if one considers matrix elements in the over-complete basis of coherent states. Non-stoquasticity has been linked to exponential speedups in quantum annealing37, and is widely believed to be necessary to gain more than constant speedup over classical devices38.

Ultimately, further investigation into the performance of our adiabatic protocol on larger problem sizes is warranted. Currently, the large Hilbert space size prevents numerically exact simulations with more than a few resonators. Nonetheless, the results here strongly suggest that the adiabatic protocol with two-photon-driven KNRs has excellent resistance to photon loss and thermal noise. Together with the highly non-classical physics displayed during the adiabatic evolution, this motivates the realization of a robust, scalable quantum Ising machine based on this architecture. After completing this work, we became aware of an alternative approach to quantum annealing with Kerr parametric oscillator39.

## Methods

### Eigen-subspace of a two-photon-driven KNR

Following ref. 15, the Hamiltonian of the two-photon-driven KNR can be expressed as

This form makes it clear that the two coherent states , which are the eigenstates of the annihilation operator , are also degenerate eigenstates of equation (4) with energy .

### Time-dependent Hamiltonian in the instantaneous rotating frame

We describe the required time-dependence of the amplitude and frequency of the drives to obtain the time-dependent Hamiltonians needed for the adiabatic protocol. As an illustration, consider the example of a two-photon-driven KNR with additional single-photon drive whose Hamiltonian is written in the laboratory frame as

Here, ωr is the fixed KNR frequency and ωp(t) is the time-dependent two-photon drive frequency. The frequency of the single-photon drive, of amplitude , is chosen to be ωp(t)/2 such that it is on resonance with the two-photon drive. In a rotating frame defined by the unitary transformation , this Hamiltonian reads

Choosing the time dependence of the drive frequency as ωp(t)=2ωr−2δ0(1−t/2τ), and the drive strengths as and , the above Hamiltonian simplifies to

This has the standard form of a linear interpolation between an initial Hamiltonian and a problem Hamiltonian that is required to implement the adiabatic protocol.

As a second illustration, the time-dependent Hamiltonian for finding the ground state of a frustrated three-spin problem embedded on a plaquette is

where ωr,k are the fixed resonator frequencies and ωp,k(t) the time-dependent two-photon drive frequencies. The resonators labelled k=1, 2 and 3 are driven by time-dependent two-photon and single-photon drives of strengths , J(t) and frequency ωp,k(t), ωp,k(t)/2, respectively. On the other hand, the frequency and strength of the two-photon drive on the k=4 resonator is fixed. Applying the unitary leads to the transformed Hamiltonian

To realize equation (2) implementing the adiabatic algorithm on this plaquette, we choose the drive frequencies such that ωp,k(t)=2ωr,k−2δ0(1−t/2τ) and ωp,4=2ωr,4, with their sum respecting ωp,1(t)+ωp,2(t)=ωp,3(t)+ωp,4. Moreover, we take the time-dependent amplitudes and J(t)=Jt/τ.

### Estimation of success probability:

To estimate the success probability of the adiabatic algorithm with KNRs, as shown by the green squares in Fig. 3, we numerically simulate24,25 the master equation , where photon loss is accounted for by the Lindbladian . It is important to keep in mind that even though the energy gap is small in the rotating frame, the KNRs laboratory frame frequencies ωr,k are by far the largest energy scale. As a result, the above standard quantum optics master equation correctly describes damping in this system40. Moreover, because we are working with KNR frequencies in the GHz range, as is typical with superconducting circuits, thermal fluctuations are negligible. From this master equation, the success probability can be evaluated as the probability of occupation of the correct ground state at the final time t=τ, that is, and for and , respectively.

On the other hand, the master equation used to simulate the adiabatic algorithm with qubits is where

Here, and are Pauli operators in the computational basis formed by the ground and excited state of the ith qubit. In these simulations, the qubits are initialized to the ground state of the initial transverse field, and the success probability (red squares in Fig. 3) is computed as the probability of occupation of the correct ground state at t=τ, that is, and for J>0 and J<0, respectively.

Finally, to obtain the data for the resonators in Fig. 5 (green squares), the simulated master equation is while, for qubits, it is . In these expressions,

The success probability is computed as the probability of occupation of the correct ground state at t=τ, that is, (green squares in Fig. 5) and (red squares in Fig. 5).

### Two paradigms of quantum annealing

The KNR-based quantum annealer proposed in this paper is based on an adiabatic non-equilibrium evolution, where the system is subject to driven and dissipative processes. This is in stark contrast to the conventional approach to quantum annealing, where a quantum system is at all times in thermal equilibrium at very low temperature such that it stays close to the ground state, as Hamiltonian parameters are adiabatically varied1. It is crucial to understand the very different roles played by the bath, modelling the environment of the annealer, in these two different approaches. In the conventional approach, as long as the temperature is sufficiently low compared to the energy gap, the thermal population of the first excited state is negligible and the system is effectively in its ground state. In fact, for large gaps, the coupling to the environment typically helps the annealer by constantly cooling the system towards its ground state. On the other hand, the bath becomes detrimental and will typically lead to large errors as soon as . Since the gap decreases exponentially with problem size for hard problems, this is a major roadblock for conventional quantum annealing. Even for easier problems when the gap closes polynomially, it quickly becomes extremely challenging to go to large system sizes.

The type of non-equilibrium quantum annealer considered in the present paper overcomes this roadblock, but trades the difficulty for a related but different challenge. The crucial point is that although the gap is small in the rotating frame where the annealing schedule is realized, the system still probes the environment at a very high frequency. All coupling and interaction terms in the Hamiltonian are effectively small perturbations of the resonator’s bare Hamiltonian , such that the energy cost of adding a thermal photon is to a very good approximation ωr, giving a negligible thermal population, Nth=exp(−ωr/kBT), for typical frequencies in the 5–15 GHz range and temperatures T10 mK. This is also the justification for the master equations used when computing the success probabilities Figs 3 and 5.

Although thermal noise is no longer a bottleneck for this type of non-equilibrium quantum annealing, another challenge now arises. Since the system is not in equilibrium, the eigenstates of the rotating frame Hamiltonian are not global eigenstates of the total system, including the bath, and the interaction with the bath therefore does not generically drive the system towards the rotating-frame ground state, even at zero temperature (see Supplementary Note 3). This leads to local dephasing noise for the KNR implementation due to resonator photon loss. We emphasize that when comparing to a qubit implementation in Figs 3 and 5, we are comparing to an analogous implementation where the qubits are also only subjected to local dephasing noise, as opposed to thermal noise due to a small gap. This allows a fair comparison of two different physical systems used to realize the Ising spins under equal noise strength, and applies for example to realizations of the type proposed in ref. 26. How non-equilibrium quantum annealing compares to conventional equilibrium quantum annealing more generally is to the best of our knowledge an open problem, and an interesting and important avenue for future research.

### Realization of four-body coupling

The physical realization of the four-body coupling is described here and more details can be found in Supplementary Notes 6 and 8. The photon annihilation operators of the four KNRs each of which are driven with a two-photon drive are denoted by , with i=1, 2, 3, 4. These resonators are capacitively coupled to a central JJ described by the annihilation operator and of energy . In this expression, EJ is the Josephson energy, φ0=/2e is the reduced flux quantum and φc is the standard deviation of the zero-point flux fluctuation for the junction mode. The coupling strength gi between the resonators and the junction is smaller than the detuning between them Δi, . In this dispersive, limit the mode of the junction becomes dressed with the resonator modes and the Josephson energy becomes

The fourth-order expansion of the cosine leads to a coupling , where . In the rotating frame of the drive, this coupling becomes resonant when the frequencies are chosen such that ωp,1(t)+ωp,2(t)=ωp,3(t)+ωp,4(t). In addition to the above four-body coupling, cross-Kerr terms of the form are also resonant. As shown in Supplementary Note 7, these terms do not affect the success probability of the algorithm. The strength of the coupling can be estimated with typical parameters EJ/2π=600 GHz, φc=0.12φ0, , resulting in C/2π=63 KHz. For a typical strength of Kerr-nonlinearity K/2π=600 KHz, this leads to .

### Data availability

The data that support the findings of this study are available from the corresponding author on reasonable request.

How to cite this article: Puri, S. et al. Quantum annealing with all-to-all connected nonlinear oscillators. Nat. Commun. 8, 15785 doi: 10.1038/ncomms15785 (2017).

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## References

1. 1

Santoro, G. E., Martoňák, R., Tosatti, E. & Car, R. Theory of quantum annealing of an ising spin glass. Science 295, 2427–2430 (2002).

2. 2

Babbush, R., Love, P. J. & Aspuru-Guzik, A. Adiabatic quantum simulation of quantum chemistry. Sci. rep. 4, 6603 (2014).

3. 3

Perdomo-Ortiz, A., Dickson, N., Drew-Brook, M., Rose, G. & Aspuru-Guzik, A. Finding low-energy conformations of lattice protein models by quantum annealing. Sci. rep. 2, 571 (2012).

4. 4

Lucas, A. Ising formulations of many np problems. Front. Phys. 2, 5 (2014).

5. 5

Barahona, F. On the computational complexity of ising spin glass models. J. Phys. A: Math. Gen. 15, 3241 (1982).

6. 6

Farhi, E., Goldstone, J., Gutmann, S. & Sipser, M. Quantum computation by adiabatic evolution. preprint at https://arxiv.org/abs/quant-ph/0001106 (2000).

7. 7

Farhi, E. et al. A quantum adiabatic evolution algorithm applied to random instances of an np-complete problem. Science 292, 472–475 (2001).

8. 8

Steffen, M., van Dam, W., Hogg, T., Breyta, G. & Chuang, I. Experimental implementation of an adiabatic quantum optimization algorithm. Phys. Rev. Lett. 90, 067903 (2003).

9. 9

Boixo, S. et al. Evidence for quantum annealing with more than one hundred qubits. Nat. Phys. 10, 218–224 (2014).

10. 10

Barends, R. et al. Digitized adiabatic quantum computing with a superconducting circuit. Nature 534, 222–226 (2016).

11. 11

Amin, M. H., Averin, D. V. & Nesteroff, J. A. Decoherence in adiabatic quantum computation. Phys. Rev. A 79, 022107 (2009).

12. 12

Choi, V. Minor-embedding in adiabatic quantum computation: I. the parameter setting problem. Quant. Inform. Process. 7, 193–209 (2008).

13. 13

Choi, V. Minor-embedding in adiabatic quantum computation: Ii. minor-universal graph design. Quant. Inform. Process. 10, 343–353 (2011).

14. 14

Lechner, W., Hauke, P. & Zoller, P. A quantum annealing architecture with all-to-all connectivity from local interactions. Sci. Adv. 1, e1500838 (2015).

15. 15

Puri, S., Boutin, S. & Blais, A. Engineering the quantum states of light in a kerr-nonlinear resonator by two-photon driving. npj Quant. Informa. 3, 18 (2017).

16. 16

Utsunomiya, S., Takata, K. & Yamamoto, Y. Mapping of ising models onto injection-locked laser systems. Opt. express 19, 18091–18108 (2011).

17. 17

Takata, K., Utsunomiya, S. & Yamamoto, Y. Transient time of an ising machine based on injection-locked laser network. New J. Phys. 14, 013052 (2012).

18. 18

Wang, Z., Marandi, A., Wen, K., Byer, R. L. & Yamamoto, Y. Coherent ising machine based on degenerate optical parametric oscillators. Phys. Rev. A 88, 063853 (2013).

19. 19

Marandi, A., Wang, Z., Takata, K., Byer, R. L. & Yamamoto, Y. Network of time-multiplexed optical parametric oscillators as a coherent ising machine. Nat. Photon. 8, 937–942 (2014).

20. 20

McMahon, P. L. et al. A fully-programmable 100-spin coherent ising machine with all-to-all connections. Science 354, 614–617 (2016).

21. 21

Inagaki, T. et al. Large-scale ising spin network based on degenerate optical parametric oscillators. Nat. Photon. 10, 415–419 (2016).

22. 22

Goto, H. Bifurcation-based adiabatic quantum computation with a nonlinear oscillator network. Sci. Rep. 6, 21686 (2016).

23. 23

Dykman, M. Fluctuating nonlinear oscillators: from nanomechanics to quantum superconducting circuits Oxford University Press (2012).

24. 24

Johansson, J., Nation, P. & Nori, F. Qutip: an open-source python framework for the dynamics of open quantum systems. Comp. Phys. Commun. 183, 1760–1772 (2012).

25. 25

Johansson, J., Nation, P. & Nori, F. Qutip 2: a python framework for the dynamics of open quantum systems. Comp. Phys. Commun. 184, 1234–1240 (2013).

26. 26

Leib, M., Zoller, P. & Lechner, W. A transmon quantum annealer: Decomposing many-body ising constraints into pair interactions. Quant. Sci. Technol. 1, 015008 (2016).

27. 27

Yamamoto, T. et al. Flux-driven josephson parametric amplifier. Appl. Phys. Lett. 93, 042510 (2008).

28. 28

Wustmann, W. & Shumeiko, V. Parametric resonance in tunable superconducting cavities. Phys. Rev. B 87, 184501 (2013).

29. 29

Krantz, P. et al. Single-shot read-out of a superconducting qubit using a josephson parametric oscillator. Nat. commun. 7, 11417 (2016).

30. 30

Mari, A. & Eisert, J. Positive wigner functions render classical simulation of quantum computation efficient. Phys. Rev. Lett. 109, 230503 (2012).

31. 31

Pashayan, H., Wallman, J. J. & Bartlett, S. D. Estimating outcome probabilities of quantum circuits using quasiprobabilities. Phys. Rev. Lett. 115, 070501 (2015).

32. 32

Rahimi-Keshari, S., Ralph, T. C. & Caves, C. M. Sufficient conditions for efficient classical simulation of quantum optics. Phys. Rev. X 6, 021039 (2016).

33. 33

Denchev, V. S. et al. What is the computational value of finite range tunneling? Phys. Rev. X 6, 031015 (2016).

34. 34

Suzuki, S., Nishimori, H. & Suzuki, M. Quantum annealing of the random-field ising model by transverse ferromagnetic interactions. Phys. Rev. E 75, 051112 (2007).

35. 35

Seki, Y. & Nishimori, H. Quantum annealing with antiferromagnetic transverse interactions for the hopfield model. J. Phys. A: Math. Theoret. 48, 335301 (2015).

36. 36

Bravyi, S., Divincenzo, D. P., Oliveira, R. & Terhal, B. M. The complexity of stoquastic local hamiltonian problems. Quant. Inform. Comput. 8, 361–385 (2008).

37. 37

Nishimori, H. & Takada, K. Exponential enhancement of the efficiency of quantum annealing by non-stochastic hamiltonians. Front. ICT 4, 2 (2017).

38. 38

Hormozi, L., Brown, E. W., Carleo, G. & Troyer, M. Non-stoquastic Hamiltonians and quantum annealing of ising spin glass. Preprint at https://arxiv.org/abs/1609.06558 (2016).

39. 39

Nigg, S. E., Lörch, N. & Tiwari, R. P. Robust quantum optimizer with full connectivity. Sci. Adv. 3, e1602273 (2017).

40. 40

Albash, T. & Lidar, D. A. Decoherence in adiabatic quantum computation. Phys. Rev. A 91, 062320 (2015).

## Acknowledgements

S.P., A.L.G. and A.B. acknowledge the support by the Army Research Office under Grant W911NF-14-1-0078, NSERC and funding from the Canada First Research Excellence Fund. C.K.A. acknowledges financial support from the Villum Foundation Center of Excellence, QUSCOPE.

## Author information

Authors

### Contributions

The concept was conceived by S.P., with contributions from C.K.A., A.L.G. and A.B.; S.P. carried out the numerical simulations. All authors discussed the results and contributed to writing the manuscript. A.B. supervised the project.

### Corresponding author

Correspondence to Shruti Puri.

## Ethics declarations

### Competing interests

The authors declare no competing financial interests.

## Supplementary information

### Supplementary Information

Supplementary figures, supplementary notes and supplementary references. (PDF 1770 kb)

## Rights and permissions

Reprints and Permissions

Puri, S., Andersen, C., Grimsmo, A. et al. Quantum annealing with all-to-all connected nonlinear oscillators. Nat Commun 8, 15785 (2017). https://doi.org/10.1038/ncomms15785

• Accepted:

• Published:

• ### Superconducting Parametric Oscillators for Quantum Annealing

• Masayuki SHIRANE
•  & Tsuyoshi YAMAMOTO

Vacuum and Surface Science (2020)

• ### Stabilization and operation of a Kerr-cat qubit

• A. Grimm
• , N. E. Frattini
• , S. Puri
• , S. Touzard
• , M. Mirrahimi
• , S. M. Girvin
• , S. Shankar
•  & M. H. Devoret

Nature (2020)

• ### A quantum annealer with fully programmable all-to-all coupling via Floquet engineering

• Tatsuhiro Onodera
• , Edwin Ng
•  & Peter L. McMahon

npj Quantum Information (2020)

• ### Noise-enhanced spatial-photonic Ising machine

• Davide Pierangeli
• , Giulia Marcucci
• , Daniel Brunner
•  & Claudio Conti

Nanophotonics (2020)

• ### Adiabatic evolution on a spatial-photonic Ising machine

• Davide Pierangeli
• , Giulia Marcucci
•  & Claudio Conti

Optica (2020)