Quantum fluctuation theorem for error diagnostics in quantum annealers

Near term quantum hardware promises unprecedented computational advantage. Crucial in its development is the characterization and minimization of computational errors. We propose the use of the quantum fluctuation theorem to benchmark the accuracy of quantum annealers. This versatile tool provides simple means to determine whether the quantum dynamics are unital, unitary, and adiabatic, or whether the system is prone to thermal noise. Our proposal is experimentally tested on two generations of the D-Wave machine, which illustrates the sensitivity of the fluctuation theorem to the smallest aberrations from ideal annealing. In addition, for the optimally operating D-Wave machine, our experiment provides the first experimental verification of the integral fluctuation in an interacting, many-body quantum system.


Bartłomiej Gardas 1,2,3 & Sebastian Deffner 4
Near term quantum hardware promises unprecedented computational advantage. Crucial in its development is the characterization and minimization of computational errors. We propose the use of the quantum fluctuation theorem to benchmark the accuracy of quantum annealers. This versatile tool provides simple means to determine whether the quantum dynamics are unital, unitary, and adiabatic, or whether the system is prone to thermal noise. Our proposal is experimentally tested on two generations of the D-Wave machine, which illustrates the sensitivity of the fluctuation theorem to the smallest aberrations from ideal annealing. In addition, for the optimally operating D-Wave machine, our experiment provides the first experimental verification of the integral fluctuation in an interacting, many-body quantum system.
It is generally expected that for specific tasks already the first generations of quantum computers will have the potential to significantly outperform classical hardware 1,2 . This relies on the fact that the quantum computational space is exponentially larger than the classical logical state space [3][4][5] .
In classical computers, Landauer's principle assigns a characteristic thermodynamic cost to processed information -namely to erase (or write) one bit of information at least k T ln(2) B of thermodynamic work (or heat) have to be expended [6][7][8][9][10] . Recent years have seen the rapid advent of thermodynamics of information 9,[11][12][13][14] , which is a generalization of thermodynamics to small, information processing systems that typically operate far from equilibrium. In their description, tools and methods from stochastic thermodynamics have proven to be versatile and powerful. In particular, the fluctuations theorems enabled to generalize and specify Landauer's principle to a wide variety of systems 15-17 . In stochastic thermodynamics work is essentially a concept from classical mechanics, and it is given by a functional along a trajectory of the system [18][19][20] . For quantum systems the situation is significantly more involved, since quantum work is not an observable in the usual sense 21,22 . Thus, progress in the development of "quantum thermodynamics of information" has been hindered by the conceptual difficulties arising from identifying the appropriate definition of quantum work [23][24][25][26][27][28][29] .
The most prominent approach relies on two projective measurements of the energy, one in the beginning and one at the end of the process 30,31 . If the system is thermally isolated, then the difference of the measurement outcomes can be considered as thermodynamic work performed during the process 21,22,[32][33][34][35] . This notion of quantum work fulfills a quantum version of the Jarzynski equality 30,31 , which has been verified in several experiments [36][37][38] . However, the question remains whether such a notion of quantum work, and the corresponding fluctuation theorem is useful in the sense that something can be "learned" about the system that one did not know alreadybefore the experiment was performed.
Since projective measurements are an important tool in quantum information and quantum computation 5 , it was only natural to generalize the quantum Jarzynski equality to a more general fluctuation theorem for arbitrary observables. The resulting theorem, , is formulated for the information production, ω ∆ , during arbitrary quantum processes [39][40][41] . Here, γ is the quantum efficacy that encodes the compatibility of the initial state, the observable, and the quantum map, and it is closely related to Holevo's bound 40 . Remarkably, γ becomes a constant independent of the details of the process for unital quantum channels 33,40  can be understood as systems which are subject to information loss due to pure decoherence 42 , but do not experience thermal fluctuations 38 .
In the following, we propose and exemplify the applicability of the general quantum fluctuation theorem in the characterization of the accuracy of quantum annealers. In particular, we show that the fluctuation theorem 40 can be utilized to test whether the quantum annealer is prone to noise induced computational errors. To this end, we will see that (i) if the quantum annealer is isolated from thermal noise, i.e., its dynamics is unital the fluctuation theorem is fulfilled, (ii) if the dynamics are unitary and adiabatic the probability density function of ω ∆ is a δ-function, i.e., a unique outcome of the computation is obtained.
Our conceptual proposal was successfully tested on two generations of the D-Wave machine (2X and 2000Q). Our findings allow to quantify the resulting error rates from decoherence and other noise sources. It is worth emphasizing that in our analysis we are not interested in a detailed analysis the physics of the D-Wave machine. Rather, the purpose of the work is the conceptual proposal of the quantum fluctuation theorem as a tool for the accuracy diagnostics of any quantum annealer. Our experimental trials on the D-Wave machine merely illustrate that the quantum fluctuation theorem and its related methods provide a powerful tool in the characterization of quantum computing hardware and their computational accuracy.
Remarkably, we identified one D-Wave machine (2X) that posses an optimal regime of parameters for which the dynamics is unital. To the very best of our knowledge, our experiment provides thus also the first verification of the integral fluctuation theorem for an interacting, many-body quantum system.

General Information Fluctuation Relation
To begin we briefly review notions of the general quantum fluctuation theorem 40 and establish notations. Information about the state of a quantum system, ρ 0 , can be obtained by performing measurements of observables. At = t 0, i.e., to initiate the computation, we measure ω Note that the eigenvalues ω m i can be degenerate, and hence the projectors Π m i may have rank greater than one. Typically ρ 0 and Ω i do not commute, and thus ρ 0 suffers from a measurement back action 5 . Accounting for all possible measurement outcomes, the statistics after the measurement are given by the weighted average of all projections, After measuring ω m i , the quantum systems undergoes a generic time evolution over time τ which we denote by Our main object of interest is the probability distribution of all possible measurement outcomes,  ω ∆ ( ), which we can write as 40 The quantum efficacy γ plays a crucial role in the following discussion and it can be written as Note that γ is constant, (i.e. process independent), for unital quantum dynamics 40 , in particular γ becomes independent of the process length τ. For such cases, it is always possible to redefine Ω i and Ω f such that γ = 1. Thus, one could say that Eq. (4) constitutes a general fluctuation theorem for unital dynamics. On the contrary, for non-unital dynamics the right hand side depends on the details of the dynamics, and thus Eq. (4) is not fluctuation theorem in the strict sense of stochastic thermodynamics 43 .

Fluctuation Relation for the Ideal Quantum Annealer
We will now see that, on the one hand, the quantum fluctuation relation (4) provides simple means to benchmark the accuracy of the hardware. On the other hand, quantum annealers such as the D-Wave machine provide optimal testing grounds to verify fluctuation relations in a quantum many body setup.
To this end, we will assume for the remainder of the discussion that the quantum system is described by the quantum Ising model in transverse field 44 ,  Although, the current generation of quantum annealers can implement more general many body systems 45 , we focus on the simple one dimensional case for the sake of simplicity 46 . An implementation of the latter Hamiltonian on the D-Wave machine is depicted in Fig. 1a annealing process by manipulating g(t) and ∆ t ( ). In the ideal quantum annealer the quantum Ising chain (6) undergoes unitary and adiabatic dynamics, Fig. 1a). The obvious choice for the observables is the (customary renormalized) Hamiltonian in the beginning and the end of the computation, where we included  in the definition of Ω i to guarantee γ = 1 for unital dynamics. For the ideal computation, the initial state, ρ 0 , is chosen to be given by is a non-degenerate, paramagnetic state -the ground state of H(0) (and thus of Ω i ), where all spins are aligned along the x-direction. As a result, as Ω i and H(0) commute by construction (Unfortunately, the D-Wave system does not allow us to test the accuracy of the initial preparation that leads to Eq. (8)). Moreover, if the quantum annealer is ideal, then the dynamics is not only unitary, but also adiabatic. In general, we can write n n 0 that is, a process independent quantity.
The D-Wave annealer prepares the initial state by thermal relaxation, thus the initial state is at best a thermal state with a hight weight on the ground state of H(0), → . Therefore, we can further write where p n|0 is the probability of measuring ω n f , conditioned on having first measured the ground state. Since we assume the latter event to be certain, ≡ | p p n n 0 is just the probability of measuring the final outcome ω n (we dropped the superscript). Therefore, n n 0 0 n Comparing this equation with Eq. (10) we finally obtain a condition that is verifiable experimentally: The probability density function ω | | ( ) n  is characteristic for every process that transforms one ground state of the Ising Hamiltonian (6) into another. It is important to note that the quantum fluctuation theorem (4) is valid for arbitrary duration τ -any slow and fast processes. Therefore, even if a particular hardware does not anneal the initial state adiabatically, but only unitally (which is not easy to verify experimentally) Eq. (13) still holds -given that the computation starts and finishes in a ground state, as outlined above.
As an immediate consequences, every τ-dependence of  must come from dissipation or decoherence. This is a clear indication that the hardware interacts with its environment in a way that cannot be neglected.

Experimental Test on the D-Wave Machine
We generated several work distributions  ω | | ( ) n -(3) through "annealing" on two generations of the D-Wave machine (2X and 2000Q), which implemented an Ising chain as encoded in Hamiltonian (6). All connections on the chimera graph have been chosen randomly. A typical example is shown in Fig. 1b, where red lines indicate nonzero zz-interactions between qubits. The experiment was conducted = N 10 6 times. Figure 3 shows our final results obtained for different chain lengths L, couplings between qubits J i and annealing times τ on 2X, and Fig. 4 for 2000Q. The current D-Wave solver reports the final state energy which is computed classically from the measured eigenstates of the individual qubits. In Fig. 2 we show the resulting exponential averages, ω 〈 −∆ 〉 exp( ) .

Discussion of the Experimental Findings
We observe, that there are cases for which the agreement is almost ideal. In particular, this is the case on 2X for = − J 1 and slow anneal times τ, see Fig. 3. In this case the ω | | ( ) n  is close to a Kronecker-delta, and the dynamics is unital, see Fig. 2. Note that the validity of the fluctuation theorem (4) is a very sensitive test to aberrations, since rare events and large fluctuations are exponentially weighted.
However, in the vast majority of cases  ω | | ( ) n is far from our theoretical prediction (13) and the dynamics is clearly not even unital, compare Fig. 2. Importantly,  clearly depends on τ indicating a large amount of computational errors are generated during the annealing. Similar conclusions have been obtained in the literature, and it has been suggested that D-Wave's dynamics can be described by a quantum master equation 32,[50][51][52][53][54] . Note, however, that an analysis of the source of error in the D-Wave machine is not the purpose of the present work. Rather, our experimental findings prove the utility of the quantum fluctuation theorem in the diagnostics of quantum annealers.
Interestingly, the D-Wave 2X we tested (This machine is based in Los Alamos National Laboratory) produces asymmetric results. The work distributions for ferromagnetic ( > J 0) and antiferromagnetic ( < J 0) couplings should be identical. On the other hand, the newest 2000Q D-Wave machine exhibits less asymmetrical behavior, however, its overall accuracys is not as good as its predecessor's (see Fig. 4).
Complicated optimization problems involve both negative and positive values of the coupling matrix J ij . That makes debugging "asymmetric" quantum annealers a much harder task. Our proposal for diagnosing the hardware with the help of the quantum fluctuation theorem allows users to asses to what extent a particular hardware exhibits this unwanted behavior. Moreover, our test is capable of detecting any exponentially small departure from "normal operation" that may potentially result in a hard failure. We believe this to be the very first step to create fault tolerant quantum hardware 55 . As a final note, we emphasize that any departure from the ideal distribution  (13) for the Ising model indicates that the final state carries "kinks" (topological defects). Counting the exact number of such imperfections allows one to determine by how much the annealer misses the true ground state 56 . In a perfect quantum annealer this number should approach zero.
The Ising model (6) undergoes a quantum phase transition 44 . Near the critical point, i.e., at t c where ∆ = t g t ( ) ( ) c c , the gap -energy difference between the ground and a first accessible state -scales like 1/L. Thus, one could argue that the extra excitations come from a Kibble-Zurek like mechanism 57,58 . However, even the fastest quench (τ µ ∼ s 20 ) exceeds the adiabatic threshold 59 , c ad 2 for the system sizes of order L ~ 10 2 . The error observed are due to decoherence 54 .

Concluding Remarks
In the present analysis we have obtained several important results: (i) We have proposed a practical use and applicability of quantum fluctuation theorems. Namely, we have argued that the quantum fluctuation theorem can be used to benchmark the accuracy of quantum annealers. Our proposal was tested on two generations of the D-Wave machine. Thus, (ii) our results indicate the varying accuracy of distinct machines of the D-Wave hardware, and our method can be used to identify underperforming machines, which are in need of re-calibration. Finally, (iii) almost as a byproduct we have performed the first experiments and verification of quantum fluctuation theorems in a many particle system. An interesting and immediate application of our present work would be to diagnose the accuracy of the D-Wave machine when applying quantum error correction. In particular in this case, the exponential sensitivity to computational errors of the fluctuation theorem might provide a guideline for developing optimal strategies.