Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Exploiting Non-Markovianity for Quantum Control


Quantum technology, exploiting entanglement and the wave nature of matter, relies on the ability to accurately control quantum systems. Quantum control is often compromised by the interaction of the system with its environment since this causes loss of amplitude and phase. However, when the dynamics of the open quantum system is non-Markovian, amplitude and phase flow not only from the system into the environment but also back. Interaction with the environment is then not necessarily detrimental. We show that the back-flow of amplitude and phase can be exploited to carry out quantum control tasks that could not be realized if the system was isolated. The control is facilitated by a few strongly coupled, sufficiently isolated environmental modes. Our paradigmatic example considers a weakly anharmonic ladder with resonant amplitude control only, restricting realizable operations to SO(N). The coupling to the environment, when harnessed with optimization techniques, allows for full SU(N) controllability.


Quantum control relies on the coherence of matter waves, employing external fields to steer the time evolution of a quantum system1,2. It holds the promise of utilizing entanglement and matter interference as cornerstones of future technologies. Typical control targets include the preparation of a state with certain properties, realization of a desired unitary operation, or generation of the maximum amount of entanglement. Accurate and reliable control solutions for such targets may be identified using optimal control techniques. As a prerequisite, the control target must be reachable. This question is addressed by controllability analysis.

For closed quantum systems, controllability is determined, besides the available resources such as power or bandwidth of the controls, by symmetries in the Hamiltonian3. Since the Hamiltonian generates the time evolution, its structure determines the directions in Hilbert space into which the dynamics can evolve and thus which states can be reached. For open quantum systems, the interaction with the environment leads to correlations which may induce memory effects in the system’s time evolution4. Such dynamics are termed non-Markovian. How the build-up of memory influences controllability is currently unknown and control strategies for non-Markovian dynamics of open quantum systems remain largely uncharted territory.

Non-Markovian dynamics are generic for condensed phase settings encountered e.g. in light harvesting or solid-state devices. Non-Markovianity can be measured in terms of information flowing from the environment back into the system5, increase of correlations if the system is bi- or multipartite6, or re-expansion of the volume of accessible states7. While the debate on which measure is most useful for identifying non-Markovianity is on-going, see for example the discussion in Ref. 8, what is important in the context of quantum control is that each of these measures holds a promise for better control. Indeed, correlations between system and environment may improve fidelities of single qubit gates9, or assist one-photon phase control10. Cooperative effects of control and dissipation may allow for entropy export and thus cooling11; and harnessing non-Markovianity may enhance the efficiency of quantum information processing and communication12,13. For a system with limited controllability, one may conjecture that the coupling to the environment may provide the missing knobs, provided amplitude and phase flow back into the system.

Limited control over the system of interest is a generic feature in quantum engineering where controllability has to be balanced with sufficiently isolating the desired quantum features. A prototype model is a weakly anharmonic ladder, describing quantum systems as diverse as superconducting devices or phonons in an ion trap. With resonant amplitude control only, one can realize for such a ladder arbitrary operations in SO(N). Strikingly, for the special case of N = 4, the controls are known analytically since so-called Pythagorean couplings provide a generalization of Rabi cycling from two- to four-level systems14. Complete controllability requires, however, the ability to realize an arbitrary element of SU(N). Provided that one is able to implement any element of SO(N), an arbitrary element of SU(N) can be constructed based on the Cartan decomposition. It results in a decomposition of all unitaries USU(N) into operations k1,k2 SO(N) and a diagonal, unitary matrix A3 such that U = k1Ak2. The task to achieve full unitary controllability on the N-level system therefore reduces to implementing an arbitrary diagonal unitary. This is the problem we address in the following, utilizing optimal control theory to properly exploit the coupling to the environment and ensure the desired phase alignment.


Partioning the environment

Our approach starts from a complete microscopic description of system and environment. The environmental degrees of freedom are then modeled by an infinite set of oscillators or spins15. The system, by definition, is (fully or partially) controllable whereas no control can be exerted onto the environmental degrees of freedom. Nonetheless, the environment can be exploited to control the system. Key is a partitioning of the environment into a few strongly coupled and potentially beneficial, modes and weakly coupled modes which result in dephasing and relaxation.

In our model, the strongly coupled modes are accounted for explicitly (“primary bath”) and taken to be two-level systems (TLS)16,17,18,19. Considering np such TLS, the Hamiltonian HQP, generating the evolution of system (“Q”) and primary bath (“P”), reads

with ħ = 1. The system Hamiltonian HQ describes an anharmonic ladder, En = Q + βn(n + 1)/2, with base frequency ωQ and anharmonicity β plus control by an external field, u(t), shifting the energy levels. For low anharmonicity, the shift is harmonic,

The ith primary bath-TLS is characterized by the splitting ωi, and couples transversally to the N-level system,

The coupling constant S(i) corresponds to the system’s energy level splitting when on resonance with the ith TLS and a+(a) denotes the creation (annihilation) operator of the N-level system.

Both system and primary bath-TLS interact weakly with the remaining environmental modes (“secondary bath”). Due to the weak coupling, these modes can be integrated over. As a result, system and primary bath modes are exposed to energy relaxation, caused by the near-resonant, weakly coupled secondary bath modes, as well as pure dephasing, due to the low-frequency secondary bath modes15. This is described by a Markovian master equation for the joint state of system and primary bath-TLS,

The state of the system alone, ρQ, is obtained by integrating over the primary bath modes16,17. This is done a posteriori. Therefore, depending on the system’s coupling to the primary bath, the dynamics of ρQ may become non-Markovian (in contrast to the dynamics of ρQP which by construction is Markovian). Decay of the joint state of system and primary bath modes due to the secondary bath (“S”) is modeled by the Liouvillian in the standard way15,

with and , affecting system level n and ith TLS, respectively. In order to limit the number of parameters and preserve clarity, we restrict our model to a T1-limited environment. In the supplemental material, we explicitly also scan dephasing times T2 and show that our main results and conclusions are unchanged when accounting for pure dephasing.

Application to superconducting circuits

A good realization of our model is given by superconducting circuits. For example, resonant amplitude control using Pythagorean couplings has recently been demonstrated by high-frequency steering in a flux-biased Josephson phase circuit20. In this setup, frequency shifts as in Eq. (2) can be achieved by low-frequency steering of the bias flux21. This corresponds to neglecting terms that oscillate strongly on the timescale of ωQ. It is those terms that, for N = 4, yield SO(4) operations via the Pythagorean couplings20. Consequently the two control mechanisms do not interfere. For superconducting circuits, the primary bath-TLS correspond to strongly coupled dielectric defects 22,23,24. They can be characterized experimentally in terms of their splitting, coupling to the N-level system, T1 and T221,25. Hamiltonian (3) neglects counter-rotating terms which is justified for couplings of the order of 50 MHz compared to bare system frequencies of about 5 GHz. Since these experiments are carried out in dilution refrigerators, all of the environment can be taken at T = 0 K.

Controllability analysis

In the absence of the environment, the control Hamiltonian (2) does not allow for realizing arbitrary diagonal unitaries for the N-level system which would be required for complete SU(N) controllability. This is best analyzed in terms of the dynamic Lie algebra. It is obtained by generating all nested commutators of the summands in the system Hamiltonian3. The elements of the Lie algebra represent the Hilbert space directions along which the system can evolve. Therefore the rank of the dynamic Lie algebra needs to be equal to N − 1 for complete controllability in terms of diagonal unitaries3. For our model of an anharmonic ladder with controlled frequency shifts, the control and drift Hamiltonian commute and evolution along only a single direction is possible. The scenario changes once the strongly coupled TLS of the primary bath come into play. In fact, a single transversal coupling term is sufficient to provide the remaining N − 2 Hilbert space directions, required for realizing an arbitrary diagonal unitary. This is due to Hc not commuting with . In more physical terms, allows for the system wave function to be transferred to the TLS and back, after acquiring the desired non-local phases.

These considerations of controllability hold, however, only for unitary evolution. The environment also leads to irreversible loss of energy and phase. The only control strategy that is available for such Markovian dynamics is to beat decoherence (unless a protected region in Hilbert space exists in which the desired dynamics can be generated). It is thus crucial to carry out all operations as fast as possible. To this end we employ optimal control theory which allows for identifying controls that operate at the speed limit26. Our optimization target is U1 = diag(1, −1, 1, 1) and we quantify success in terms of the error, 1 − Faverage27. U1 is a particularly difficult unitary to implement, as exemplified by an error of over 40% in the absence of any strongly coupled TLS. While we discuss in the following only U1, we have verified that optimization towards diagonal unitaries with random phases yield very similar errors. For example, optimization for 20 random diagonal unitaries, using the same parameters for system and primary bath, yields errors that differ from that for U1 by less than a factor of 1.2. This suggests full SU(4)-controllability, once implementation of U1 is successful.

Successful realization of an exemplary element of SU(4)

We first present results obtained with a single TLS in the primary bath and discuss the effect of additional TLS below. Figure 1 plots the error after optimization for U1 as a function of the T1 times of qudit and primary bath-TLS, demonstrating that errors below 1% can be reached even for T1 times of the order of a few microseconds. Due to increasing decoherence rate with increasing excitation, short T1 times of the qudit have a slightly more severe effect than short T1 times of the TLS.

Figure 1

Realization of an examplary element of SU(4).

Error after optimization for diag(1, −1, 1, 1) as a function of T1 times of qudit and TLS for an optimization time of T = 40 ns (anharmonicity β = 40 MHz, ωQ − ω(1) = 550 MHz, S(1) = 60 MHz).

A multitude of controls lead to the results shown in Fig. 1. Two examples of optimized controls, obtained using different constraints, are displayed in Fig. 2(a): The control can be restricted to low bandwidth by ramping it into and out of resonance at the beginning and end of the optimization time interval (blue solid line in Fig. 2(a)), whereas fast oscillating controls are obtained without imposing a ramp (red dashed line in Fig. 2(a)). The different controls all share the mechanism of moving the qudit close to resonance with the TLS, picking up a non-local phase due to the enhanced interaction and moving the qudit back off resonance. This sequence is repeated several times in order to properly align all the phases in the four-level subspace. A visualization of the dynamics is provided as supplemental material. While both controls lead to similar errors, the ramped control is easier to implement experimentally and also fulfills the low-frequency approximation used to derive the control Hamiltonian (2). All further calculations therefore employ ramped controls.

Figure 2

Optimized controls and non-Markovianity measure.

(a): Optimized amplitudes with the control shown in blue following a fixed ramp of ±500 MHz over 2.5 ns at the beginning and end and the red dashed line obtained without imposing a ramp. (b): Liouville space determinant of the system evolution—increase of the determinant indicates non-Markovianity (parameters as in Fig. 1, μs, μs).

Both solutions shown in Fig. 2(a) use the non-Markovianity of the time evolution as a core resource for control. This is seen in Fig. 2(b) which plots the determinant of the volume of reachable system states7. An increase of this quantity indicates a non-Markovian evolution of the qudit. Pronounced non-Markovianity is observed at the beginning and the end of the time interval in Fig. 2(b). The state space determinant is a comparatively weak non-Markovianity measure, that is, the evolution may also be non-Markovian at intermediate times. It will be interesting to assess how much non-Markovianity is required for control and over which extent of time. This is, however, beyond the scope of our present work which demonstrates the basic feasibility of exploiting non-Markovian dynamics for control.

Dependence of control success on system and bath parameters

Use of the environment as a resource is further illustrated in Fig. 3 which explores the dependence of the best possible error on qudit anharmonicity and coupling strength between qudit and TLS: For very small coupling no solution can be found and the error remains of the order one. On the other hand, one moderately coupled TLS in the primary bath is sufficient to yield good fidelities even for weak or zero anharmonicity. In the latter case (Fig. 3(a)), the desired diagonal unitaries can be realized if the operation time is sufficiently long. This can only be exploited for good T1 times, utilizing the level-dependent coupling strengths. The control problem becomes much easier for non-zero anharmonicity, with a subtle interplay between the requirements of resolving the qudit levels and sufficient interaction with all qudit levels. The latter corresponds to small anharmonicity (Fig. 3(b)) and subsequently allows good results even for weak coupling, whereas energy resolution is best for larger anharmonicity (Fig. 3(c)), which in turn allows for very short operation times. For fixed anharmonicity, one expects larger coupling strengths and longer gate times to allow for better fidelities. A few exceptions to this rule, which are observed in Fig. 3, can be attributed to the numerical nature of our controllability analysis. The observation that for a very weakly coupled TLS there exists no anharmonicity and no gate time that lead to even moderate fidelities is clear evidence that the primary bath is essential for the generation of arbitrary diagonal unitaries.

Figure 3

Dependence of control success on system anharmonicity.

Error after optimization for diag(1,−1,1,1) for μs, μs (ac) and anharmonicities of β = 0 MHz (a,d), 40 MHz (b,e), 150 MHz (c,f). For comparison, the error is also shown for infinite T1 of qudit and TLS (df).

While the environment may provide interactions with the system that can be used as a resource for control, it can also have detrimental effects on the system. This is likely to happen when several strongly coupled modes affect the dynamics. Since the number, position and coupling strength of the TLS cannot be controlled in the preparation of actual devices, we analyze the presence of an additional TLS in our optimizations, cf. Table 1. If the TLS are not too close to each other, a suitable control can suppress the effect of the additional TLS even if it is strongly coupled and very noisy. On the other hand and not surprisingly so, the stronger a closely lying second TLS is coupled to the qudit, the more difficult it is to maintain good fidelities. This is due to the fact that the gate time needs to be sufficiently long to resolve the energy difference between the two TLS. Adding more TLS to the primary bath does not change the picture shown in Table 1: In optimizations with as many as four strongly coupled primary bath TLS, the error is increased by less than a factor of 2 compared to the error for a single TLS if none of the additional TLS is close to the favourable one and less than a factor of 4 if a moderately lossy TLS is in its vicinity.

Table 1 Dependence of control success on primary bath parameters.


In summary, we have shown that non-Markovianity can be exploited for quantum control, enabling realization of all quantum operations in SU(4) where the system alone allows only for SO(4). Extension to SO(N) is straightforward: For N > 4, resonant amplitude-controls to realize arbitrary elements of SO(N) can be obtained numerically. As shown in the supplementary material, the required computational resources scale very moderately with N. The enhanced controllability results from an effective control over the system-bath coupling by moving the system into and out of resonance with a selected bath mode. Fast implementations of this control scheme can be obtained with optimal control theory such that the errors are solely T1-limited. Our model and results are directly applicable to superconducting phase and transmon circuits for which we predict, with reasonably simple controls, errors below one per cent for state of the art decoherence times.

More generally, our results provide a new perspective on open quantum systems—the environment can act as a resource for (almost) unitary quantum control. It can be exploited using optimal control theory as a tool to properly engineer the details of the dynamics. It requires one or a few environmental modes to be sufficiently isolated and sufficiently strongly coupled to the system. These conditions are met for a variety of solid-state devices other than superconducting circuits, for example NV centers in nanodiamonds or nanomechanical oscillators. In addition, on an abstract level, our work calls for a comprehensive investigation of controllability of open quantum systems, in order to gain a more rigorous understanding of when and how non-Markovianity is beneficial for quantum control.


The equation of motion (4) was solved by calculating a polynomial approximation of the evolution operator, with , using Newton polynomials28. The time step δt was chosen sufficiently small to neglect time ordering.

To obtain a shape of the external control u(t) in Eq. (2) that realizes, as best possible, the desired unitary evolution, a recent variant of optimal control theory for unitary gates in open quantum systems29 was employed.

Non-Markovianity of the system evolution is assessed by computing the determinant of the volume of reachable system states7. While this measure for non-Markovianity is comparatively weak, it has, unlike all other non-Markovianity measures, the advantage of easy numerical evaluation. Its weakness compared to the non-Markovianity measures based on the divisibility of the dynamics6 or the non-monotonicity of the trace distance5 is of no concern for our purposes. That is, if a weak measure detects non-Markovianity, the dynamics clearly is non-Markovian also from the perspective of stronger measures.

Additional Information

How to cite this article: Reich, D. M. et al. Exploiting Non-Markovianity for Quantum Control. Sci. Rep. 5, 12430; doi: 10.1038/srep12430 (2015).


  1. Rice, S. A. & Zhao, M. Optical control of molecular dynamics (John Wiley & Sons, 2000).

  2. Brumer, P. & Shapiro, M. Principles and Applications of the Quantum Control of Molecular Processes (Wiley Interscience, 2003).

  3. D’Alessandro, D. Introduction to Quantum Control and Dynamics (Chapman & Hall/CRC, 2007).

  4. Breuer, H.-P. Foundations and measures of quantum non-Markovianity. J. Phys. B 45, 154001 (2012).

    ADS  Article  Google Scholar 

  5. Breuer, H.-P., Laine, E.-M. & Piilo, J. Measure for the Degree of Non-Markovian Behavior of Quantum Processes in Open Systems. Phys. Rev. Lett. 103, 210401 (2009).

    ADS  MathSciNet  Article  Google Scholar 

  6. Rivas, A., Huelga, S. F. & Plenio, M. B. Entanglement and Non-Markovianity of Quantum Evolutions. Phys. Rev. Lett. 105, 050403 (2010).

    ADS  MathSciNet  Article  Google Scholar 

  7. Lorenzo, S., Plastina, F. & Paternostro, M. Geometrical characterization of non-Markovianity. Phys. Rev. A 88, 020102 (2013).

    ADS  Article  Google Scholar 

  8. Addis, C., Bylicka, B., Chruściński, D. & Maniscalco, S. Comparative study of non-markovianity measures in exactly solvable one- and two-qubit models. Phys. Rev. A 90, 052103 (2014).

    ADS  Article  Google Scholar 

  9. Rebentrost, P., Serban, I., Schulte-Herbrüggen, T. & Wilhelm, F. K. Optimal Control of a Qubit Coupled to a Non-Markovian Environment. Phys. Rev. Lett. 102, 090401 (2009).

    CAS  ADS  Article  Google Scholar 

  10. Pachón, L. A. & Brumer, P. Mechanisms in environmentally assisted one-photon phase control. J. Chem. Phys. 139, 164123 (2013).

    ADS  Article  Google Scholar 

  11. Schmidt, R., Negretti, A., Ankerhold, J., Calarco, T. & Stockburger, J. T. Optimal Control of Open Quantum Systems: Cooperative Effects of Driving and Dissipation. Phys. Rev. Lett. 107, 130404 (2011).

    CAS  ADS  Article  Google Scholar 

  12. Laine, E.-M., Breuer, H.-P. & Piilo, J. Nonlocal memory effects allow perfect teleportation with mixed states. Sci. Rep. 4, 4620 (2014).

    Article  Google Scholar 

  13. Bylicka, B., Chruściński, D. & Maniscalco, S. Non-Markovianity and reservoir memory of quantum channels: a quantum information theory perspective. Sci. Rep. 4, 5720 (2014).

    CAS  ADS  Article  Google Scholar 

  14. Suchowski, H., Silberberg, Y. & Uskov, D. B. Pythagorean coupling: Complete population transfer in a four-state system. Phys. Rev. A 84, 013414 (2011).

    ADS  Article  Google Scholar 

  15. Breuer, H.-P. & Petruccione, F. The theory of open quantum systems (Oxford University Press, 2007).

  16. Baer, R. & Kosloff, R. Quantum dissipative dynamics of adsorbates near metal surfaces: A surrogate Hamiltonian theory applied to hydrogen on nickel. J. Chem. Phys. 106, 8862–8875 (1997).

    CAS  ADS  Article  Google Scholar 

  17. Koch, C. P., Klüner, T. & Kosloff, R. A complete quantum description of an ultrafast pump-probe charge transfer event in condensed phase. J. Chem. Phys. 116, 7983–7996 (2002).

    CAS  ADS  Article  Google Scholar 

  18. Gelman, D., Koch, C. P. & Kosloff, R. Dissipative quantum dynamics with the Surrogate Hamiltonian approach. A comparison between spin and harmonic baths. J. Chem. Phys. 121, 661–671 (2004).

    CAS  ADS  Article  Google Scholar 

  19. Gualdi, G. & Koch, C. P. Renormalization approach to non-Markovian open-quantum system dynamics. Phys. Rev. A 88, 022122 (2013).

    ADS  Article  Google Scholar 

  20. Svetitsky, E., Suchowski, H., Resh, R., Shalibo, Y., Martinis, J. M. & Katz, N. Hidden Two-Qubit Dynamics of a Four-Level Josephson Circuit. Nature Commun. 5, 5617 (2014).

    CAS  ADS  Article  Google Scholar 

  21. Shalibo, Y. Control and Measurement of Multi-Level States in the Josephson Phase Circuit. Ph.D. thesis, Hebrew University of Jerusalem, Israel (2012).

  22. Martinis, J. M. et al. Decoherence in Josephson Qubits from Dielectric Loss. Phys. Rev. Lett. 95, 210503 (2005).

    ADS  Article  Google Scholar 

  23. Lisenfeld, J., Müller, C., Cole, J. H., Bushev, P., Lukashenko, A., Shnirman, A. & Ustinov, A. V. Rabi spectroscopy of a qubit-fluctuator system. Phys. Rev. B 81, 100511 (2010).

    ADS  Article  Google Scholar 

  24. Paladino, E., Galperin, Y. M., Falci, G. & Altshuler, B. L. 1/f noise: Implications for solid-state quantum information. Rev. Mod. Phys. 86, 361–418 (2014).

    ADS  Article  Google Scholar 

  25. Shalibo, Y., Rofe, Y., Shwa, D., Zeides, F., Neeley, M., Martinis, J. M. & Katz, N. Lifetime and Coherence of Two-Level Defects in a Josephson Junction. Phys. Rev. Lett. 105, 177001 (2010).

    ADS  Article  Google Scholar 

  26. Goerz, M. H., Calarco, T. & Koch, C. P. The quantum speed limit of optimal controlled phasegates for trapped neutral atoms. J. Phys. B 44, 154011 (2011).

    ADS  Article  Google Scholar 

  27. Nielsen, M. A. & Chuang, I. L. Quantum Computation and Quantum Information (Cambridge University Press, 2000).

  28. Kosloff, R. Propagation methods for molecular dynamics. Annu. Rev. Phys. Chem. 45, 145–178 (1994).

    CAS  ADS  Article  Google Scholar 

  29. Goerz, M. H., Reich, D. M. & Koch., C. P. Optimal control theory for a unitary operation under dissipative evolution. New J. Phys. 16, 055012 (2014).

    ADS  MathSciNet  Article  Google Scholar 

Download references


We would like to thank Ronnie Kosloff for fruitful discussions. Financial support by the DAAD and the ISF (Bikura Grant No. 1567/12) is gratefully acknowledged.

Author information




D.M.R. and C.P.K. constructed the theoretical framework. All authors developed its application to the superconducting phase circuit. D.M.R. performed the numerical simulations. All authors discussed the results and wrote the manuscript.

Ethics declarations

Competing interests

The authors declare no competing financial interests.

Electronic supplementary material

Rights and permissions

This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Reich, D., Katz, N. & Koch, C. Exploiting Non-Markovianity for Quantum Control. Sci Rep 5, 12430 (2015).

Download citation

Further reading


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.


Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing