## Abstract

In 1929, Leó Szilárd invented a feedback protocol^{1} in which a hypothetical intelligence—dubbed Maxwell’s demon—pumps heat from an isothermal environment and transforms it into work. After a long-lasting and intense controversy it was finally clarified that the demon’s role does not contradict the second law of thermodynamics, implying that we can, in principle, convert information to free energy^{2,3,4,5,6}. An experimental demonstration of this information-to-energy conversion, however, has been elusive. Here we demonstrate that a non-equilibrium feedback manipulation of a Brownian particle on the basis of information about its location achieves a Szilárd-type information-to-energy conversion. Using real-time feedback control, the particle is made to climb up a spiral-staircase-like potential exerted by an electric field and gains free energy larger than the amount of work done on it. This enables us to verify the generalized Jarzynski equality^{7}, and suggests a new fundamental principle of an ‘information-to-heat engine’ that converts information into energy by feedback control.

## Main

To illustrate the basic idea of our feedback protocol, let us consider a microscopic particle on a spiral-staircase-like potential (Fig. 1). We set the height of each step comparable to the thermal energy *k*_{B}*T*, where *k*_{B} is the Boltzmann constant and *T* is temperature. Subjected to thermal fluctuations, the particle jumps between steps stochastically. Although the particle sometimes jumps to an upper step, downward jumps along the gradient are more frequent than upward jumps. In this manner, on average, the particle falls down the stairs unless it is externally pushed up (Fig. 1a). Now, let us consider the following feedback control: We measure the particle’s position at regular intervals, and if an upward jump is observed we place a block behind the particle to prevent subsequent downward jumps (Fig. 1b). If this procedure is repeated, the particle is expected to climb up the stairs. Note that, in the ideal case, energy to place the block can be negligible; this implies that the particle can obtain free energy without any direct energy injection. In such a case, what drives the particle to climb up the stairs? This apparent contradiction to the second law of thermodynamics, epitomized by Maxwell’s demon, inspired many physicists to generalize the principles of thermodynamics^{1,5,6}. It is now understood that the particle is driven by the ‘information’ gained by the measurement of the particle’s location^{5,8}.

In microscopic systems, thermodynamic quantities such as work, heat and internal energy do not remain constant but fluctuate^{9,10}. In fact, stochastic violations of the second law have been observed^{11,12}; nonetheless, the second law still holds, on average, if the initial state is in thermal equilibrium: 〈Δ*F*−*W*〉≤0, where Δ*F* is the free-energy difference between states, *W* the work done on the system and 〈·〉 the ensemble average. However, the feedback control enables us to selectively manipulate only fluctuations that cause Δ*F*−*W*>0 such as upward jumps by using the information about the system^{13,14,15}. Here, ‘feedback’ means that control protocols depend on measurement outcomes of the controlled system, in other words, ‘feedback control’ means a ‘closed-loop control’^{16}. Our gedanken experiment shows that, by employing feedback control, the information can be used as a resource for free energy. In fact, Szilárd has developed a model that converts one bit of information about the system to *k*_{B}*T*ln2 of free energy or work^{1}. In other words, the second law is generalized^{17} as follows: Here *I* is the mutual information content obtained by measurements^{6,18} (see Methods). So far, the idea of a simple thermal rectification by feedback control has found applications such as the reduction of thermal noise^{15} and the rectification of an atomic current at low temperature^{13}. On the other hand, the Szilárd-type Maxwell demon enables us to evaluate both the input (used information content) and the output (obtained energy) of the feedback control and relate them operationally. Therefore, it has provided an ideal test-ground of information-to-energy conversion and played the crucial role in the foundation of thermodynamics. However, its experimental realization has been elusive. In this experiment, we develop a new method to evaluate the information contents and thermodynamic quantities of feedback systems and demonstrate the Szilárd-type information-to-energy conversion for the first time using a colloidal particle on a spiral-staircase-like potential.

A dimeric particle comprising polystyrene beads (diameter=287 nm) was attached to the top glass surface of a chamber filled with a buffer solution (Fig. 2a). The particle was pinned at a single point by a linker molecule; it exhibited rotational Brownian motion (Supplementary Fig. S2). By using quadrant electrodes imprinted on the bottom glass plate, we imposed 1 MHz electric fields to simultaneously create periodic potentials and constant torque on the particle along the angle of rotation. By using this new method, a tilted periodic potential with an ideal sinusoidal shape for the particle can be achieved, which is a realization of the spiral-staircase-like potential mentioned above (Fig. 2b, see also Supplementary Information). A feedback control was carried out under a microscope by constructing a real-time feedback system including video capture, image analysis, potential modulation and data storage. We repeated the following feedback cycle with a period of *τ*=44 ms and a minimum feedback delay of 1.1 ms, as illustrated in Fig. 2c. At *t*=0, the particle’s angular position is measured. If the particle is observed at the angular region indicated as ‘S’, the potential is changed to that with an opposite phase at *t*=*ɛ*; otherwise, no action is taken. At *t*=*τ*, the next cycle begins with the measurement of the angular position. Region S was chosen for its energy advantage; in region S, the potential energy before switching is always higher than that after switching. In the case of small *ɛ*, the particle is expected to be at rest around region S just before the switching at *t*=*ɛ* and then jump to the rightward well of the switched potential after the switching. On the other hand, for large *ɛ*, the particle falls down in the well away from region S before the switching. In this case, with a large probability, the particle jumps down to the leftward well of the switched potential after the switching. In this manner, the feedback delay *ɛ* regulates the efficiency of the feedback control. Note that, as *τ*=44 ms is sufficiently larger than the relaxation time in each well (∼10 ms) and smaller than the typical time to jump to neighbour wells (∼1 s), each feedback cycle is supposed to be a transition between equilibrium states.

In Fig. 3a, typical trajectories with the feedback control are shown. The trajectories are stepwise with a step size of 90°, which reflects the potential profile (Fig. 3b). We find that for small *ɛ* the particle rotates unidirectionally while climbing up the potential, whereas for large *ɛ* the particle goes down along the gradient. The rotation rate decreases monotonically with *ɛ*, as expected (Fig. 3c).

We then focused on the energetics during a cycle. In Fig. 3d, we show the difference between the obtained free energy Δ*F* and the work done on the particle by the switching, *W*, which is averaged over a cycle (see Methods). We find that 〈Δ*F*−*W*〉>0 for small *ɛ*; this implies that the particle gains a net free energy larger than the work done by absorbing heat beyond the conventional limitation of the second law of thermodynamics. For small *ɛ*, the switching mostly occurs when the particle is in region S. In such cases, the particle absorbs heat from an isothermal environment to reach region S before the measurements at *t*=0, then does work on the electric field at the switching, and finally jumps to the rightward well after the switching (Supplementary Fig. S7). Although such an event is not prohibited even if we randomly switch potentials without feedback control, it is typically an accidental and rare event in accordance with the second law of thermodynamics or the fluctuation theorem^{19,20,21}. However, the feedback control can increase the likelihood of occurrence of such an event. This is the crux of the control by Maxwell’s demon. The resource of the excess free energy is the information obtained by the measurement. If the estimation error of the particle’s angular position is negligible, the amount of information is characterized by the Shannon information content *I* (ref. 22). In this study, *I*=−*p*ln*p*−(1−*p*)ln(1−*p*), where *p* is the probability that the particle is observed in region S (see Methods). As noted in (1), *I* can be converted to free energy of up to *k*_{B}*T**I* (ref. 1). In our system, for the shortest feedback delay (*ɛ*=1.1 ms), *p*, *I* and 〈Δ*F*−*W*〉 were 0.059, 0.22 and 0.062 *k*_{B}*T*, respectively (Supplementary Fig. S9). This gives the efficiency of the information-to-energy conversion as 〈Δ*F*−*W*〉/*k*_{B}*T**I*=28%. 100% efficiency can be achieved by quasistatic information heat engines such as the Szilárd engine^{1}.

Although the second law concerns only the average, or the first-order cumulant, of the stochastic quantity Δ*F*−*W*, Jarzynski pointed out that the second law naturally emerges as the first-order cumulant expansion of the following equality that involves Δ*F*−*W* to all orders^{23,24}: 〈e^{(ΔF−W)/kBT}〉=1. Recently, the Jarzynski equality, which assumes a prescribed control scheme, was generalized to systems with a feedback control as follows^{7} (see Methods for heuristic derivation): where *γ* is an experimentally measurable quantity and is defined as the sum of the probabilities that the time-reversed trajectories are observed under time-reversed protocols for all possible protocols (see Methods). From its definition, 0≤*γ*≤2 in our system. Whereas *I* concerns the information obtained by the measurements, *γ* quantifies how efficiently we use the obtained information for the feedback control. If we control the system perfectly and deterministically, a time-reversed trajectory is always realized under the time-reversed protocol; *γ* then takes its maximum value. We repeated time-reversed cycles with and without switchings to obtain *γ* with a period of 220 ms, which is sufficiently long to ensure that the initial state of the cycle is relaxed to equilibrium.

Figure 4 shows that the conventional Jarzynski equality is violated in the presence of the feedback control. For large *ɛ* where 〈Δ*F*−*W*〉≤0, the second law holds on average, but the Jarzynski equality is violated. On the other hand, the generalized Jarzynski equality (2) holds over a broad range of *ɛ* (Fig. 4a), showing that equality (2) expresses the effect of feedback control to all orders. *γ* seems to converge to unity in the limit of infinite *ɛ*; here, the angular position at the switching becomes independent of that at the measurement, and the conventional Jarzynski equality recovers. For a close examination, we plotted the discrepancy between *γ* and 〈e^{(ΔF−W)/kBT}〉 and its convergence in Fig. 4b and c, respectively. The small discrepancy, less than 3%, for small *ɛ* (Fig. 4b) is supposed to result from the definition of the states. The equality assumes that each cycle starts from an equilibrium state. However, as the probability that the particle escapes from the well is not zero, an equilibrium state cannot be realized in a precise sense. Although the typical escape time (∼1 s) is much larger than the period of cycle (44 ms), it is possible that such a small discrepancy arises. It is known that a large number of cycles is necessary for the Jarzynski equality to converge owing to the exponential average^{24}. We repeated more than 100,000 cycles for each *ɛ* and confirmed the convergence of the left-hand side of (2) (Fig. 4c). The validity of (2) verifies a new fundamental principle of an ‘information-heat engine’, which converts information to free energy, in terms of all orders.

As the energy converted from information is compensated for by the demon’s energy cost to manipulate information^{2,3,4}, the second law of thermodynamics is not violated when the total system including both the particle and demon is considered. In our system, the demon consists of macroscopic devices such as computers; the microscopic device gains energy at the expense of the energy consumption of a macroscopic device. In other words, by using information as the energy-transferring ‘medium’, this information-to-energy conversion can be used to transport energy to nanomachines^{25,26} even if it is not possible to drive them directly (Supplementary Fig. S1). The next step will be to extract work from the obtained free energy explicitly by coupling the system with a microscopic transducer. This can cause a further loss of the conversion efficiency. However, in this study, compared with the obtained free energy of ∼*k*_{B}*T*, a huge amount of energy was consumed for the information processing at the macroscopic level. The future challenge is to realize a nanoscale information-processing device such as an artificial molecular motor^{27}, in which both the demon and the controlled system are microscopic.

## Methods

### Experimental set-up.

A dimeric particle composed of particles (287 nm diameter, Seradyn) was non-specifically attached to the top glass surface by means of a streptavidin linker coated on the particle’s surface. To impose a tilted periodic potential on the particle, an elliptically rotating electric field was induced by applying 1 MHz sinusoidal voltages on the quadrant electrodes patterned on the bottom glass surface. The direction of the long axis of the elliptically rotating electric field corresponds to the local minima of the potential. By changing the direction of its axis, we inverted the phase of the potential. The particle was observed on an upright microscope equipped with a high-speed camera at a period of 1.1 ms with an exposure time of 0.3 ms. Potentials were measured from transition probabilities. More than 100,000 feedback cycles were carried out for each feedback delay (*ɛ*). See Supplementary Information for details.

### Free energy and work.

Each potential well separated by peaks was defined as a state (Supplementary Fig. S6). The free energy of state *k* was calculated as , where *U*(*x*) is the potential energy at angular position *x*, and the integration is carried out in the angular region corresponding to state *k*. As the shapes of all the wells are almost the same, the free-energy difference between states is nearly equal to the difference of the potential energies of their local minima. The work done on the particle, *W*, was calculated as the potential-energy change associated with the switching: the potential energy after the switching minus that before the switching. In cycles without switching, *W*=0.

### Information content.

For an event *k* with a probability of occurrence *p*(*k*), the Shannon information content associated with this event is defined as −ln*p*(*k*). This definition leads to well-defined properties that the information content should satisfy^{22}. The average Shannon information content becomes . Measurements are usually accompanied by errors, which reduce the amount of information that can be used. Although *I* denotes the amount of the information embedded in the system, the mutual information content, *I*′, denotes the amount of information that is obtained by the measurement^{7,18}: , where *p*(*m*|*k*) is the conditional probability that the outcome of the measurement is the *m*th event when the *k*th event occurs actually. If the measurement is free from error, *p*(*m*|*k*)=*δ*_{k,m} (*δ*_{k,m}=1 if *k*=*m*, and otherwise 0). In such a case, *I*′=*I*. In the present experiment, we distinguished two events: the particle is observed in region S or not with negligible measurement errors. Then, the (average) Shannon information content per cycle becomes the so-called binary entropy function: *I*=−*p*ln*p*−(1−*p*)ln(1−*p*), where *p* is the probability that the particle is observed in region S.

### Generalized Jarzynski equality and feedback efficacy.

Let us consider the situations in which we make measurements without error and divide the phase-space of the particle into several regions. Then, in each region, a more detailed expression of the Jarzynski equality holds^{28}: 〈e^{(ΔF−W)/kBT}〉_{A}=*P*^{†}(A)/*P*(A), where 〈⋯〉_{A} is the ensemble average over trajectories under the condition that the particle is observed in region A (A=S or outside S in our set-up) with probability *P*(A), and *P*^{†}(A) is the probability that the particle is observed in A under the time-reversed control protocol. Without feedback control, this detailed equality reproduces the Jarzynski equality as . In contrast, with feedback control, *P*^{†}(A)_{A} is no longer a single probability distribution in terms of A, because the control protocols depend on A. Therefore, is not necessarily equal to unity. In such cases, the Jarzynski equality needs to be generalized to (2), where .

We measured the feedback efficacy, *γ*, as follows (see Supplementary Fig. S8). In the forward feedback cycle, we measured the particle’s angular position at *t*=0 and (1) switched or (2) did not switch the potential at *t*=*ɛ* depending on the angular position. Corresponding time-reversed trajectories are that the particle is observed in the region (1) S at *t*=*τ* after the switching at *t*=*τ*−*ɛ* or (2) outside S without switching. Let the occurrence probabilities of time-reversed trajectories under timer-reversed protocols be *p*_{sw} and *p*_{ns}, respectively. Then, *γ* is *γ*=*p*_{sw}+*p*_{ns}. From its definition, if there are *m* states to be distinguished (*m*=2 in our experiment: whether the particle is in region S or not), 0≤*γ*≤*m*. We repeated time-reversed cycles with/without switchings to obtain *γ* with a period of 220 ms, which is sufficiently long to ensure that the initial state of the cycle is relaxed to equilibrium.

## References

- 1.
Szilárd, L. On the decrease of entropy in a thermodynamic system by the intervention of intelligent beings.

*Z. Phys.***53**, 840–856 (1929). - 2.
Landauer, R. Irreversibility and heat generation in the computing process.

*IBM J. Res. Dev.***5**, 183–191 (1961). - 3.
Bennett, C. H. The thermodynamics of computation—a review.

*Int. J. Theor. Phys.***21**, 905–940 (1982). - 4.
Sagawa, T. & Ueda, M. Minimal energy cost for thermodynamic information processing: Measurement and information erasure.

*Phys. Rev. Lett.***102**, 250602 (2009). - 5.
Leff, H. S. & Rex, A. F.

*Maxwell’s Demon 2: Entropy, Classical and Quantum Information, Computing*(Institute of Physics Publishing, 2003). - 6.
Maruyama, K., Nori, F. & Vedral, V. The physics of Maxwell’s demon and information.

*Rev. Mod. Phys.***81**, 1–23 (2009). - 7.
Sagawa, T. & Ueda, M. Generalized Jarzynski equality under nonequilibrium feedback control.

*Phys. Rev. Lett.***104**, 090602 (2010). - 8.
Serreli, V., Lee, C-F., Kay, E. R. & Leigh, D. A. A molecular information ratchet.

*Nature***445**, 523–527 (2007). - 9.
Bustamante, C., Liphardt, J. & Ritort, F. The nonequilibrium thermodynamics of small systems.

*Phys. Today***58**, 43–48 (July, 2005). - 10.
Sekimoto, K. in

*Stochastic Energetics*(Lecture Notes in Physics, Vol. 799, Springer, 2010). - 11.
Wang, G. M., Sevick, E. M., Mittag, E., Searles, D. J. & Evans, D. J. Experimental demonstration of violations of the second law of thermodynamics for small systems and short time scales.

*Phys. Rev. Lett.***89**, 050601 (2002). - 12.
Carberry, D. M.

*et al.*Fluctuations and irreversibility: An experimental demonstration of a second-law-like theorem using a colloidal particle held in an optical trap.*Phys. Rev. Lett.***92**, 140601 (2004). - 13.
Thorn, J. J., Schoene, E. A., Li, T. & Steck, D. A. Experimental realization of an optical one-way barrier for neutral atoms.

*Phys. Rev. Lett.***100**, 240407 (2008). - 14.
Lopez, B. J.

*et al.*Realization of a feedback controlled flashing ratchet.*Phys. Rev. Lett.***101**, 220601 (2008). - 15.
Jourdan, G., Torricelli, G., Chevrier, J. & Comin, F. Tuning the effective coupling of an AFM lever to a thermal bath.

*Nanotechnology***18**, 475502 (2007). - 16.
Doyle, J. C., Francis, B. A. & Tannenbaum, A. R.

*Feedback Control Theory*(Prentice Hall, 1992). - 17.
Sagawa, T. & Ueda, M. Second law of thermodynamics with discrete quantum feedback control.

*Phys. Rev. Lett.***100**, 080403 (2008). - 18.
Cover, T. M. & Thomas, J. A.

*Elements of Information Theory*(John Wiley, 1991). - 19.
Evans, D. J., Cohen, E. G. D. & Morriss, G. P. Probability of second law violations in shearing steady states.

*Phys. Rev. Lett.***71**, 2401–2404 (1993). - 20.
Gallavotti, G. & Cohen, E. G. D. Dynamical ensembles in nonequilibrium statistical mechanics.

*Phys. Rev. Lett.***74**, 2694–2697 (1995). - 21.
Crooks, G. E. Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences.

*Phys. Rev. E***60**, 2721–2726 (1999). - 22.
Shannon, C. E. A mathematical theory of communication.

*Bell System Tech. J.***27**, 379–423, 623–656 (1948). - 23.
Jarzynski, C. Nonequilibrium equality for free energy differences.

*Phys. Rev. Lett.***78**, 2690–2693 (1997). - 24.
Liphardt, J., Dumont, S., Smith, S. B., Tinoco, I.Jr & Bustamante, C. Equilibrium information from nonequilibrium measurements in an experimental test of Jarzynski’s equality.

*Science***296**, 1832–1835 (2002). - 25.
Leigh, D. A., Wong, J. K. Y., Dehez, F. & Zerbetto, F. Unidirectional rotation in a mechanically interlocked molecular rotor.

*Nature***424**, 174–179 (2003). - 26.
van Delden, R. A.

*et al.*Unidirectional molecular motor on a gold surface.*Nature***437**, 1337–1340 (2005). - 27.
Hänggi, P. & Marchesoni, F. Artificial Brownian motors: Controlling transport on the nanoscale.

*Rev. Mod. Phys.***81**, 387–442 (2009). - 28.
Kawai, R., Parrondo, J. M. R. & den Broeck, C. V. Dissipation: The phase-space perspective.

*Phys. Rev. Lett.***98**, 080602 (2007). - 29.
Watanabe-Nakayama, T.

*et al.*Effect of external torque on the ATP-driven rotation of F_{1}-ATPase.*Biochem. Biophys. Res. Commun.***366**, 951–957 (2008). - 30.
Toyabe, S.

*et al.*Nonequilibrium energetics of a single F_{1}-ATPase molecule.*Phys. Rev. Lett.***104**, 198103 (2010).

## Acknowledgements

We thank T. Okamoto, M. Miyazaki and N. Akiyama for critical discussions and A. Ozeki for illustrations. This work was supported by Japan Science and Technology Agency (JST) and Grants-in-Aid for Scientific Research 18074001, 17049015, 19037022 and 18031033 (to E.M.), and 21740291, 21023007 (to S.T.) and 21244061 (to M.S.). T.S. acknowledges JSPS Research Fellowships for Young Scientists (208038).

## Author information

## Affiliations

### Department of Physics, Faculty of Science and Engineering, Chuo University, Kasuga, Tokyo 112-8551, Japan

- Shoichi Toyabe
- & Eiro Muneyuki

### Department of Physics, Graduate School of Science, University of Tokyo, Hongo, Tokyo 113-0033, Japan

- Takahiro Sagawa
- , Masahito Ueda
- & Masaki Sano

### ERATO Macroscopic Quantum Control Project, JST, Yayoi, Tokyo 113-8656, Japan

- Masahito Ueda

## Authors

### Search for Shoichi Toyabe in:

### Search for Takahiro Sagawa in:

### Search for Masahito Ueda in:

### Search for Eiro Muneyuki in:

### Search for Masaki Sano in:

### Contributions

S.T. designed and carried out experiments, analysed data and wrote the paper. T.S. and M.S. designed experiments and wrote the paper. T.S. and M.U. supported theoretical aspects. E.M. and M.S. supervised the experiments. All authors discussed the results and implications and commented on the manuscript at all stages.

### Competing interests

The authors declare no competing financial interests.

## Corresponding authors

Correspondence to Eiro Muneyuki or Masaki Sano.

## Supplementary information

## PDF files

- 1.
### Supplementary Information

Supplementary Information

## Rights and permissions

To obtain permission to re-use content from this article visit RightsLink.