Abstract
In 1929, Leó Szilárd invented a feedback protocol^{1} in which a hypothetical intelligence—dubbed Maxwell’s demon—pumps heat from an isothermal environment and transforms it into work. After a longlasting and intense controversy it was finally clarified that the demon’s role does not contradict the second law of thermodynamics, implying that we can, in principle, convert information to free energy^{2,3,4,5,6}. An experimental demonstration of this informationtoenergy conversion, however, has been elusive. Here we demonstrate that a nonequilibrium feedback manipulation of a Brownian particle on the basis of information about its location achieves a Szilárdtype informationtoenergy conversion. Using realtime feedback control, the particle is made to climb up a spiralstaircaselike potential exerted by an electric field and gains free energy larger than the amount of work done on it. This enables us to verify the generalized Jarzynski equality^{7}, and suggests a new fundamental principle of an ‘informationtoheat engine’ that converts information into energy by feedback control.
Main
To illustrate the basic idea of our feedback protocol, let us consider a microscopic particle on a spiralstaircaselike potential (Fig. 1). We set the height of each step comparable to the thermal energy k_{B}T, where k_{B} is the Boltzmann constant and T is temperature. Subjected to thermal fluctuations, the particle jumps between steps stochastically. Although the particle sometimes jumps to an upper step, downward jumps along the gradient are more frequent than upward jumps. In this manner, on average, the particle falls down the stairs unless it is externally pushed up (Fig. 1a). Now, let us consider the following feedback control: We measure the particle’s position at regular intervals, and if an upward jump is observed we place a block behind the particle to prevent subsequent downward jumps (Fig. 1b). If this procedure is repeated, the particle is expected to climb up the stairs. Note that, in the ideal case, energy to place the block can be negligible; this implies that the particle can obtain free energy without any direct energy injection. In such a case, what drives the particle to climb up the stairs? This apparent contradiction to the second law of thermodynamics, epitomized by Maxwell’s demon, inspired many physicists to generalize the principles of thermodynamics^{1,5,6}. It is now understood that the particle is driven by the ‘information’ gained by the measurement of the particle’s location^{5,8}.
In microscopic systems, thermodynamic quantities such as work, heat and internal energy do not remain constant but fluctuate^{9,10}. In fact, stochastic violations of the second law have been observed^{11,12}; nonetheless, the second law still holds, on average, if the initial state is in thermal equilibrium: 〈ΔF−W〉≤0, where ΔF is the freeenergy difference between states, W the work done on the system and 〈·〉 the ensemble average. However, the feedback control enables us to selectively manipulate only fluctuations that cause ΔF−W>0 such as upward jumps by using the information about the system^{13,14,15}. Here, ‘feedback’ means that control protocols depend on measurement outcomes of the controlled system, in other words, ‘feedback control’ means a ‘closedloop control’^{16}. Our gedanken experiment shows that, by employing feedback control, the information can be used as a resource for free energy. In fact, Szilárd has developed a model that converts one bit of information about the system to k_{B}Tln2 of free energy or work^{1}. In other words, the second law is generalized^{17} as follows:
Here I is the mutual information content obtained by measurements^{6,18} (see Methods). So far, the idea of a simple thermal rectification by feedback control has found applications such as the reduction of thermal noise^{15} and the rectification of an atomic current at low temperature^{13}. On the other hand, the Szilárdtype Maxwell demon enables us to evaluate both the input (used information content) and the output (obtained energy) of the feedback control and relate them operationally. Therefore, it has provided an ideal testground of informationtoenergy conversion and played the crucial role in the foundation of thermodynamics. However, its experimental realization has been elusive. In this experiment, we develop a new method to evaluate the information contents and thermodynamic quantities of feedback systems and demonstrate the Szilárdtype informationtoenergy conversion for the first time using a colloidal particle on a spiralstaircaselike potential.
A dimeric particle comprising polystyrene beads (diameter=287 nm) was attached to the top glass surface of a chamber filled with a buffer solution (Fig. 2a). The particle was pinned at a single point by a linker molecule; it exhibited rotational Brownian motion (Supplementary Fig. S2). By using quadrant electrodes imprinted on the bottom glass plate, we imposed 1 MHz electric fields to simultaneously create periodic potentials and constant torque on the particle along the angle of rotation. By using this new method, a tilted periodic potential with an ideal sinusoidal shape for the particle can be achieved, which is a realization of the spiralstaircaselike potential mentioned above (Fig. 2b, see also Supplementary Information). A feedback control was carried out under a microscope by constructing a realtime feedback system including video capture, image analysis, potential modulation and data storage. We repeated the following feedback cycle with a period of τ=44 ms and a minimum feedback delay of 1.1 ms, as illustrated in Fig. 2c. At t=0, the particle’s angular position is measured. If the particle is observed at the angular region indicated as ‘S’, the potential is changed to that with an opposite phase at t=ɛ; otherwise, no action is taken. At t=τ, the next cycle begins with the measurement of the angular position. Region S was chosen for its energy advantage; in region S, the potential energy before switching is always higher than that after switching. In the case of small ɛ, the particle is expected to be at rest around region S just before the switching at t=ɛ and then jump to the rightward well of the switched potential after the switching. On the other hand, for large ɛ, the particle falls down in the well away from region S before the switching. In this case, with a large probability, the particle jumps down to the leftward well of the switched potential after the switching. In this manner, the feedback delay ɛ regulates the efficiency of the feedback control. Note that, as τ=44 ms is sufficiently larger than the relaxation time in each well (∼10 ms) and smaller than the typical time to jump to neighbour wells (∼1 s), each feedback cycle is supposed to be a transition between equilibrium states.
In Fig. 3a, typical trajectories with the feedback control are shown. The trajectories are stepwise with a step size of 90°, which reflects the potential profile (Fig. 3b). We find that for small ɛ the particle rotates unidirectionally while climbing up the potential, whereas for large ɛ the particle goes down along the gradient. The rotation rate decreases monotonically with ɛ, as expected (Fig. 3c).
We then focused on the energetics during a cycle. In Fig. 3d, we show the difference between the obtained free energy ΔF and the work done on the particle by the switching, W, which is averaged over a cycle (see Methods). We find that 〈ΔF−W〉>0 for small ɛ; this implies that the particle gains a net free energy larger than the work done by absorbing heat beyond the conventional limitation of the second law of thermodynamics. For small ɛ, the switching mostly occurs when the particle is in region S. In such cases, the particle absorbs heat from an isothermal environment to reach region S before the measurements at t=0, then does work on the electric field at the switching, and finally jumps to the rightward well after the switching (Supplementary Fig. S7). Although such an event is not prohibited even if we randomly switch potentials without feedback control, it is typically an accidental and rare event in accordance with the second law of thermodynamics or the fluctuation theorem^{19,20,21}. However, the feedback control can increase the likelihood of occurrence of such an event. This is the crux of the control by Maxwell’s demon. The resource of the excess free energy is the information obtained by the measurement. If the estimation error of the particle’s angular position is negligible, the amount of information is characterized by the Shannon information content I (ref. 22). In this study, I=−plnp−(1−p)ln(1−p), where p is the probability that the particle is observed in region S (see Methods). As noted in (1), I can be converted to free energy of up to k_{B}T I (ref. 1). In our system, for the shortest feedback delay (ɛ=1.1 ms), p, I and 〈ΔF−W〉 were 0.059, 0.22 and 0.062 k_{B}T, respectively (Supplementary Fig. S9). This gives the efficiency of the informationtoenergy conversion as 〈ΔF−W〉/k_{B}T I=28%. 100% efficiency can be achieved by quasistatic information heat engines such as the Szilárd engine^{1}.
Although the second law concerns only the average, or the firstorder cumulant, of the stochastic quantity ΔF−W, Jarzynski pointed out that the second law naturally emerges as the firstorder cumulant expansion of the following equality that involves ΔF−W to all orders^{23,24}: 〈e^{(ΔF−W)/k}_{B}T 〉=1. Recently, the Jarzynski equality, which assumes a prescribed control scheme, was generalized to systems with a feedback control as follows^{7} (see Methods for heuristic derivation):
where γ is an experimentally measurable quantity and is defined as the sum of the probabilities that the timereversed trajectories are observed under timereversed protocols for all possible protocols (see Methods). From its definition, 0≤γ≤2 in our system. Whereas I concerns the information obtained by the measurements, γ quantifies how efficiently we use the obtained information for the feedback control. If we control the system perfectly and deterministically, a timereversed trajectory is always realized under the timereversed protocol; γ then takes its maximum value. We repeated timereversed cycles with and without switchings to obtain γ with a period of 220 ms, which is sufficiently long to ensure that the initial state of the cycle is relaxed to equilibrium.
Figure 4 shows that the conventional Jarzynski equality is violated in the presence of the feedback control. For large ɛ where 〈ΔF−W〉≤0, the second law holds on average, but the Jarzynski equality is violated. On the other hand, the generalized Jarzynski equality (2) holds over a broad range of ɛ (Fig. 4a), showing that equality (2) expresses the effect of feedback control to all orders. γ seems to converge to unity in the limit of infinite ɛ; here, the angular position at the switching becomes independent of that at the measurement, and the conventional Jarzynski equality recovers. For a close examination, we plotted the discrepancy between γ and 〈e^{(ΔF−W)/k}_{B}T 〉 and its convergence in Fig. 4b and c, respectively. The small discrepancy, less than 3%, for small ɛ (Fig. 4b) is supposed to result from the definition of the states. The equality assumes that each cycle starts from an equilibrium state. However, as the probability that the particle escapes from the well is not zero, an equilibrium state cannot be realized in a precise sense. Although the typical escape time (∼1 s) is much larger than the period of cycle (44 ms), it is possible that such a small discrepancy arises. It is known that a large number of cycles is necessary for the Jarzynski equality to converge owing to the exponential average^{24}. We repeated more than 100,000 cycles for each ɛ and confirmed the convergence of the lefthand side of (2) (Fig. 4c). The validity of (2) verifies a new fundamental principle of an ‘informationheat engine’, which converts information to free energy, in terms of all orders.
As the energy converted from information is compensated for by the demon’s energy cost to manipulate information^{2,3,4}, the second law of thermodynamics is not violated when the total system including both the particle and demon is considered. In our system, the demon consists of macroscopic devices such as computers; the microscopic device gains energy at the expense of the energy consumption of a macroscopic device. In other words, by using information as the energytransferring ‘medium’, this informationtoenergy conversion can be used to transport energy to nanomachines^{25,26} even if it is not possible to drive them directly (Supplementary Fig. S1). The next step will be to extract work from the obtained free energy explicitly by coupling the system with a microscopic transducer. This can cause a further loss of the conversion efficiency. However, in this study, compared with the obtained free energy of ∼k_{B}T, a huge amount of energy was consumed for the information processing at the macroscopic level. The future challenge is to realize a nanoscale informationprocessing device such as an artificial molecular motor^{27}, in which both the demon and the controlled system are microscopic.
Methods
Experimental setup.
A dimeric particle composed of particles (287 nm diameter, Seradyn) was nonspecifically attached to the top glass surface by means of a streptavidin linker coated on the particle’s surface. To impose a tilted periodic potential on the particle, an elliptically rotating electric field was induced by applying 1 MHz sinusoidal voltages on the quadrant electrodes patterned on the bottom glass surface. The direction of the long axis of the elliptically rotating electric field corresponds to the local minima of the potential. By changing the direction of its axis, we inverted the phase of the potential. The particle was observed on an upright microscope equipped with a highspeed camera at a period of 1.1 ms with an exposure time of 0.3 ms. Potentials were measured from transition probabilities. More than 100,000 feedback cycles were carried out for each feedback delay (ɛ). See Supplementary Information for details.
Free energy and work.
Each potential well separated by peaks was defined as a state (Supplementary Fig. S6). The free energy of state k was calculated as , where U(x) is the potential energy at angular position x, and the integration is carried out in the angular region corresponding to state k. As the shapes of all the wells are almost the same, the freeenergy difference between states is nearly equal to the difference of the potential energies of their local minima. The work done on the particle, W, was calculated as the potentialenergy change associated with the switching: the potential energy after the switching minus that before the switching. In cycles without switching, W=0.
Information content.
For an event k with a probability of occurrence p(k), the Shannon information content associated with this event is defined as −lnp(k). This definition leads to welldefined properties that the information content should satisfy^{22}. The average Shannon information content becomes . Measurements are usually accompanied by errors, which reduce the amount of information that can be used. Although I denotes the amount of the information embedded in the system, the mutual information content, I′, denotes the amount of information that is obtained by the measurement^{7,18}: , where p(mk) is the conditional probability that the outcome of the measurement is the mth event when the kth event occurs actually. If the measurement is free from error, p(mk)=δ_{k,m} (δ_{k,m}=1 if k=m, and otherwise 0). In such a case, I′=I. In the present experiment, we distinguished two events: the particle is observed in region S or not with negligible measurement errors. Then, the (average) Shannon information content per cycle becomes the socalled binary entropy function: I=−plnp−(1−p)ln(1−p), where p is the probability that the particle is observed in region S.
Generalized Jarzynski equality and feedback efficacy.
Let us consider the situations in which we make measurements without error and divide the phasespace of the particle into several regions. Then, in each region, a more detailed expression of the Jarzynski equality holds^{28}: 〈e^{(ΔF−W)/k}_{B}T 〉_{A}=P^{†}(A)/P(A), where 〈⋯〉_{A} is the ensemble average over trajectories under the condition that the particle is observed in region A (A=S or outside S in our setup) with probability P(A), and P^{†}(A) is the probability that the particle is observed in A under the timereversed control protocol. Without feedback control, this detailed equality reproduces the Jarzynski equality as . In contrast, with feedback control, P^{†}(A)_{A} is no longer a single probability distribution in terms of A, because the control protocols depend on A. Therefore, is not necessarily equal to unity. In such cases, the Jarzynski equality needs to be generalized to (2), where .
We measured the feedback efficacy, γ, as follows (see Supplementary Fig. S8). In the forward feedback cycle, we measured the particle’s angular position at t=0 and (1) switched or (2) did not switch the potential at t=ɛ depending on the angular position. Corresponding timereversed trajectories are that the particle is observed in the region (1) S at t=τ after the switching at t=τ−ɛ or (2) outside S without switching. Let the occurrence probabilities of timereversed trajectories under timerreversed protocols be p_{sw} and p_{ns}, respectively. Then, γ is γ=p_{sw}+p_{ns}. From its definition, if there are m states to be distinguished (m=2 in our experiment: whether the particle is in region S or not), 0≤γ≤m. We repeated timereversed cycles with/without switchings to obtain γ with a period of 220 ms, which is sufficiently long to ensure that the initial state of the cycle is relaxed to equilibrium.
References
Szilárd, L. On the decrease of entropy in a thermodynamic system by the intervention of intelligent beings. Z. Phys. 53, 840–856 (1929).
Landauer, R. Irreversibility and heat generation in the computing process. IBM J. Res. Dev. 5, 183–191 (1961).
Bennett, C. H. The thermodynamics of computation—a review. Int. J. Theor. Phys. 21, 905–940 (1982).
Sagawa, T. & Ueda, M. Minimal energy cost for thermodynamic information processing: Measurement and information erasure. Phys. Rev. Lett. 102, 250602 (2009).
Leff, H. S. & Rex, A. F. Maxwell’s Demon 2: Entropy, Classical and Quantum Information, Computing (Institute of Physics Publishing, 2003).
Maruyama, K., Nori, F. & Vedral, V. The physics of Maxwell’s demon and information. Rev. Mod. Phys. 81, 1–23 (2009).
Sagawa, T. & Ueda, M. Generalized Jarzynski equality under nonequilibrium feedback control. Phys. Rev. Lett. 104, 090602 (2010).
Serreli, V., Lee, CF., Kay, E. R. & Leigh, D. A. A molecular information ratchet. Nature 445, 523–527 (2007).
Bustamante, C., Liphardt, J. & Ritort, F. The nonequilibrium thermodynamics of small systems. Phys. Today 58, 43–48 (July, 2005).
Sekimoto, K. in Stochastic Energetics (Lecture Notes in Physics, Vol. 799, Springer, 2010).
Wang, G. M., Sevick, E. M., Mittag, E., Searles, D. J. & Evans, D. J. Experimental demonstration of violations of the second law of thermodynamics for small systems and short time scales. Phys. Rev. Lett. 89, 050601 (2002).
Carberry, D. M. et al. Fluctuations and irreversibility: An experimental demonstration of a secondlawlike theorem using a colloidal particle held in an optical trap. Phys. Rev. Lett. 92, 140601 (2004).
Thorn, J. J., Schoene, E. A., Li, T. & Steck, D. A. Experimental realization of an optical oneway barrier for neutral atoms. Phys. Rev. Lett. 100, 240407 (2008).
Lopez, B. J. et al. Realization of a feedback controlled flashing ratchet. Phys. Rev. Lett. 101, 220601 (2008).
Jourdan, G., Torricelli, G., Chevrier, J. & Comin, F. Tuning the effective coupling of an AFM lever to a thermal bath. Nanotechnology 18, 475502 (2007).
Doyle, J. C., Francis, B. A. & Tannenbaum, A. R. Feedback Control Theory (Prentice Hall, 1992).
Sagawa, T. & Ueda, M. Second law of thermodynamics with discrete quantum feedback control. Phys. Rev. Lett. 100, 080403 (2008).
Cover, T. M. & Thomas, J. A. Elements of Information Theory (John Wiley, 1991).
Evans, D. J., Cohen, E. G. D. & Morriss, G. P. Probability of second law violations in shearing steady states. Phys. Rev. Lett. 71, 2401–2404 (1993).
Gallavotti, G. & Cohen, E. G. D. Dynamical ensembles in nonequilibrium statistical mechanics. Phys. Rev. Lett. 74, 2694–2697 (1995).
Crooks, G. E. Entropy production fluctuation theorem and the nonequilibrium work relation for free energy differences. Phys. Rev. E 60, 2721–2726 (1999).
Shannon, C. E. A mathematical theory of communication. Bell System Tech. J. 27, 379–423, 623–656 (1948).
Jarzynski, C. Nonequilibrium equality for free energy differences. Phys. Rev. Lett. 78, 2690–2693 (1997).
Liphardt, J., Dumont, S., Smith, S. B., Tinoco, I. Jr & Bustamante, C. Equilibrium information from nonequilibrium measurements in an experimental test of Jarzynski’s equality. Science 296, 1832–1835 (2002).
Leigh, D. A., Wong, J. K. Y., Dehez, F. & Zerbetto, F. Unidirectional rotation in a mechanically interlocked molecular rotor. Nature 424, 174–179 (2003).
van Delden, R. A. et al. Unidirectional molecular motor on a gold surface. Nature 437, 1337–1340 (2005).
Hänggi, P. & Marchesoni, F. Artificial Brownian motors: Controlling transport on the nanoscale. Rev. Mod. Phys. 81, 387–442 (2009).
Kawai, R., Parrondo, J. M. R. & den Broeck, C. V. Dissipation: The phasespace perspective. Phys. Rev. Lett. 98, 080602 (2007).
WatanabeNakayama, T. et al. Effect of external torque on the ATPdriven rotation of F1ATPase. Biochem. Biophys. Res. Commun. 366, 951–957 (2008).
Toyabe, S. et al. Nonequilibrium energetics of a single F1ATPase molecule. Phys. Rev. Lett. 104, 198103 (2010).
Acknowledgements
We thank T. Okamoto, M. Miyazaki and N. Akiyama for critical discussions and A. Ozeki for illustrations. This work was supported by Japan Science and Technology Agency (JST) and GrantsinAid for Scientific Research 18074001, 17049015, 19037022 and 18031033 (to E.M.), and 21740291, 21023007 (to S.T.) and 21244061 (to M.S.). T.S. acknowledges JSPS Research Fellowships for Young Scientists (208038).
Author information
Authors and Affiliations
Contributions
S.T. designed and carried out experiments, analysed data and wrote the paper. T.S. and M.S. designed experiments and wrote the paper. T.S. and M.U. supported theoretical aspects. E.M. and M.S. supervised the experiments. All authors discussed the results and implications and commented on the manuscript at all stages.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Supplementary information
Supplementary Information
Supplementary Information (PDF 529 kb)
Rights and permissions
About this article
Cite this article
Toyabe, S., Sagawa, T., Ueda, M. et al. Experimental demonstration of informationtoenergy conversion and validation of the generalized Jarzynski equality. Nature Phys 6, 988–992 (2010). https://doi.org/10.1038/nphys1821
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nphys1821
This article is cited by

Thermodynamic fluctuation theorems govern human sensorimotor learning
Scientific Reports (2023)

Nonreciprocal forces enable coldtohot heat transfer between nanoparticles
Scientific Reports (2023)

The nonequilibrium cost of accurate information processing
Nature Communications (2022)

Fluctuation relations for irreversible emergence of information
Scientific Reports (2022)

Imagining Kant’s theory of scientific knowledge: philosophy and education in microbiology
International Microbiology (2022)