Introduction

Biochemical processes are innevitably noisy due to the stochastic nature of reactions, the small number of molecules involved, and the thermal fluctuations from environment1,2. Various regulatory mechanisms have evolved to suppress effects of noise in order to process information accurately in vital life processes such as biomolecule synthesis3, cell cyle4, and development5. At the same time, some of these systems also need to have a high sensitivity to external stimuli. For example, for many biochemical oscillatory systems, such as glycolysis, cyclic AMP signaling, cell cycle, circadian rhythms, and neural activities4,6,7,8, besides being accurate in their rhythmic timing, they also need to respond sensitively to external cues. In fact, one of the most salient properties of circadian rhythms is their ability to be entrained by the daily cycle in the environment so that their endogenous 24 h cycle can quickly synchronize with environmental signals9,10.

However, these two requirements, high sensitivity and low fluctuation, are incompatible for equilibrium systems due to the Fluctuation Dissipation Theorem (FDT)11. Briefly, for a perturbation of intensity \(\varepsilon\) applied to the conjugate variable of an observable A at time t = 0, FDT establishes the fluctuation-response relation (FRR) \(\left\langle {A(t)} \right\rangle _\varepsilon - \left\langle A \right\rangle _0\) = β\(\varepsilon\)[C A (t, t) − C A (t, 0)], where \(C_A(t,s)\) = \(\left\langle {A(t)A(s)} \right\rangle _0\) is the two-time autocorrelation and β = 1/k B T is the reverse thermal energy. We immediately see that the long time response ΔA ≡ \(\left\langle {A(t = \infty )} \right\rangle _\varepsilon - \left\langle A \right\rangle _0\) is linearly proportional to the variance, i.e., \({\mathrm{\Delta }}A = - \beta \varepsilon \sigma _A^2\). This means that a higher sensitivity (ΔA/\(\varepsilon\)) would necessarily lead to a higher fluctuation \(\left( {\sigma _A^2} \right)\) in any equilibrium system. Such a FRR was also found in certain biochemical systems in their linear response regime12.

To understand how living organisms solve the challenge of enhancing sensitivity (responsiveness) and reducing noise (fluctuation) at the same time, we studied the dynamics of a large class of biochemical oscillators in which limit cycles exist with the focus on non-equilibrium effects in the underlying biochemical reaction networks where FRR breaks down. Recently, the relationship between biological regulatory functions and their energy cost has attracted much attention in non-equilibrium statistical physics community13,14,15,16,17,18. A previous study found that the phase diffusion constant can be suppressed by a dissipative process that consumes free energy19. In this work, by studying different types of limit cycle oscillators analytically and numerically, we investigated whether dissipative processes can enhance sensitivity and reduce fluctuation at the same time. More importantly, our study uncovered the key design principles for biochemical circuits to achieve these two goals simultaneously.

Result

Reduced phase description for biochemical oscillations

The dynamics of a biochemical reaction system {X1, X2, …, X N }, with fixed volume V and constant temperature, is described by chemical Langevin equation (CLE)20. For a biological oscillator, the concentration variable of ith species x i (t) oscillates. Instead of dealing with the entire system, we employ the phase reduction method first developed by Kuramoto21,22,23, which reduce N-dimensional state space to a single phase variable ϕ characterizing the timing of oscillation. Specifically, \(\phi \left( {{\boldsymbol{x}}^{\cal L}} \right)\) along the deterministic limit cycle \({\cal L}\) is chosen to progress with a constant speed Ω = 2π/τ for convenience, where τ is the period. This definition of the phase can be extended to the whole basin of attraction of \({\cal L}\)24. If trajectories originated from two states eventually converge onto the limit cycle at the same time, these two states are assigned the same phase. An isochron is a line formed by all points with the same phase (see Fig. 1a).

Fig. 1
figure 1

Illustration of the phase response in biological oscillators. a The circle is the assumed stable limit cycle. The gray dashed lines represent equally separated isochrons. An unperturbed system (purple) progresses on the circle, while a perturbed system (cyan) is driven away from the circle by an impulsive signal between time 1 and time 2, and then relaxes back to the limit cycle. At time 2 (end of perturbation), it is moved to an isochron different from the unperturbed one. The difference of their phases determines the phase shift. b, c Diagrams of the signal and phase evolution of the perturbed and unperturbed system. Phase shift is induced during the perturbation and sustains after the perturbation

Clearly, geometrical structure of isochrons is crucial to the phase response property: larger x ϕ would produce larger phase shifts for the same deviation from limit cycle25. In biology literature, a phase response curve (PRC) is commonly used to characterize oscillators’ responsiveness26,27,28,29. The PRC Δϕ(ϕ) is determined by delivering a perturbation at a given phase ϕ of the oscillation for a given duration of time and comparing the shift in peak times between the perturbed trajectories and the unperturbed ones to obtain Δϕ30. Indeed, as shown in Supplementary Note 1, x ϕ is the key signal-independent factor in determining the amplitude of PRC. At a given phase, we define a dimensionless phase gradient vector \(\nabla _{{\boldsymbol{x}}^ \ast }\phi\) where \({\boldsymbol{x}}^ \ast = x_i{\mathrm{/}}\left( {x_i^{{\mathrm{max}}} - x_i^{{\mathrm{min}}}} \right)\) is a dimensionless state variable (normalized by the range of variation in x i ). We further use the maximal Euclidean norm of \(\nabla _{{\boldsymbol{x}}^ \ast }\phi\) along the limit cycle to define a global phase sensitivity parameter χ:

$$\chi \equiv {\mathrm{max}}\left\{ {\left\Vert {\nabla _{{\boldsymbol{x}}^ \ast }\phi } \right\Vert} \right\}.$$
(1)

Throughout this work, we assume that change in other signal-dependent factors (see Supplementary Note 1) does not overwhelm the effect of χ on phase shift.

Intuitively, a more sensitive circuit can enhance entrainment as it can more readily change its oscillation phase to sync with external stimuli31. It is also straightforward to show analytically that a higher sensitivity widens the range of synchronizable frequencies known as the Arnold tongue32 and therefore enhances entrainability of biochemical oscillators (see Supplementary Note 2 for details).

Due to the stochastic nature (Poisson process) of the underlying chemical transitions, biochemical oscillations are noisy and the phase fluctuates19. The variance of phase fluctuations \(\sigma _\phi ^2\) grows linearly with time, \(\sigma _\phi ^2 = D_\phi t\), which can be used to define a phase diffusion constant D ϕ . It can be shown using the phase reduction method that the probability distribution of phase fluctuation (δϕ) indeed follows a diffusive dynamics \(\partial _tP(\delta \phi ,t) = D_\phi \partial _{\delta \phi }^2P\) (see Supplementary Note 3). It is usually hard to directly derive the phase equation. As shown in Supplementary Note 4, the finite correlation time τc due to phase diffusion is inversely proportional to D ϕ . Thus, we use this relationship to infer the phase diffusion constant from the autocorrelation function, which follows a damped oscillation19

$$C(t,0) = C_0{\kern 1pt} {\mathrm{exp}}\left( { - t{\mathrm{/}}\tau _{\mathrm{c}}} \right) \times {\mathrm{cos}}({\it{\Omega }}t)$$
(2)

We now introduce the specific biochemical oscillators we study here. It is known that nonlinear autocatalytic biochemical reactions in open systems can exhibit oscillatory behaviors. For clarity, we employ a simple model (Fig. 2a) derived from glycolysis oscillation33 and the Brusselator34,35 as follows:

$$A\begin{array}{*{20}{c}} {k_1} \\ \rightleftharpoons \\ {k_{ - 1}} \end{array}X;\quad B + X\begin{array}{*{20}{c}} {k_2^0} \\ \rightleftharpoons \\ {k_{ - 2}^0} \end{array}D + Y;\quad 2X + Y\begin{array}{*{20}{c}} {k_3} \\ \rightleftharpoons \\ {k_{ - 3}} \end{array}3X$$
(3)

where A, B, and D have fixed concentrations. Here we neglect the inhomogeneous spatial distribution and focus on the dynamics and energetics of the “well-stirred” reaction system.

Fig. 2
figure 2

The reversible Brusselator model. a The reaction with B and D can be mapped into a unimolecular reaction with rate constants: \(k_2 = k_2^0[B]\), \(k_{ - 2} = k_{ - 2}^0[D]\). Together with the autocatalytic reaction with rates k3 and k−3, they form a reaction cycle with a reversibility parameter γ ≡ k−2k−3/k2k3. When γ ≠ 1, the system is nonequilibrium with free-energy dissipation driving the cyclic flux X → Y → X. b The steady-state probability density P(x, y) (color plot) and the state-space fluxes (J x , J y ) (vector field) of the model. The two small blue boxes highlight the regions around the two opposite phases ϕ = 0 and ϕ = π in the deterministic limit cycle. c Details of the chemical reactions in a local region (e.g., the small boxes in b) in the state space. Two microscopic states, (X − 1, Y + 1) and (X, Y), are linked by two distinct reversible reaction pathways, which form a microscopic reaction cycle (loop)

To study thermodynamics of the system properly, we include the backward reactions (see Fig. 2a) in the Brusselator model. An equilibrium steady state can be achieved when \(k_{ - 2}^{{\mathrm{(eq)}}}k_{ - 3} = k_2^{{\mathrm{(eq)}}}k_3\), where \(k_2^{{\mathrm{(eq)}}} = k_2^0[B]^{{\mathrm{(eq)}}}\), \(k_{ - 2}^{{\mathrm{(eq)}}} = k_{ - 2}^0[D]^{{\mathrm{(eq)}}}\) are pseudo-first-order rate constants and equilibrium values are labeled by superscript (eq). However, if the concentrations of B and D are sustained at values different from their equilibrium values by active processes such as biochemical synthesis and/or active transport (pumping), the system is driven out of equilibrium with the chemical potential difference \({\mathrm{\Delta }}\mu _{DB} = - k_{\mathrm{B}}T{\kern 1pt} {\mathrm{ln}}\left( {k_{ - 2}k_{ - 3}{\mathrm{/}}k_2k_3} \right)\) serving as the chemical driving force for the reaction cycle X → Y → X.

To characterize the nonequilibrium cycle dynamics, we introduce a (global) irreversibility parameter γ:

$$\gamma \equiv \frac{{k_{ - 2}k_{ - 3}}}{{k_2k_3}} = {\mathrm{exp}}\left( { - {\mathrm{\Delta }}\mu _{DB}{\mathrm{/}}k_{\mathrm{B}}T} \right),$$
(4)

which is related to the chemical driving force for the reaction cycle (see Fig. 2). For the special case of an equilibrium system with γ = 1, detailed balance is satisfied and the cycle is fully reversible without net flux. When γ ≠ 1, the system is driven out of equilibrium by external free-energy sources resulting in a non-zero net cycling flux.

In general, external free energy can be utilized to change the chemical reactions in two ways: enhancing forward reactions or suppressing backward reactions. To understand effects of these two distinct changes, we further introduce γ1 and γ2 to characterize the (local) irreversibility of the forward and backward reaction respectively, i.e., \(k_2 = k_2^{{\mathrm{(eq)}}}{\mathrm{/}}\gamma _1\), \(k_{ - 2} = k_{ - 2}^{{\mathrm{(eq)}}} \times \gamma _2\), with γ = γ1γ2.

In addition to the Brusselator model, we have studied another class of biochemical oscillators driven by the general activator–inhibitor (AI) mechanism (see Supplementary Fig. 1). In the AI model, oscillation is driven by the ATP hydrolysis energy and γ−1 can be expressed as \(\frac{{[{\mathrm{ATP}}][{\mathrm{ADP}}]^{{\mathrm{(eq)}}}[{\mathrm{P}}_i]^{{\mathrm{(eq)}}}}}{{[{\mathrm{ATP}}]^{{\mathrm{(eq)}}}[{\mathrm{ADP}}][{\mathrm{P}}_i]}}\). The two “local” irreversibility parameters (γ1 and γ2) are also introduced in the AI model to characterize the non-equilibrium effects in different parts of the phosphorylation–dephosphorylation (PdP) cycle that dissipates energy to drive the oscillation. Dissipation outside of the PdP cycle is roughly independent of γ and does not have a direct role in controlling the oscillation (see Supplementary Note 5A and Supplementary Fig. 2 for details).

Effects of free-energy dissipation on phase dynamics

From the chemical reaction rates, we can compute the free-energy dissipation rate (in units of k B T)36:

$$\dot W = \mathop {\sum}\limits_i \left( {J_i^ + - J_i^ - } \right){\mathrm{ln}}\frac{{J_i^ + }}{{J_i^ - }}$$
(5)

where \(J_i^ +\) and \(J_i^ -\) are the forward and backward fluxes of the ith reaction. As the dissipation rate also oscillates, we use \({\mathrm{\Delta }}W = {\int}_0^\tau {\kern 1pt} \dot W{\mathrm{d}}t\) to measure free-energy cost per period per volume. Here we study how ΔW affects the performance of the oscillation as measured by its phase diffusivity and phase sensitivity.

First, we briefly summarize the effect of energy dissipation on phase diffusion. As shown in Fig. 3a, b, the minimum phase diffusion constant DminW) depends inversely on the free-energy cost per period ΔW consistent with our previous work19 and the general thermodynamic uncertainty relation for biomolecular processes37. Here we further dissect the separate dependence on γ1 and γ2. As shown in Fig. 3a, decreasing γ1 or γ2 can both reduce phase diffusion. However, D eventually saturates to a nonzero value even in the absence of backward reactions (γ2 = 0) due to the finite stochasticity in the forward reactions with a finitie γ1 (see Supplementary Fig. 3b). On the other hand, D seems to decrease continuously with γ1 (see Supplementary Fig. 3c). As the number of forward reactions per unit time Nc increases with 1/γ1, the averaging effect (\(1{\mathrm{/}}\sqrt {N_{\mathrm{c}}}\) effect) in reducing the phase fluctuation can persist for small γ1 (or large Nc). In fact, this noise reduction strategy, i.e., taking average over multiple irreversible steps, is also commonly employed in other biological processes38.

Fig. 3
figure 3

Energy dissipation suppresses phase diffusion and enhances phase sensitivity simultaneously. a, c Phase diffusion constant D and phase sensitivity χ are plotted against non-equilibrium parameter γ1 and γ2. b D depends inversely on energy dissipation per cycle ΔW. (inset) The envelope curve (dashed line), which shows the minimum phase diffusion constant, is fitted well by Dmin = C + W0/(ΔW − Wc)19. The fitting parameters are: Wc = 41.29, W0 = 36.44, and C = 0.2305. The volume of Gillespie simulation is V = 100. d χ exhibits linear dependence on ΔW and the maximum sensitivity χmax = K W ΔW + const. with the proportional constant K W  ≈ 6.5 × 10−3

We now turn to the main focus of this work, i.e., to understand how free-energy dissipation affects phase response. In particular, we ask whether low phase fluctuation and high phase sensitivity can coexist in a dissipative system. For different values of the forward and backward irreversible constants (γ1 and γ2), we calculated phase sensitivity χ of the biochemical oscillator to external perturbations (stimuli). Remarkably, we observed in Fig. 3c, d that the phase sensitivity χ is bounded by a maximum value χmax that increases linearly with ΔW in a wide range of ΔW for different combinations of γ1 and γ2:

$$\chi \left( {\gamma _1,\gamma _2} \right) \le \chi _{{\mathrm{max}}}({\mathrm{\Delta }}W) = K_W{\mathrm{\Delta }}W + {\mathrm{const}}{\mathrm{.}}$$
(6)

where K W is a constant whose value is given in the legend of Fig. 3. We have confirmed the generality of Eq. (6) for other implementations of γ1, γ2 (Supplementary Fig. 4) in the Brusselator model, as well as for the AI model (Supplementary Fig. 5).

The relation between phase sensitivity and entrainment to external periodic driving

Many biochemical oscillators are exposed to an external periodic signal \(\varepsilon\)p(Ω, t) (e.g., temperature, light, etc.) that entrains the internal oscillation. The external signal varies with the system’s intrinsic frequency Ω and acts on an internal parameter μ. Incorporating this periodic driving force as time-dependent perturbation f(t) = (∂ μ F)\(\varepsilon\)p(Ω, t) in the phase reduction description, we obtain the dynamical equation for the phase ϕ

$$\frac{{\mathrm{d}\phi }}{{{\mathrm d}t}} = {{\Omega }} + Z_\mu(\phi ) \cdot \varepsilon p({\it{\Omega }},t),$$
(7)

where Z μ (ϕ) is the infinitesimal PRC function for perturbing μ25. Applying a pulse perturbation with duration Δt = δ t τ and intensity Δμ = δ μ on μ, the PRC can be calculated as Δϕ(ϕ; δ t , τ, δ μ , μ) = Z μ (ϕtΔμ. We now relate the normalized PRC C(ϕ) = Δϕ(ϕ)/(δ t δ μ ) = Z μ (ϕ)τ with the performance of entrainment to the external periodic driving signal.

To characterize the phase dynamics in the presence of an external periodic signal, we use the phase difference ψ = ϕ − Ωt between the internal oscillator and the external signal. By averaging over a period (as ψ is a slow variable when \(\varepsilon\) is small), we have

$$\frac{{\mathrm{d}\psi }}{{{\mathrm d}t}} = \frac{\varepsilon }{\tau }{\it{\Gamma}}(\psi ) \equiv \frac{\varepsilon }{\tau } \times \frac{1}{{2\pi }}{\int_{0}^{2\pi}} {\kern 1pt} C(\psi + \theta )p(\theta )d\theta .$$
(8)

Entrainment to the external signal occurs, because Eq. (8) has a stable fixed point ψ0, i.e., Γ(ψ0) = 0, Γ´(ψ0) < 0. Now, we consider a sudden phase shift Δψ of the external signal, which is equivalent to an initial perturbation Δψ in ψ away from its fixed point. When Δψ is small, the perturbation δψ = ψ − ψ0 follows, to the leading order, \(\dot {\delta \psi} = - t_{\mathrm{e}}^{ - 1}\delta \psi\) where \(t_{\mathrm{e}} = \left| {\varepsilon {\it{\Gamma}}{\prime}\left( {\psi _0} \right)} \right|^{ - 1}\tau\) is the entrainment time for the system to catch up the shifted signal. It is clear that stronger signals (larger \(\varepsilon\)) shorten the entrainment process. At the same time, the internal phase response property also has an important role. In general, both the steady state phase difference ψ0 and the entrainment time te depend on the shape of PRC (C(ϕ)) and how the periodic signal is applied (i.e., the waveform p(Ω, t)); however, as long as the shape of PRC remains approximately the same, enhancing phase sensitivity χ (the amplitude of PRC) reduces te:

$$t_{\mathrm{e}}{\mathrm{/}}\tau \sim \chi ^{ - 1}.$$
(9)

We have simulated the AI model to test the above relation between the phase sensitivity χ and the entrainment time te for a periodic driving \(k_1^{{\mathrm{(p)}}}(t) = k_1(1 + \varepsilon {\kern 1pt} {\mathrm{cos}}{\kern 1pt} {\it{\Omega }}t)\). At different phases of the oscillation, a phase shift Δψ = 0.4π was applied to the external signal, triggering the entrainment process. The oscillator was considered “entrained” when the peak difference between a perturbed and unperturbed system is small δψ < 0.1Δψ. Minimum number of entrainment cycles \({\mathrm{min}}_\phi \left\{ {t_{\mathrm{e}}} \right\}{\mathrm{/}}\tau\) was recorded for different γ1 and γ2. The results are shown in Fig. 4a, b for \(\varepsilon\) = 0.1.

Fig. 4
figure 4

Relation between entrainment performance and phase sensitivity and free-energy dissipation. a The minimum number of cycles needed for entrainment te/τ versus the PRC amplitude for different choices of (γ1, γ2). The energy dissipation per period ΔW is shown by the color of the data points. The log-log plot in the inset clearly shows te/τ scales inversely with the PRC amplitude. b te/τ decreases with ΔW. The inset shows te/τ (represented by the color) in the \(( - \log \gamma _1, - \log \gamma _2)\) space. c Autocorrelation function C xx (t) versus time t. The amplitude first decays exponentially and then reaches a constant \(e^{ - Dt_{\mathrm{e}}}\) in agreement with Eq. (10). The phase dynamics in the cases without (\(\varepsilon\) = 0) and with (\(\varepsilon\) > 0) external driving signal are illustrated in the inset. d The phase diffusion constant D, inferred from phase variance, decreases with the energy dissipation ΔW. The external driving signal strength \(\varepsilon\) = 0.1 for all simulations

The external periodic signal also affects phase fluctuations, which is now bounded by a “potential” well established by the external signal (Fig. 4c). By approximating the potential well by its harmonic form, the stochastic phase evolution equation in the presence of noise (from stochastic chemical reactions) can be solved to determine the phase variance:

$$\sigma^2 (t) \equiv \left\langle {\delta \psi ^2(t)} \right\rangle = Dt_{\mathrm{e}}\left( {1 - e^{ - t/t_{\mathrm{e}}}} \right){\mathrm{/}}\tau ,$$
(10)

where D is the previously defined dimensionless phase diffusion constant in the absence of the external signal. For time tte, the phase variance follows diffusion \(\left\langle {\delta \psi ^2} \right\rangle = Dt{\mathrm{/}}\tau\). For tte, the phase variance reaches a constant \(\sigma _\psi ^2 = Dt_{\mathrm{e}}{\mathrm{/}}\tau\). From Eq. (10), it is clear that phase fluctuation is suppressed by reducing D even in the presence of external driving signal.

By using the Gillespie algorithm39, we also computed the normalized auto-correlation function: \(C_{xx}(t) = \left\langle {x(t + s)x(s)} \right\rangle _s\)/\(\left\langle {x^2} \right\rangle = {\mathrm{exp}}( - \sigma (t)){\mathrm{cos}}({\it{\Omega }}t)\), where x is a state variable. As shown in Fig. 4c, the amplitude of a typical autocorrelation function C xx (t) first decreases exponentially before reaching a steady state constant \(A = {\mathrm{exp}}\left( { - Dt_{\mathrm{e}}{\mathrm{/}}\tau } \right)\), which verifies Eq. (10). Based on the value of A from the simulations, we obtain the phase variance \(\sigma _\psi ^2\), which gives \(D = \sigma _\psi ^2\tau {\mathrm{/}}t_{\mathrm{e}}\). As shown in Fig. 4d, the dimensionless diffusion constant D decreases with energy dissipation ΔW consistent with the case without external signal (Fig. 3b).

Energy-enhanced phase-amplitude coupling leads to higher phase sensitivity

To understand the dependence of phase sensitivity on free-energy consumption analytically, we study the normal form of limit cycle oscillation originated from a Hopf bifurcation. Applying variable transformation, we obtain from CLE the stochastic Stuart–Landau equation40

$$\begin{array}{*{20}{l}} {\displaystyle\frac{{{\mathrm{d}}r}}{{{\mathrm{d}}t}} = \mu r - \beta _1r^3 + \frac{{q_r}}{{\sqrt V }}\xi _r(t)} \hfill \\ {\frac{{{\mathrm{d}}\theta }}{{{\mathrm{d}}t}} = \omega + \beta _2r^2 + \frac{{q_\theta {\mathrm{/}}r}}{{\sqrt V }}\xi _\theta (t)} \hfill \end{array}$$
(11)

where μ, ω, β1, β2 are parameters associated with original reaction rate constants and ξr,θ are unit variance white noise terms. We note that β2 characterizes the phase-amplitude coupling strength that affects the phase dynamics. By using the stochastic averaging method41, we can show the two noise strength q r and q θ to be the same \(q_r^2 = q_\theta ^2 \equiv Q\) to the leading order in amplitude. See Supplementary Note 6 for detailed derivations.

For μ > 0, we have the mean amplitude \(r_{\mathrm{s}} = \sqrt {\mu {\mathrm{/}}\beta _1}\) and angular velocity \({\it{\Omega }} = \omega + \beta _2r_{\mathrm{s}}^2\). The isochron with the phase θ can be determined from the mean-field solution (see Supplementary Note 7 for details)

$$\phi (r,\theta ) = \theta - \frac{{ \beta _2 }}{{ \beta _1 }}\left( {{\mathrm{ln}}{\kern 1pt} r - \frac{1}{2}{\mathrm{ln}}\frac{{ \mu }}{{ \beta _1 }}} \right)$$
(12)

Thus, \(\nabla _{\boldsymbol{x}}\phi = \left( { - \frac{{\beta _2}}{{\beta _1}}{\mathrm{/}}r} \right){\boldsymbol{e}}_r + (1{\mathrm{/}}r){\boldsymbol{e}}_\theta\) and the phase sensitivity can be calculated

$$\chi = \sqrt {\left( {\beta _2{\mathrm{/}}\beta _1} \right)^2 + 1} .$$
(13)

The dissipation of Stuart-Landau oscillators can be determined by solving the Fokker–Plank equation for (11)19, which results in the steady state probability distribution

$$P^{{\mathrm{ss}}}(r,\theta ) = A{\kern 1pt} {\mathrm{exp}}\left[ { - \frac{{\left( {\beta _1r^4{\mathrm{/}}4 - \mu r^2{\mathrm{/}}2} \right)}}{{{\Delta }}}} \right]$$
(14)

where Δ = Q/V and A is the normalization coefficient. To have a well-defined phase variable requires that the amplitude fluctuation is much smaller than \(r_{\mathrm{s}}^2\), leading to a constraint \(\rho \equiv \mu {\mathrm{/}}\sqrt {2\beta _1{ {\Delta }}} \gg 1\)19.

The entropy production rate computed from Pss(r, θ) yields the minimum free-energy cost per cycle42 (kBT = 1, see also Supplementary Note 8 for details).

$$\begin{array}{*{20}{l}} {{\mathrm{\Delta }}W} \hfill & = \hfill & {\dot S \times \displaystyle\frac{{2\pi }}{{\left\langle {\it{\Omega }} \right\rangle }} = \frac{{2\pi }}{{ {\Delta }}} \times \displaystyle\frac{{\left\langle {r^2\left( {\omega + \beta _2r^2} \right)^2} \right\rangle }}{{\left\langle {\left( {\omega + \beta _2r^2} \right)} \right\rangle }}} \hfill \\ {} \hfill & {} \hfill & { \approx 4\pi \rho ^2\left( {1 + \kappa } \right)\left( {\displaystyle\frac{{\beta _2}}{{\beta _1}}} \right)} \hfill \end{array}$$
(15)

where \(\kappa = \omega {\mathrm{/}}\beta _2r_{\mathrm{s}}^2\) is a dimensionless parameter.

Finally, assuming that the phase sensitivity is dominated by the radial contribution, i.e., β2/β1 1, we have χ ≈ β2/β1 and κ 1. Inserting this into Eq. (15), we obtain that to the leading order:

$$\chi \approx K_W{\mathrm{\Delta }}W,$$
(16)

where K W  ≈ [4πρ2]−1 is a constant independent of β2.

The linear relation (16) agrees with our numerical results. More importantly, the analytical results reveal that the amplitude-phase coupling constant β2 has an important role in relating energy dissipation (Eq. (15)) to phase sensitivity (Eq. (13)). We further develop a toy model of limit cycle oscillator (see Supplementary Fig. 6) where β2 can be explicitly calculated in terms of the microscopic nonequilibrium parameter γ. See Supplementary Note 9 for details. We found, in this simple model, that free-energy cost of increasing forward rates and suppressing backward rates both strengthen the phase-amplitude coupling β2, therefore enhancing the phase sensitivity.

Design principles for enhancing oscillation functions

Now that we show it is in principle possible to increase phase sensitivity and to suppress phase diffusion simultaneously in a nonequilibrium system that consumes free energy, the next logical question is what are the design principles for a biochemical oscillator to optimize desirable oscillatory behaviors with a fixed energy budget. Here we search for possible design principles by studying the performance of an oscillator, characterized by χ and D, for different combinations of γ1 and γ2 that lead to the same free-energy dissipation per period. In particular, we look for rules for designing the kinetic rate parameters in reactions that form a microscopic loop like the one shown in Fig. 2c. Unlike in simplified models43 where only one reversible reaction exists between two states, these microscopic loops, which are formed by two distinct reaction pathways between two nearby microscopic states, are the basic building blocks in realistic oscillatory biochemical networks.

Balance the forward-to-backward ratio in antiparallel pathways to suppress phase diffusion

Consider N discrete states with equally spaced phases ϕ(n) = 2πn/N along a limit cycle, we study the case in which there are two antiparallel pathways i = 1, 2 between two neighboring states. For each pathway, its forward and backward transition rates are given by \(w_i^ \pm\), respectively. The overall effect of the ith transition is denoted by the net rate \(w_i(\phi ) = w_i^ + - w_i^ -\). These two pathways are antiparallel in the sense that \(w_1^ +\) and \(w_2^ +\) are in the opposite direction and they together form a counter-clockwise loop (so do \(w_1^ -\) and \(w_2^ -\) in the clockwise direction; see Fig. 2c for the Brusselator model).

It is easy to show that the average change of phase and its variance are44:

$$\frac{{{\mathrm{d}}\left\langle {\phi (t)} \right\rangle }}{{{\mathrm{d}}t}} = w_f(\phi ) - w_b(\phi ) \equiv {\it{\Omega }}_N,$$
(17)
$$\frac{{{\mathrm{d}}\left\langle {\delta \phi ^2(t)} \right\rangle }}{{{\mathrm{d}}t}} = \left( {\frac{{2\pi }}{N}} \right)^2\mathop {\sum}\limits_{\begin{array}{c}i = f,b;\nu = \pm \end{array}} {\kern 1pt} w_i^\nu ,$$
(18)

where the subscript f, b can be either i = 1 or i = 2 depending on whether a given transition pathway i contributes to forward or backward movement of the phase. As shown in Fig. 2c for the Brusselator model, a given reaction pathway, either the \(B + X \rightleftharpoons D + Y\) reaction (i = 1) or the \(2X + Y \rightleftharpoons 3X\) reaction (i = 2), can lead to a forward or a backward phase change depending on which part of the limit cycle (or phase) the transition occurs. For example, f = 1, b = 2 at phase ϕ = 0, whereas f = 2, b = 1 at phase ϕ = π (see Fig. 2c).

From the above Eqs. (17) and (18), we obtain a dimensionless phase diffusion constant

$$D = \left( {\frac{{2\pi }}{N}} \right)^2\mathop {\sum}\limits_\phi {\kern 1pt} \mathop {\sum}\limits_{\begin{array}{c}i = f,b;\nu = \pm \end{array}} {\kern 1pt} \left. {\frac{{w_i^\nu }}{{{\it{\Omega }}_N}}} \right|_\phi .$$
(19)

Our goal is to minimize phase diffusion under the constraint of a fixed energy dissipation \({\mathrm{ln}}\left( {w_1^ + w_2^ + {\mathrm{/}}w_1^ - w_2^ - } \right)\) = \({\mathrm{ln}}{\kern 1pt} \gamma ^{ - 1} \sim {\mathrm{\Delta }}W{\mathrm{/}}N\). For simplicity, we assume the ratio \(w_i^ + {\mathrm{/}}w_i^ -\) take the same value independent of the phase, i.e., \(w_i^ + (\phi ){\mathrm{/}}w_i^ - (\phi ) \equiv g_i\). The fixed energy constraint is now given by g1g2 = γ−1. By using w f (ϕ) = w b (ϕ) + Ω N and the expressions for \(w_i^ \pm\): \(w_i^ + = w_ig_i{\mathrm{/}}\left( {g_i - 1} \right)\), \(w_i^ - = w_i{\mathrm{/}}\left( {g_i - 1} \right)\), we can rewrite diffusion constant as

$$D = \left( {\frac{{2\pi }}{N}} \right)^2\mathop {\sum}\limits_\phi {\kern 1pt} \left. {\frac{{g_f + 1}}{{g_f - 1}}} \right|_\phi + \left( {\frac{{g_f + 1}}{{g_f - 1}} + \frac{{g_b + 1}}{{g_b - 1}}} \right)\frac{{w_b(\phi )}}{{{\it{\Omega }}_N}}.$$
(20)

For an ideal symmetric clock, we can assume \(\left. {g_b} \right|_\phi = \left. {g_f} \right|_{\phi + \pi }\), and the summation of the first term in Eq. (20) can be expressed as \(\mathop {\sum}\nolimits_\phi {\kern 1pt} \left. {\frac{{g_f + 1}}{{g_f - 1}}} \right|_\phi\) = \(\frac{N}{2} \times \left( {\frac{{g_1 + 1}}{{g_1 - 1}} + \frac{{g_2 + 1}}{{g_2 - 1}}} \right)\), which leads to a new expression for D and consequently its lower bound:

$$D = \frac{{(2\pi )^2}}{{2N}}\left( {1 + \frac{2}{N}\mathop {\sum}\limits_\phi \frac{{w_b(\phi )}}{{{\it{\Omega }}_N}}} \right) \times \left( {\frac{{g_1 + 1}}{{g_1 - 1}} + \frac{{g_2 + 1}}{{g_2 - 1}}} \right)$$
(21)
$$\ge \frac{{(2\pi )^2}}{N}\left( {1 + \frac{2}{N}\mathop {\sum}\limits_\phi {\kern 1pt} \frac{{w_b(\phi )}}{{{\it{\Omega }}_N}}} \right) \times \frac{{1 + \sqrt \gamma }}{{1 - \sqrt \gamma }}\hskip3pc$$
(22)

where the lower bound is reached when g1 = g2 = γ−1/2. Here we have implicitly assumed that the average of normalized backward rate \(N^{ - 1}\mathop {\sum}\nolimits_\phi {\kern 1pt} w_b(\phi ){\mathrm{/}}{\it{\Omega }}_N\) has weak dependence on g1, g2.

Our analysis clearly suggests that one design principle to minimize the phase diffusion of biochemical oscillators with a given energy budget is to equalize (balance) the ratio between forward and backward transition rates in the two antiparallel pathways that form the (non-equilibrium) dissipative loop.

This design principle obtained from an ideal clock is consistent with our previous findings in the AI model19. We have also directly tested it by numerical simulations of the Brusselator model, where two adjacent states (X − 1, Y + 1) and (X, Y) are linked by a non-equilibrium reaction loop (see Fig. 2c). We compute the ratio r of the forward and backward flux of two reactions, respectively: \(r_1 = w_1^ + {\mathrm{/}}w_1^ -\) = k2[X]/k−2[Y] and \(r_2 = w_2^ + {\mathrm{/}}w_2^ -\) = k3[X]2[Y]/k−3[X]3. We can then define M ≡ \({\mathrm{max}}\left( {\left\langle {r_1(t)} \right\rangle _\tau ,\left\langle {r_2(t)} \right\rangle _\tau } \right)\)/\({\mathrm{min}}\left( {\left\langle {r_1(t)} \right\rangle _\tau ,\left\langle {r_2(t)} \right\rangle _\tau } \right)\) to measure the matching of these two pathways averaged over the period. As shown in Fig. 5a, b, the exact matching point (M = 1) correlates closely to the minimum of the phase diffusion (see Supplementary Figs. 7 and 8 for other values of ΔW).

Fig. 5
figure 5

Testing the design principles in the Brusselator model. We vary γ1 and γ2 together with a fixed energy budget (ΔW = 200). a, b The minimum phase diffusion D occurs at \(- {\mathrm{log}}{\kern 1pt} \gamma _1 \approx 0.8\), where the forward-backward ratio is matched for the two antiparallel pathways, i.e., M ≈ 1. c, d The phase sensitivity reaches its maximum at \(- {\mathrm{log}}{\kern 1pt} \gamma _1 \approx 0.7\), where r w , the ratio of the net flux for the phase-retreating pathway over that of the phase-advancing pathway is minimum

Minimize the net backward flux relative to the net forward flux to enhance phase sensitivity

To look for strategies in enhancing phase sensitivity, we calculate \(\parallel \nabla_{x^\ast} \phi\parallel\) by projecting the transition fluxes in the state space onto the phase (angular) direction and the amplitude (radial) directions. In addition to the reactions that form part of the loop (such as w1 and w2 shown in Fig. 2c), we also include the reaction that is not part of the dissipative loop, e.g., the \(A \rightleftharpoons X\) reaction in the Brusselator model. The net flux for this non-dissipative reaction is denoted by w0, which is not regulated by the non-equilibrium parameters (γ1,2).

Recall that phase sensitivity χ measures the largest \(\parallel\nabla_{x^\ast}\phi\parallel\) along the limit cycle. It can be shown that the maximum phase gradient occurs at the point in phase space where the energy-driven fluxes most closely align with the phase direction (see Supplementary Note 10 for a more detailed analysis). A corresponding approximation is that the transition rate in the radial direction near the most sensitive point is controlled by w0. Thus, we can estimate χ as:

$$\chi \approx \frac{{w_f}}{{w_0}} \times \frac{{\left| {q_f - \left( {w_b{\mathrm{/}}w_f} \right)q_b} \right|}}{{q_0}} \equiv c_w\frac{{\left| {q_f - r_wq_b} \right|}}{{q_0}}$$
(23)

where \(q_i = \frac{{{\mathrm{\Delta }}w_i{\mathrm{/}}w_i}}{{{\mathrm{\Delta }}r{\mathrm{/}}r_{\mathrm{s}}}}\) is the relative change of transition rates induced by a perturbation given by a relative change Δr/rs of the amplitude. q i characterizes the sensitivity of the ith transition determined by the nonlinearity in the underlying reaction rates. In biochemical oscillators, for example, reactions of (pseudo) first order have q i  ~ 1; the autocatalytic reactions in the Brusselator model give q i  ~ 3.

The dominant effect of energy dissipation is to increase w f , which roughly takes the form c1/γ1 − γ2c2, where c1,2 are concentration-related coefficients for biochemical circuits. At a fixed energy dissipation or a fixed w f /w0, Eq. (23) suggests that reducing the net backward flux relative to the net forward flux, i.e., minimizing r w  ≡ w b /w f can lead to higher phase sensitivity.

This design principle, based largely on heuristic arguments, has been tested directly in the Brusselator model where the two net fluxes are w1 = k2[X] − k−2[Y] and w2 = k3[X]2[Y] − k−3[X]3. We calculated \(r_w = {\mathrm{min}}\left( {w_1,w_2} \right){\mathrm{/max}}\left( {w_1,w_2} \right)\) numerically along the entire limit cycle and compared \({\mathrm{min}}\left\{ {r_w} \right\}\) for different combinations of γ1 and γ2 for a fixed dissipation ΔW. As shown in Fig. 5c, d, phase sensitivity reaches its peak when r w is small, which confirms the strategy (design principle) for maximizing phase sensitivity by a maximum separation of net transition fluxes between anti-parallel pathways in a dissipative loop. Similar results were confirmed in the AI model (see Supplementary Fig. 9 for details).

Experimental evidence in the Kai system

To look for experimental evidence of the design principles described above, we investigate the circadian clock of cyanobacteria, i.e., the Kai system, by studying the experimentally measured kinetic rates in the reactions between different phosphorylation states (U, T, D, S) of KaiC along its PdP cycle45,46,47.

To test the first design principle, we calculate the ratio of forward to backward flux rXY = \(J_{X \to Y}{\mathrm{/}}J_{Y \to X}\) on each of the four links in the KaiC phosphorylation cycle U → T → D → S → U based on a kinetic model of KaiC phosphorylation with experimentally measured rate parameters45,46,47 (see Supplementary Note 11 and Supplementary Fig. 10a for details of the model and Supplementary Table S1 for the parameters). We then compare the period-averaged ratio 〈rXY τ to check whether these ratios are matched along the cycle. The KaiC model with the experimentally determined parameters (see Supplementary Information for details) yields 〈rUT τ :〈rTD τ :〈rDS τ :〈rSU τ  = 1:1.16:0.97:1.08, clearly showing that the forward-to-backward ratio in different links (pathways) of the KaiC phosphorylation cycle are properly balanced, which is consistent with the first design principle for minimizing phase diffusion.

To test the second design principle, we calculate the net flux for each link \(J_{X \to Y}^{{\mathrm{(net)}}} = J_{X \to Y} - J_{Y \to X}\). The net phosphorylation and dephosphorylation flux are then approximated as \(J_{U \to D}^{{\mathrm{(net)}}} = J_{U \to T}^{{\mathrm{(net)}}} + J_{T \to D}^{{\mathrm{(net)}}}\) and \(J_{D \to U}^{{\mathrm{(net)}}} = J_{D \to S}^{{\mathrm{(net)}}} + J_{S \to U}^{{\mathrm{(net)}}}\), respectively. From direct simulation of the model, the backward-to-forward (in terms of phosphorylation rhythm) net flux ratio r w is smaller during the subjective day with an average \(\left\langle {r_w} \right\rangle _{{\mathrm{day}}} \approx 0.2\) than during the night with average \(\left\langle {r_w} \right\rangle _{{\mathrm{night}}} \approx 0.5\). According to the second design principle, this r w behavior leads to a higher phase sensitivity during the subjective day (phosphorylation phase) than during the night (dephosphorylation phase), which is consistent with the experimentally measured PRC reported in ref. 46 (see Supplementary Note 11 and Supplementary Fig. 10 for details). This result confirms that the Kai system controls phase sensitivity by modulating the relative strength of the phosphorylation and dephosphorylation fluxes.

Discussion

In this study, we investigated whether and how biochemical systems can achieve high sensitivity and low fluctuation at the same time in the context of biological oscillators. In non-equilibrium systems, the FDT is broken. There is no unique relationship between fluctuation and response—they could have a positive correlation or a negative one depending on which parameters are varied. For example, in the Stuart–Landau model, if we vary a single variable without changing the others, χ and D satisfy a positively correlated relation: χ2 = D/Teff. However, even in this case, the effective temperature Teff could be lowered by dissipation ΔW in different ways depending on which variable (μ or β2) is varied (see Supplementary Note 12 for details). For a realistic non-equilibrium biochemical reaction network (circuit) such as the Brusselator model, where many parameters are affected by the dissipation in a correlated manner, our study shows that an increase in free-energy dissipation can lead to both a suppression of phase fluctuation and an enhancement of the phase sensitivity if it is used properly (or the circuit is designed properly). This result should be generally applicable to other non-equilibrium systems.

Our study revealed two design principles to achieve optimal performance with a finite budget of free-energy consumption in oscillatory systems. The findings of our analysis can be demonstrated by the expression of dissipation rate \(\dot W = \mathop {\sum}\nolimits_i {\kern 1pt} w_i{\kern 1pt} {\mathrm{ln}}\left( {w_i^ + {\mathrm{/}}w_i^ - } \right)\). In principle, high sensitivity and low phase fluctuations for a given dissipation rate can be achieved by favoring the net forward flux w f over the net backward flux w b and balancing the forward-to-backward ratio \(w_i^ + {\mathrm{/}}w_i^ -\) among antiparallel reaction pathways, respectively. As these two design principles act on different combinations of the reaction rates, they can be satisfied simultaneously leading to biochemical circuits that have both high sensitivity and low fluctuations. Strong evidence in support of these two design principles are found in the Kai system. Aside from helping us understand the structure and dynamics of naturally occurring biological pathways, these design principles may also serve as the best practice rules for constructing efficient synthetic biochemical circuits for oscillations.

Other evidence for our theory may be found in experiments measuring PRC at different energetic states of the system. For example, our theory predicts that the PRC amplitude should decrease when the background ATP/ADP ratio is decreased. As far as we know, no such experiment has been done. The closest are PRC measurements (to light and drug/chemical perturbations) at different temperatures. In our analysis, the dimensionless energy dissipation ΔW has a temperature-dependent component βΔG(0), where β = (k B T)−1 is the inverse thermal energy and ΔG(0) is a concentration-independent free-energy difference48. According to Eq. (6), this means the phase sensitivity increases as the temperature decreases if we neglect other temperature dependence. Interestingly, in the experimental systems we found, i.e., Neurospora49, Gonyaulax polyedra50, and chick pineal cell51, except for the case of light response in chick pineal cell where no T-dependence is found, PRC amplitudes indeed increase with 1/T (see Supplementary Fig. 11). However, many internal variables in biological systems can depend on temperature, therefore these temperature dependence measurements in in-vivo systems may not serve as direct tests of our theory.

The best system to test our theory directly is the relatively simple cyanobacterial circadian clock, especially the in vitro Kai system. Experimental studies in cyanobacterial circadian clocks uncover that metabolism is the fundamental synchronizer46,47,52. However, there is yet no direct experiments investigating the relationship between phase sensitivity and the background metabolic state of the system. Away from the onset of oscillation, the relative amplitude change Δr/r caused by a modest phase resetting signal (e.g., temperature pulse) should has only a weak dependence on the metabolic state of system. Under this assumption, our theory shows that the phase response is dominated by χ, which increases with the background ATP/ADP ratio. In particular, we predict that the invitro KaiABC oscillators with a lower background ATP/ADP ratio would generate a smaller PRC amplitude in response to the same temperature perturbation. In Fig. 6, we show the PRC in response to a particular change of kinetic rate constants in a generic AI model, to which the Kai system belongs. By choosing the reaction rate changes during the temperature perturbation properly, we can reproduce the observed PRC to a temperature pulse as shown in Fig. 6a. We then use our model to compute the PRC to the same perturbation (rate changes) but with different values of the energy dissipation per period (ΔW) or different background ATP/ADP ratios. As shown in Fig. 6b, the amplitude of the PRC decreases as ΔW decreases. This result is robust as the enhancement of PRC amplitude by free-energy dissipation holds true generally regardless of the specific perturbation and the specific model used (see Supplementary Fig. 12). This prediction can be tested in future experiments, e.g., by measuring the PRC for changes in temperature in different background ATP/ADP ratios. These types of experiments would not only test our hypothesis that energy dissipation affects phase response, they may also shed light on its molecular mechanisms53 and how cellular metabolic activities affects other crucial functions of biological clocks, such as temperature compensation54,55,56.

Fig. 6
figure 6

Experimental connection and prediction of the dependence of phase sensitivity on irreversibility γ. a By assuming k1 is increased by 70% and k4 by 30% during a temperature up perturbation (0.1 period), the PRC from the AI model (black line) can be fitted to that of a temperature up PRC (symbols) observed in57. Simulation trajectory of oscillation along with the circadian time scale are shown in the inset. The peak of activator rhythm is defined as CT 0. Experimental PRC data from ref. 57 is aligned with the model PRC to peak at the same CT. b PRCs for the same perturbation as in a is computed for different background levels of ATP/ADP ratio or equivalently different values of γ (given in the legend). The extra free-energy dissipation for each γ choice are: ΔW − Wc ≈ 170 (blue); 250 (red); 350 (black, same as in a). Amplitude of PRC increases as sensitivity χ is enhanced by \(- {\mathrm{log}}{\kern 1pt} \gamma\) or ΔW as shown in the inset, where the hollow circles correspond to different choices of (γ1, γ2). This prediction can be tested experimentally

Data availability

The data that support the findings of this study are available from the corresponding author on request.