Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

# Transient hysteresis and inherent stochasticity in gene regulatory networks

## Abstract

Cell fate determination, the process through which cells commit to differentiated states is commonly mediated by gene regulatory motifs with mutually exclusive expression states. The classical deterministic picture for cell fate determination includes bistability and hysteresis, which enables the persistence of the acquired cellular state after withdrawal of the stimulus, ensuring a robust cellular response. However, stochasticity inherent to gene expression dynamics is not compatible with hysteresis, since the stationary solution of the governing Chemical Master Equation does not depend on the initial conditions. We provide a quantitative description of a transient hysteresis phenomenon reconciling experimental evidence of hysteretic behaviour in gene regulatory networks with inherent stochasticity: under sufficiently slow dynamics hysteresis is transient. We quantify this with an estimate of the convergence rate to the equilibrium and introduce a natural landscape capturing system’s evolution that, unlike traditional cell fate potential landscapes, is compatible with coexistence at the microscopic level.

## Introduction

In a deterministic description, binary decision making is attributed to the irreversible state transition between two mutually exclusive stable steady states in response to a signal. This state transition is usually governed by regulatory motifs with the capacity for bistability and hysteresis1, thus ensuring that the system does not switch back immediately when the signal is removed2.

The stochastic dynamic behavior of a gene regulatory network is governed by a chemical master equation (CME), which describes the time evolution of the probability distribution of the system state. The stationary solution of the CME is unique and independent on the initial state of the system3 and therefore, incompatible with memory effects or hysteresis. The incompatibility of hysteresis with intrinsic noise in gene regulatory networks has been addressed, for example, by Lestas et al.4. However, there are numerous works providing experimental evidence of hysteretic behavior under significant levels of stochasticity5,6,7,8.

In the context of phenotypic switching and cell fate determination, three different scenarios have been distinguished and experimentally observed for binary decision making: deterministic irreversible9,10,11, stochastic reversible12, and stochastic yet irreversible state transitioning13. Reversibility is understood here as the capacity of individual cells to switch back in absence of external signals. According to a pseudo-potential interpretation, dynamics are directed by a pseudo-potential landscape divided by a separatrix into two basins of attraction such that each local minimum corresponds to a specific cellular state. Stochastic irreversible transitions are found to appear when cells are initialized on (or near) the separatrix13.

In this article we provide a quantitative description of hysteresis and apparent irreversibility in stochastic gene regulatory networks at the single cell level as transient effects, which disappear at the stationary state. Our analysis is based on an accurate approximation of the CME. This means that our results are valid for purely stochastic regimes far from the thermodynamic limit, and thus complementary to those based on the classical linear noise approximation for systems closer to the thermodynamic limit4,14. Since the stationary solution of the CME is unique3, if the solution corresponds to a bimodal distribution, state transitions at the single cells level occur necessarily in a random and spontaneous manner, switching back and forth between regions of high probability.

Fang et al.15 experimentally determined an energy potential-like landscape as the negative logarithm of the probability distribution, as well as the transition rates, based on previous theoretical studies16. In this contribution, we provide a theoretical basis that explains coexistence of different expression states. In fact, under the assumption of protein bursting17, we propose an efficient form of the CME17,18 that allows us to construct a meaningful probability based landscape. Furthermore, a clear link between the characteristic kinetic parameters of regulation dynamics and the resulting landscape is established.

## Results

### Deterministic description

We consider the simplest gene regulatory motif exhibiting hysteresis, a single gene with positive self-regulation (see Supplementary Fig. 1). In its deterministic description, the evolution of the amounts of mRNA and protein X ($$m$$ and $$x$$, respectively) for the self-regulatory gene network is given by the set of ODEs:

$$\frac{{\mathrm{d}}m}{{\mathrm{d}}t}={k}_{m}c(x)-{\gamma }_{m}m$$
(1)
$$\frac{{\mathrm{d}}x}{{\mathrm{d}}t}={k}_{x}m-{\gamma }_{x}x,$$
(2)

where $${\gamma }_{m}$$ and $${\gamma }_{x}$$ are the mRNA and protein degradation rates, respectively. $${k}_{m}c(x)$$ is the transcription rate, that is essentially proportional to the input function $$c(x)$$ which collects the expression from the activated and inactivated promoter states. This function incorporates the effect of protein self-regulation and takes the form19,20:

$$c(x)=\left(1-\rho (x)\right)+\rho (x)\varepsilon ,$$
(3)

with $$\rho (x)$$ being a Hill function21 that describes the ratio of promoter in the inactive form as a function of bound protein:

$$\rho (x)=\frac{{x}^{H}}{{x}^{H}+{K}^{H}}.$$
(4)

The above expression, can be interpreted as the probability of the promoter being in its inactive state, where $$K={k}_{{\rm{off}}}/{k}_{{\rm{on}}}$$ is the equilibrium binding constant and $$H\in {\mathbb{Z}}\backslash \{0\}$$ is an integer (Hill coefficient) which indicates whether protein X inhibits ($$H\,> \,0$$) or activates ($$H\,<\,0$$) expression. Finally, expression (3) includes basal transcription or leakage with a constant rate $$\varepsilon ={k}_{\varepsilon }/{k}_{m}$$ (see Supplementary Fig. 1) typically much smaller than $$1$$. The parameters of the Hill function employed along the paper are $$H=-7$$ (the value taken from To and Maheshri22) and $$K=100$$, whereas $$\varepsilon =0.05$$. Unless other value is indicated, we use $$a=54$$. Assuming that $$mRNA$$ degrades faster than protein X we have that $${m}^{* }={k}_{m}c(x)/{\gamma }_{m}$$ and model (1) reduces to:

$$\frac{{\mathrm{d}}x}{{\mathrm{d}}\tau }=-x+abc(x),$$
(5)

where $$\tau =t{\gamma }_{x}$$, $$a={k}_{m}/{\gamma }_{x}$$, and $$b={k}_{x}/{\gamma }_{m}$$. Along the paper we use the values $${\gamma }_{x}=4\times 1{0}^{-4}$$ s$${}^{-1}$$ and $${\gamma }_{m}=20{\gamma }_{x}$$ s$${}^{-1}$$, taken from Friedman et al.23.

The self-regulatory network described by the deterministic Eqs. (1) and (2) shows bistability and hysteresis (see Fig. 1a). For a range of the control parameter $$b$$ the system evolves toward one stable state or another depending on the initial conditions. We therefore say that the system has memory, since steady state values provide information about the system’s past. In systems with hysteresis (dependency of the state of the system on its past), forward and reverse induction experiments follow different paths resulting in a hysteresis loop (the system switches back and forth for different values of the control parameter)24.

### Stochastic description

Gene expression is inherently stochastic. Taking into account that mRNA degrades faster than protein X in most prokaryotic and eukaryotic organisms25, protein is assumed to be produced in bursts19,20,23,26 at a frequency $$a={k}_{m}/{\gamma }_{x}$$ (see Eq. (5)). From this assumption, it follows20,23 that the temporal evolution of the associated probability density function $$p:{{\mathbb{R}}}_{+}\times {{\mathbb{R}}}_{+}\to {{\mathbb{R}}}_{+}$$ can be described by a partial integro-differential equation (PIDE) of the form:

$$\frac{\partial p(\tau ,x)}{\partial \tau }-\frac{\partial [xp(\tau ,x)]}{\partial x}=a \int _{0}^{x}\,\omega (x-y)c(y)p(\tau ,y)\ {\rm{d}}y-ac(x)p(\tau ,x),$$
(6)

where $$x$$ and $$\tau$$ correspond with the amount of protein and dimensionless time, respectively. The latter variable is associated to the time scale of the protein degradation, as in the previous deterministic description. In addition, $$\omega (x-y)$$ is the conditional probability for protein level to jump from a state $$y$$ to a state $$x$$ after a burst, which is proportional to

$$\omega (x-y)=\frac{1}{b}\exp \left[\frac{-(x-y)}{b}\right],$$
(7)

with $$b$$, as in Eq. (5), representing the burst size. The stationary form of the one dimensional Eq. (6) has analytical solution19,20 $${p}^{* }(x)=C{\left[\rho (x)\right]}^{\frac{a(1-\varepsilon )}{H}}{x}^{-(1-a\varepsilon )}{e}^{\frac{-x}{b}}$$ where $$\rho (x)$$ is defined in (4) and $$C$$ is a normalizing constant such that $$\int _{0}^{\infty }{p}^{* }(x)=1$$. It has been shown that the equilibrium solution associated to a CME is unique and stable3. This is also the case for the Friedman Eq. (6) whose stability has been recently proved by entropy methods27,28, which eventually makes it to qualify as a master equation itself. It is important to remark that stability properties remain valid for higher dimensions (i.e., multiple genes and proteins). While the mean $$x$$-values of the stationary solution do not depend on the initial conditions, the means obtained at the transients depend on the initial number of proteins (Fig. 1b).

Note that under sufficiently slow dynamics, transient values may look stationary, thus leading to plots (red and blue lines) that resemble hysteresis, as different mean values coexist within a given interval of the $$b$$ parameter. Interestingly, this interval coincides with bimodal distributions in which the two most probable states are separated by a region, in the protein space, with very low probability. This explains recent experimental observations29 in which the range of apparent hysteresis was found to shrink with time. Here we denote this phenomenon as transient hysteresis and show how, in fact, the low probability region acts as a barrier that hinders transitions between low and high protein expression, contributing in this way to slow down the dynamics toward the corresponding stationary distribution. Supplementary Fig. 2 compares transient and stationary distributions for different values of the control parameter and different initial conditions. This figure provides a clear illustration of how, in presence of stochasticity, hysteresis is transitory: it shrinks with time and disappears as the system achieves the stationary state.

In order to compute an estimate of the convergence rate to equilibrium we make use of entropy methods28,27 and define the entropy norm as $$G= \int _{0}^{\infty } H(u(\tau ,x)){p}^{* }(x){\rm{d}}x$$ where $$H(u(\tau ,x))$$ is a convex function in $$u$$, that in this study has been chosen to be $$H(u)={u}^{2}-1$$, with $$u=p(\tau ,x)/{p}^{* }(x)$$. According to Pájaro et al.28 and Cañizo et al.27, $$G$$ satisfies the following differential inequality:

$$\frac{{\rm{d}}G}{{\rm{d}}\tau }\le -\eta G,$$
(8)

where $$\eta$$ is a positive constant (its dimension is the inverse of time) related to regulation (parameters $$H$$ and $$K$$), as well as the transcription-translation kinetics ($$a$$, $$b$$). The smaller $$\eta$$, the slower its convergence toward the corresponding equilibrium solution. Computing $$\eta$$ requires a full simulation of (6) until the system reaches the equilibrium distribution for each parameter on a given range, what is computationally involved. In this work, the PIDE model (6) is solved by using the semi-lagrangian method implemented in the toolbox SELANSI18.

Alternatively, we provide a truncation method to approximate the rate of convergence that we use here for verification purposes. The method makes use of the discrete jump process representation (see Supplementary Fig. 3), which is a precursor of Friedman PIDE model, by making the protein amount a continuous variable17. With this method (see Methods section) we compute the negative eigenvalue with smallest absolute value of the state change matrix $${\mathcal{M}}$$ which we refer to as $${\lambda}_{1}$$. This eigenvalue is a good approximation of the convergence rate $$\eta$$.

Figure 2 compares the eigenvalue $${\lambda }_{1}$$ with the convergence rate $$\eta$$ obtained by simulation, for different values of the parameter $$b$$. In the parameter range where bimodal distributions occur, the negative eigenvalue $${\lambda }_{1}$$ is a good approximation of the convergence rate of the PIDE model. The figure also shows how the smaller $$\eta$$ values correspond to the solution near equilibrium which lies within the hysteresis region in the $$b$$ parameter space. Remarkably, low convergence rates coincide with the parameter region in which bimodal behavior take place.

The estimation of the convergence rate (either in terms of $$\eta$$ or $${\lambda }_{1}$$) can be obtained from kinetic coefficients $$a$$ and $$b$$ previously estimated from experiments. To that purpose, we can use the PIDE model to find by least squares from typically time dependent distributions obtained from a cell population by flow cytometry, the best set of parameters. Alternatively, distributions could be reconstructed from single cell time series. With the resulting model, simulations will be executed to estimate rate of convergence.

This example has served as a proof of concept to clarify how hysteresis, as it is known in deterministic nonlinear systems (i.e., as a long-term stationary phenomenon) has not an equivalence in a microscopic world governed by a CME. For stochastic systems, hysteretic behavior is a transitory phenomenon, i.e., it can be only obtained under transients that may resemble stationary solutions due to the extremely slow dynamics at which bimodal distributions evolve. Nonetheless, some correspondence can be drawn between the most frequently visited states on a microscopic system and the stable states on the deterministic counterpart (see Supplementary Note 1).

Figure 3 shows that the logarithm of the eigenvalue decreases as the parameters $$a$$ and $$b$$ become higher and smaller, respectively. Variations of the logarithm of the eigenvalue are more pronounced inside the bimodal (if one of the peaks lies at zero the bimodal distribution is also known as binary) and bistable regions. Moreover, as discussed by Pájaro et al.30, as the parameter $$a$$ increases the system approaches the thermodynamic limit.

### Hysteresis in a mutual repression gene network

We consider the gene regulatory network in Ellis et al.31 and Wu et al.13, where the Lacl promoter is repressed by the protein expressed by the TetR promoter and vice versa, and ATc is used to inhibit the expression of TetR (see details in Supplementary Note 2).

We simulate the dynamics from two different initial conditions, $${p}_{0}={\mathcal{N}}([600,10],5{\rm{I}})$$ and $${p}_{0}={\mathcal{N}}([50,200],5{\rm{I}})$$, and take snapshots at 50, 100, and 150 h. In Fig. 4, we depict the dose–response curves at $$t=100$$ h for each initial condition (red and blue lines, respectively) and the stationary dose–response curve. It can be observed clearly how hysteresis disappears at the stationary. Note that the transient hysteresis observed at $$t=100$$ h is in agreement with experimental observations by Wu et al.13.

The transient distributions are depicted in Supplementary Figs. 4 and 5 representing the corresponding marginal distribution for the same snapshots. As it is shown, the distribution at 50 h resembles a stationary distribution, since no significant differences are observed with those obtained at $$t=100$$ h and even at $$t=150$$ h. However, comparing those distributions with the stationary distribution (see also third row in Supplementary Fig. 6), we clearly conclude that the system is not at the stationary state. Thus, the corresponding dose–response curve at $$t=50$$ h describes a transient hysteresis phenomenon. Note that as shown in Supplementary Figs. 6 and 7 even snapshots taken at much longer times (e.g., 1500 h) still differ significantly from the stationary solution.

The results for $$t=50$$ h are coherent with the observation by Wu et al.13 that if a trajectory starts clearly within one of the basins of attraction remains there for a long time. Note that the time needed to reach the stationary state might be longer than the natural timescales of relevance to the process. This is in accordance with Wu et al.13 where the transitions are characterized as stochastic yet irreversible.

The convergence rates of the solution toward the equilibrium are depicted in Fig. 5. As it happens for the 1D example in Fig. 2 the parameter region leading to bimodal distributions corresponds with the slowest convergence rates; such slow dynamics is responsible for the phenomenon of transient hysteresis.

Supplementary Fig. 8 compares the set of stable and unstable equilibrium states obtained from a deterministic representation with the most and least probable microscopic states, respectively. Note that this equivalence does not support the existence of long-term (stationary) hysteresis at the microscopic level. Essentially, what the picture shows is that, rather than a parameter-dependent preferential state among two stable ones, there are two highly probable states that coexist for a given parameter region on a cell population.

## Discussion

These results provide us with an important insight on how to interpret experimental results showing hysteretic behavior at the level of gene regulatory networks: if the system is governed by the CME, hysteresis is necessarily transient. Note that for slow dynamics (high $$a$$ and low $$b$$ values) the time needed to reach the stationary state might be longer than the natural timescales of relevance to the process. This is in accordance with previous studies reporting large mean passage times14 and also with Wu et al.13 where they engineer a synthetic switch with stochastic yet irreversible transitions (the same mutually inhibitory gene regulatory motif is analyzed next using our PIDE approach).

The characterization of a cell response as hysteretic or non-hysteretic is important. For example, in a a recent study concerning epithelial to mesenchymal transition (EMT), a process through which epithelial cells transdifferentiate into a mesenchymal cell fate, the authors characterize two types of responses, hysteretic and non-hysteretic EMT, and report the notable influence of hysteresis on the metastatic ability of cancer cells32.

Invoking pseudo-potential concepts to interpret dynamics in GRN under fluctuations13, although attractive from an intuitive point of view, may be misleading since it cannot capture the notion of coexistence. By coexistence we mean that two different protein expression levels coinciding with the peaks of the bimodal distribution coexist on a cell population (assuming no cell to cell variability on the initial conditions).

The pseudo-potential landscape is not easy to compute either, specially when increasing the number of proteins expressed. Alternatively, we can use the stationary solution of (6) to construct on the natural framework of probability distributions, a landscape informing of the possible transitions or evolution of the underlying microscopic system. As we illustrate in the example discussed in the supplementary material, its computation can be extended in a straightforward manner to larger dimensional protein spaces. This can be of use to efficiently identify most prevalent phenotypes coexisting on a given cell population.

The main assumption of the PIDE model is protein bursting (mRNA degrading faster than proteins). As reported in Pájaro et al.17, the approximation remains generally valid even for degradation rate ratios around 2–3 (5 in the most restrictive cases). In terms of protein copy numbers, although the PIDE model is valid in any range, we expect a significant effect of the inherent intrinsic noise for low copy numbers (in the order of thousands and lower). Note that, for prokaryotic cells this is the case for the majority of the proteins33. Although in eukaryotic cells proteins are in general more abundant there is still a significant portion of the cases for which the copy numbers appear to be low (see for example, Schwanhausser et al.34, Shi et al.35, Nguyen et al.36). We would like to remark that extrinsic noise is not taken into account in this study since we are quantifying the effect of intrinsic noise in hysteresis.

## Methods

### Stochastic model and simulation

We use the PIDE model17 described in Eq. (6). The model is simulated by a semi-lagrangian method implemented in the toolbox SELANSI18.

### Rates of convergence (truncation method)

Let $${\mathcal{P}}:{{\mathbb{R}}}_{+}\times {\mathbb{N}}\to [0,1]$$, be the probability of having $$n$$ proteins at time $$\tau ={\gamma }_{x}t$$. The time evolution of $${\mathcal{P}}(\tau ,n)$$ is given by the following CME with jumps that reads

$$\frac{{\mathrm{d}}{\mathcal{P}}(\tau ,n)}{{\mathrm{d}}\tau }=\sum _{i=0}^{n-1}{g}_{i}^{n}{\mathcal{P}}(\tau ,i)-\sum _{i=n+1}^{\infty }{g}_{n}^{i}{\mathcal{P}}(\tau ,n)+(n+1){\mathcal{P}}(\tau ,n+1)-n{\mathcal{P}}(\tau ,n),$$
(9)

where the transition probability $${g}_{i}^{j}$$ is proportional to the production rate of messenger RNA, so that

$${g}_{i}^{j}:= \frac{a}{b}c(i){e}^{\frac{i-j}{b}},\quad \forall j\,> \,i.$$
(10)

In order to obtain an approximation of the convergence rate of the PIDE model toward the stationary state, we use the truncated form of the discrete Eq. (9). Let $$N$$ be the maximum possible number of proteins. Then, Eq. (9) can be written in matrix form as

$$\frac{{\mathrm{d}}{\mathcal{P}}(\tau ,n)}{{\mathrm{d}}\tau }={\mathcal{M}}{\mathcal{P}}(\tau ,n),$$
(11)

where the matrix $${\mathcal{M}}$$ reads

$${\mathcal{M}}=\left(\begin{array}{ccccccc}-{d}_{0}&1&0&\cdots \ &0&0&0\\ {g}_{0}^{1}&-{d}_{1}&2&\cdots \ &0&0&0\\ {g}_{0}^{2}&{g}_{1}^{2}&-{d}_{2}&\ddots &0&0&0\\ \vdots &\vdots &&\ddots &\ddots &&\vdots \\ {g}_{0}^{N-2}&{g}_{1}^{N-2}&{g}_{2}^{N-2}&\cdots \ &-{d}_{N-2}&(N-1)&0\\ {g}_{0}^{N-1}&{g}_{1}^{N-1}&{g}_{2}^{N-1}&\cdots \ &{g}_{N-2}^{N-1}&-{d}_{N-1}&N\\ {g}_{0}^{N}&{g}_{1}^{N}&{g}_{2}^{N}&\cdots \ &{g}_{N-2}^{N}&{g}_{N-1}^{N}&-{d}_{N}\end{array}\right),$$
(12)

with the elements of the diagonal $${d}_{i}$$ being of the form

$${d}_{i}=\left\{\begin{array}{ll}i+\sum\nolimits _{n=i+1}^{N}{g}_{i}^{n}&{\mathrm{if}}\, i=0,\ldots ,N-1,\\ N&{\rm{if}}\,i=N,\end{array}\right.$$
(13)

equivalently

$${d}_{i}=i+\frac{ac(i)}{b\left({e}^{\frac{1}{b}}-1\right)}\left(1-{e}^{\frac{i-N}{b}}\right)\ {\rm{for}}\ i=0,\ldots ,N.$$
(14)

The steady state is given by the null space of matrix $${\mathcal{M}}$$, which is spanned by the normalized eigenvector associated to the unique zero eigenvalue, as the associated eigenspace has dimension one. Actually, since the graph associated to matrix $${\mathcal{M}}$$ (See Supplementary Fig. 3) has one trap, all the eigenvalues are negative except one (which is zero)37. By $${\lambda }_{1}$$, we denote the negative eigenvalue closer to zero, i.e., the one with smallest absolute value.

### Reporting summary

Further information on research design is available in the Nature Research Reporting Summary linked to this article.

## Data availability

All relevant data needed to reproduce the results are included in the text and supplementary information.

## Code availability

The semi-lagrangian method to simulate the PIDE model is freely avaliable and can be downloaded at: https://github.com/selansi/Selansi.

## References

1. 1.

Veening, J. W., Smits, W. K. & Kuipers, O. Bistability, epigenetics and bet-hedging in bacteria. Annu. Rev. Microbiol. 62, 193–210 (2008).

2. 2.

Losick, R. & Desplan, C. Stochasticity and cell fate. Science 320, 65–68 (2008).

3. 3.

Van Kampen, N. G. Stochastic Processes in Physics and Chemistry. 3rd edn (Elsevier, Netherlands, 2007).

4. 4.

Lestas, I., Paulsson, J., Ross, N. E. & Vinnicombe, G. Noise in gene regulatory networks. IEEE Trans. Autom. Control 53, 189–200 (2008).

5. 5.

Ozbudak, E. M., Thattai, M., Lim, H. N., Shraiman, B. I. & van Oudenaarden, A. Multistability in the lactose utilization network of Escherichia coli. Nature 427, 737–740 (2004).

6. 6.

Thomas, P., Popovic, N. & Grima, R. Phenotypic switching in gene regulatory networks. Proc. Natl Acad. Sci. USA 111, 6994–6999 (2014).

7. 7.

Gnügge, R., Dharmarajan, L., Lang, M. & Stelling, J. An orthogonal permease-inducer-repressor feedback loop shows bistability. ACS Synth. Biol. 5, 1098–1107 (2016).

8. 8.

Hsu, C., Jaquet, V., Gencoglu, M. & Becskei, A. Protein dimerization generates bistability in positive feedback loops. Cell Reports 16, 1204–1210 (2016).

9. 9.

Xiong, W. & Ferrell, J. E. A positive-feedback-based bistable ‘memory module’ that governs a cell fate decision. Nature 426, 460–465 (2003).

10. 10.

Wang, L. et al. Bistable switches control memory and plasticity in cellular differentiation. Proc. Natl Acad. Sci. USA 106, 6638–6643 (2009).

11. 11.

Ferrell, J. E. Bistability, bifurcations, and Waddington’s epigenetic landscape. Curr. Biol. 22, R458–R466 (2012).

12. 12.

Gupta, P. B. et al. Stochastic state transitions give rise to phenotypic equilibrium in populations of cancer cells. Cell 146, 633–644 (2011).

13. 13.

Wu, M. et al. Engineering of regulated stochastic cell fate determination. Proc. Natl Acad. Sci. USA 110, 10610–10615 (2013).

14. 14.

Scott, M., Hwa, T. & Ingalls, B. Deterministic characterization of stochastic genetic circuits. Proc. Natl Acad. Sci. USA 104, 7402–7407 (2007).

15. 15.

Fang, X. et al. Cell fate potentials and switching kinetics uncovered in a classic bistable genetic switch. Nat. Commun. 9, 2787 (2018).

16. 16.

Wang, J. Landscape and flux theory of non-equilibrium dynamical systems with application to biology. Adv. Phys. 64, 1–137 (2015).

17. 17.

Pájaro, M., Alonso, A. A., Otero-Muras, I. & Vázquez, C. Stochastic modeling and numerical simulation of gene regulatory networks with protein bursting. J. Theor. Biol. 421, 51–70 (2017).

18. 18.

Pájaro, M., Otero-Muras, I., Vázquez, C. & Alonso, A. A. SELANSI: a toolbox for Simulation of Stochastic Gene Regulatory Networks. Bioinformatics 34, 893–895 (2018).

19. 19.

Ochab-Marcinek, A. & Tabaka, M. Transcriptional leakage versus noise: a simple mechanism of conversion between binary and graded response in autoregulated genes. Phys. Rev. E 91, 012704 (2015).

20. 20.

Pájaro, M., Alonso, A. A. & Vázquez, C. Shaping protein distributions in stochastic self-regulated gene expression networks. Phys. Rev. E 92, 032712 (2015).

21. 21.

Alon, U. An Introduction to Systems Biology. Design Principles of Biological Circuits. (Chapman & Hall/CRC, London, 2007).

22. 22.

To, T. L. & Maheshri, N. Noise can induce bimodality in positive transcriptional feedback loops without bistability. Science 327, 1142–1145 (2010).

23. 23.

Friedman, N., Cai, L. & Xie, X. S. Linking stochastic dynamics to population distribution: an analytical framework of gene expression. Phys. Rev. Lett. 97, 168302 (2006).

24. 24.

Otero-Muras, I., Yordanov, P. & Stelling, J. Chemical reaction network theory elucidates sources of multistability in interferon signaling. PLoS Comp. Biol. 13, e1005454 (2017).

25. 25.

Dar, R. D. et al. Transcriptional burst frequency and burst size are equally modulated across the human genome. Proc. Natl Acad. Sci. USA 109, 17454–17459 (2012).

26. 26.

Ozbudak, E. M., Thattai, M., Kurtser, I., Grossman, A. D. & van Oudenaarden, A. Regulation of noise in the expression of a single gene. Nature Genet. 31, 69–73 (2002).

27. 27.

Cañizo, J. A., Carrillo, J. A. & Pájaro, M. Exponential equilibration of genetic circuits using entropy methods. J. Math. Biol. 78, 373–411 (2019).

28. 28.

Pájaro, M., Alonso, A. A., Carrillo, J. A. & Vázquez, C. Stability of stochastic gene regulatory networks using entropy methods. IFAC-PapersOnLine 49, 1–5 (2016).

29. 29.

Hsu, C., Jaquet, V., Maleki, F. & Becskei, A. Contribution of bistability and noise to cell fate transitions determined by feedback opening. J. Mol. Biol. 428, 4115–4128 (2016).

30. 30.

Pájaro, M. & Alonso, A. A. On the applicability of deterministic approximations to model genetic circuits. IFAC-PapersOnLine 49, 206–211 (2016).

31. 31.

Ellis, T., Wang, X. & Collins, J. J. Diversity-based, model-guided construction of synthetic gene networks with predicted functions. Nat. Biotechnol. 27, 465–471 (2009).

32. 32.

Celià-Terrassa, T. et al. Hysteresis control of epithelial-mesenchymal transition dynamics conveys a distinct program with enhanced metastatic ability. Nat. Commun. 9, 5005 (2018).

33. 33.

Soufi, B., Krug, K., Harst, A. & Macek, B. Characterization of the E. coli proteome and its modifications during growth and ethanol stress. Front. Microbiol. 6, 103 (2015).

34. 34.

Schwanhäusser, B. et al. Global quantification of mammalian gene expression control. Nature 473, 337–342 (2011).

35. 35.

Shi, T. et al. Conservation of protein abundance patterns reveals the regulatory architecture of the EGFR-MAPK pathway. Sci. Signal. 9, rs6 (2016).

36. 36.

Nguyen, C. et al. A sensitive and simple targeted proteomics approach to quantify transcription factor and membrane proteins of the unfolded protein response pathway in glioblastoma cells. Sci Rep. 9, 8836 (2019).

37. 37.

Fife, D. Which linear compartmental systems contain traps? Math. Biosci. 14, 311–315 (1972).

## Acknowledgements

M.P. and A.A.A. acknowledge funding from grant PIE201870E041; I.O.M. acknowledges funding from Spanish MINECO (and the European Regional Development Fund) project SYNBIOCONTROL (grant number DPI2017-82896-C2-2-R). C.V. has been partially funded by the spanish MINECO project MTM2016-76497-R and Xunta de Galicia grant ED431C2018/033.

## Author information

Authors

### Contributions

A.A.A. and I.O.M. conceived the research. M.P. and A.A.A. performed the research. C.V., M.P., I.O.M., and A.A.A. contributed to the simulation methods. A.A.A., M.P., I.O.M., and C.V. wrote the paper. A.A.A. supervised the project.

### Corresponding author

Correspondence to A. A. Alonso.

## Ethics declarations

### Competing interests

The authors declare no competing interests.

Peer review information Nature Communications thanks Attila Becskei and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. Peer reviewer reports are available.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Reprints and Permissions

Pájaro, M., Otero-Muras, I., Vázquez, C. et al. Transient hysteresis and inherent stochasticity in gene regulatory networks. Nat Commun 10, 4581 (2019). https://doi.org/10.1038/s41467-019-12344-w

• Accepted:

• Published:

• ### Pareto optimality between growth-rate and lag-time couples metabolic noise to phenotypic heterogeneity in Escherichia coli

• Diego Antonio Fernandez Fuentes
• , Pablo Manfredi
• , Urs Jenal
•  & Mattia Zampieri

Nature Communications (2021)