Article | Open | Published:

On chaotic dynamics in transcription factors and the associated effects in differential gene regulation

Abstract

The control of proteins by a transcription factor with periodically varying concentration exhibits intriguing dynamical behaviour. Even though it is accepted that transcription factors vary their dynamics in response to different situations, insight into how this affects downstream genes is lacking. Here, we investigate how oscillations and chaotic dynamics in the transcription factor NF-κB can affect downstream protein production. We describe how it is possible to control the effective dynamics of the transcription factor by stimulating it with an oscillating ligand. We find that chaotic dynamics modulates gene expression and up-regulates certain families of low-affinity genes, even in the presence of extrinsic and intrinsic noise. Furthermore, this leads to an increase in the production of protein complexes and the efficiency of their assembly. Finally, we show how chaotic dynamics creates a heterogeneous population of cell states, and describe how this can be beneficial in multi-toxic environments.

Introduction

The regulation and control of protein production is a vital element in all living organisms. This process can be highly complicated, involving a large number of steps. However, despite stochastic fluctuations, life is characterised by a high level of organisation indicative of very precise regulation. A thorough understanding of the mechanisms and interactions that maintain the precision of regulation is absent, but the prospect of discerning and ultimately controlling the production of specific proteins is one of the great goals in the field of systems biology.

Control of transcription is a ubiquitous means of regulating gene expression, but it has only recently been appreciated that transcription factor dynamics might be important for gene regulation. For instance, oscillations have been observed in key transcriptional factors, such as the p53 tumour suppressor or NF-κB, which regulates numerous genes involved in immune response1,2,3,4,5,6,7. Debate continues about the functional role, if any, of these oscillations, but it is clear that altering the dynamics of these transcription factors differentially affects downstream genes1,2,4,8.

Oscillatory dynamics is the prerequisite for many complex phenomena—and in the present study for the onset of chaotic dynamics. Chaos refers to complex, apparently unpredictable, dynamics that even simple deterministic dynamical systems can produce (see section What is chaos?). A universal way to achieve chaos is by driving a nonlinear oscillator (say the NF-κB system) by an external periodic signal (e.g., by periodically varying a cytokine-like tumor necrosis factor (TNF) that triggers NF-κB oscillations). When the external driving signal has low amplitude oscillations, it can entrain or synchronise the nonlinear oscillator, i.e., if TNF is varied within certain frequency ranges it will force the NF-κB oscillations to occur with the externally imposed frequency8,9. As the amplitude of TNF oscillations is increased, the range of frequencies for which it can entrain NF-κB becomes larger—these expanding synchronisation regions of the external amplitude–frequency parameter space are called Arnold tongues10,11,12. Such entrainment/synchronisation13 has been observed in many different physical systems, from fluids14 to quantum mechanical devices15,16, and now also in biological processes, such as cell cycles17,18,19, and gene regulatory dynamics in synthetic populations20. The dynamics gets even more complex as the amplitude of the external driving signal increases further. First, Arnold tongues start overlapping, which means the nonlinear oscillator can exist in more than one entrained state with different frequencies (termed modes), and even small amounts of intrinsic or extrinsic noise can cause it to hop between these modes. Such mode-hopping has been observed in the NF-κB system when driven by a periodically varying TNF signal of sufficiently high amplitude21. When the external amplitude is increased even further, then chaotic dynamics is predicted11,12.

In this paper, we study the possible implications of oscillatory and chaotic dynamics of a transcription factor, such as NF-κB, on the downstream genes it controls. We compare the expression of genes with different affinities to the transcription factor, and show that chaotic dynamics has differential effects on genes with different affinites. This can be exploited, for instance, to up-regulate certain proteins, or specific protein complexes. We also show how chaotic dynamics can generate heterogeneity in a cell population that can provide a selective advantage in multi-toxic environments. Our work provides a theoretical framework to study the effects of dynamically varying transcription factors, and we believe it constitutes one of the first investigations into how chaotic dynamics might influence genetic regulation in living cells.

Results

The model

Our investigation starts with a model of the transcription factor NF-κB that is known to exhibit oscillatory dynamics3,9,22. A schematic version of this is found in Fig. 1a and a full description is presented in the Supplementary Note 1. In this deliberately simplified model, the oscillations arise from a single negative feedback loop between NF-κB and its inhibitor IkBα, and can be triggered by TNF via the activation of the IkB kinase (IKK). We then allow TNF to oscillate. This system exhibits Arnold tongues (shown schematically in Fig. 1c), which are regions of parameter space where the NF-κB oscillation is entrained to the external TNF oscillation9, i.e., it locks on to the external signal’s frequency and phase. Outside the Arnold tongues there is no synchronisation. It is straightforward to add intrinsic noise to this system by explicitly modelling the randomness in binding/unbinding of proteins, phosphorylation, as well as transcriptional and translation processes using the Gillespie algorithm23 (see Supplementary Note 2 and Supplementary Figure 1C for details). Figure 1c right panel shows that this system exhibits single-mode oscillations (for low amplitude TNF oscillations), mode-hopping (intermediate amplitude) and chaos (high amplitude) in this system, as was first noted in ref. 21. Note that changes in a single parameter are sufficient to obtain all these different dynamics.

Fig. 1
figure1

Dynamics from coupled oscillators and emergence of chaos. a Schematic picture of a simplified NF-κ B network with a single negative feedback loop which can generate oscillations. b Schematic picture of oscillations in the external TNF concentration, represented by the changing shade of blue. c Dynamics that emerges when the NF-kB system is driven by a periodic TNF signal. The left panel shows schematically that there are Arnold tongues, triangular regions of the TNF amplitude-period parameter space where NF-kB oscillations can be synchronised to the TNF signal. Outside the Arnold tongues, e.g. point 0, there is no synchronisation. As TNF amplitude increase the Arnold tongues start overlapping and the behaviour becomes more complex. Keeping the TNF period fixed (here we used T = 50 min), as we increase the the TNF amplitude we enter three distinct states: Point 1: A single Arnold tongue, only allowing one oscillation state. Point 2: Overlap of Arnold tongues, allowing two stable oscillation states. The presence of noise can cause transitions (mode-hopping). Point 3: Chaotic dynamics, with apparently unpredictable trajectories. The trajectories corresponding to these points are shown in in the middle panels. Red and blue trajectories correspond to two different initial conditions in a deterministic simulation. The rightmost panels show the dynamics of NF-κ B vs. time in stochastic simulations where intrinsic noise is implemented using the Gillespie algorithm. d Schematic figure of the polymerase binding for genes that have NF-κB (green spheres) as a transcription factor. e Profile of the Hill function in Eq. (2) for different values of affinity and cooperativity. Red: h = 2 and K = 1.0 (HAG). Purple: h = 4 and K = 4.5 (LAG). Green: Example of intermediate values with h = 3 and K = 2.0 (MAG). Vertically, light blue: a representative NF-κB oscillation

To the above model, we now add genes that are regulated by NF-κB, following the approach of Mengel et al. 4. We assume that NF-κB can bind to an enhancer or operator region, and can form complexes to bind the RNA polymerase, with different affinity, depending on the gene (schematically shown in Fig. 1d). We describe the transcription and translation of each gene, labelled i = 1, 2, 3,…, using the differential equations:

$$\dot m_i = \gamma _i\frac{{N^{h_i}}}{{N^{h_i} + K_i^{h_i}}} - \delta _im_i,$$
(1)
$$\dot P_i = {\mathrm{\Gamma }}_im_i - {\mathrm{\Delta }}_iP_i.$$
(2)

Here, the mi represent the mRNA level transcribed from gene i, and Pi represents the concentration of proteins produced from the correspnding mRNA. The first term in the equation for the mRNA is known as a Hill function; the canonical way to describe the protein production for genes governed by transcription factors where each gene has a specific Hill coefficient and effective affinity4,24,25,26,27.

The effective affinity Ki is a parameter that combines the strength of binding of the transcription factor to the operator/enhancer region, the strength of binding of RNA polymerase to the promoter and transcription factor, as well as the effect of DNA looping that may be needed to bring the enhancer/operator close to the promoter region. Operationally, Ki sets the concentration of NF-κB that results in 50% of maximal gene expression enhancement. The Hill coefficient hi is a measure of the cooperativity of the transcription factor at that gene. A thorough description of this is presented in Supplementary Note 3, and representations of the sigmoidally shaped curves are shown in Supplementary Figure 1. γi and Γi are the maximal transcription and translation rates for the gene, while δi and Δi are inversely proportional to the half-lives of the mRNA and protein, respectively. While all these parameters affect the behaviour of genes described by these equations, the affinity Ki is particularly important. In particular, as we will demonstrate in subsequent sections, high-affinity genes (HAGs) with low Ki behave quite differently from low-affinity genes (LAGs) with high Ki. In Fig. 1e the values of the Hill function Nh/(Kh + Nh) as NF-κB level N varies are shown, along with a typical single-mode NF-κB oscillation. It is clear from the figure that the same NF-κB oscillation would be expected to excit HAGs and LAGs to different levels.

What is chaos?

When we speak of chaos, we refer to deterministic chaos. Deterministic means that if one knows the initial state of the system exactly, then the dynamical trajectory will be the same every time it is initiated in that state. However, any two initial conditions infinitesimally apart will have exponentially diverging trajectories as time proceeds making it practically impossible to predict the future dynamics—hence chaos28,29,30,31. It is important to note that the unpredictability of chaos does not arise from stochasticity—the latter refers to a non-deterministic system with noise. Noise is observed in most real-world systems and can often result in very different dynamics than the deterministic version of the same system. For example, noise can cause transitions between different states which would never occur if the system were deterministic. Thus, both deterministically chaotic and noisy systems exhibit unpredictability of their future trajectories, but for very different underlying reasons.

Chaos enhances LAGs

We simulate our model of the NF-κB system, with periodically varying TNF and intrinsic noise, along with downstream genes with different affinities and cooperativities. We then measure the average protein concentration associated with each gene over timescales much longer than the half-lives of the mRNA and proteins. This long-term average is the simplest measure of the effect of NF-κB oscillations on gene expression. As shown in Fig. 2, we find that as TNF amplitude increases, we obtain very different behaviour for HAGs, LAGs and genes with intermediate affinity (MAGs). As described above and in Fig. 1, as TNF amplitude is increased, keeping its frequency fixed, the NF-κB dynamics is first a single-mode oscillation (point 1 in Fig. 1c), then exhibits mode-hopping (point 2 in Fig. 1c) and finally chaos (point 3 in Fig. 1c) for high amplitude TNF. The ranges of TNF amplitude which exhibit these three qualitatively different dynamics are indicated in Fig. 2a–c.

Fig. 2
figure2

Effects of chaos on protein production. a The average protein level from an HAG (K = 4.5, h = 4), for different values of the TNF amplitude. We performed four separate simulations of duration 5*105 min. and show their individual means and the mean of these four combined. We used V = 2*10−14L and T = 50 min. Results for other periods are found in SI. b Same as a but for MAG (K = 2, h = 3). c Same as a but for LAG (K = 1, h = 2). d The average production from the HAG for different intrinsic noise levels. We performed simulations of duration 1*105 min each datapoint and used the total mean as calculated in ac. Here T = 50 min. e Same as d but for the MAG. f Same as d but for the LAG. g The average production from the HAG for different extrinsic noise levels. We performed simulations of duration 1*105 min each datapoint and used the total mean as calculated in a and b. We added Langevin noise to the oscillator and used \(\dot r = r(1 - r)\) and \(\dot \theta = \nu\), and in the last dataseries (yellow *) we used the Van der Pol oscillator with noise as a perturbation to TNF (see Supplementary Note 4). Here T = 50 min. h Same as g but for the MAG. i Same as g but for the LAG. j The average production from the HAG, for different values of the TNF amplitude and period. The bright colours indicate the maximal average protein levels, while the dark colours correspond to low average protein levels. k Same as j but for the MAG. l Same as j but for the LAG

The chaotic regime shows the differential behaviour of the different genes most clearly. The HAG has a linearly decreasing average protein level as TNF amplitude is increased, while the LAG shows exactly the opposite. The MAG exhibits much less variation with TNF amplitude. It is interesting that genes under control of NF-κB can thus be designed to have increasing, decreasing, as well as relatively flat response to variation of a single parameter. The increasing (decreasing) trend that is seen for LAGs (HAGs) within the chaotic regime is also seen across the entire range of TNF amplitudes, going from single-mode oscillations through mode-hopping to chaos. However, within the first two regimes the response is relatively flat with major change happening only near the transition between regimes. Overall, we see that both HAGs and LAGs could exhibit fold-changes on the order of two-fold, which we believe should be observable in experiments, while MAGs could lie within experimental error and thus appear effectively unresponsive to TNF amplitude.

A mathematical analysis of this behaviour provides some intuition to understand why HAGs and LAGs respond so differently: The long-term average protein level is essentially proportional to the average of the Hill function over the same long timescale: \(\langle P\rangle \sim \left\langle {\frac{{N^{\mathrm {h}}}}{{K^{\mathrm {h}} + N^{\mathrm {h}}}}} \right\rangle .\) For HAGs, K is small, and to lowest order in K/N, \(\langle P\rangle \sim 1 - K^{\mathrm {h}}\left\langle {\frac{1}{{N^{\mathrm {h}}}}} \right\rangle\). In contrast, for LAGs, K is large, and \(\langle P\rangle \sim \frac{{\left\langle {N^{\mathrm {h}}} \right\rangle }}{{K^{\mathrm {h}}}}\) (see Supplementary Note 4 for further details). The averages 〈Nh〉 and 〈1/Nh〉 depend on the probability distribution of NF-κB values over a long time series. This distribution is typically unimodal, but is asymmetric and has a long right tail (see Supplementary Figure 2K–L). Now 〈Nh〉 is largely dominated by this right tail, especially for large h. Thus, if the right tail of this distribution became more prominent as TNF amplitude was increased, we would expect 〈Nh〉 to increase and this would explain why LAGs show an increasing average protein level, while 〈1/Nh〉 in contrast is dominated by the other end of the probability distribution, i.e., very low values of N. Thus, if the probability of NF-κB spending time at low concentrations increased with TNF amplitude, then 〈1/Nh〉 would increase, and the average protein level of LAGs would decrease. Supplementary Figure 2K–L shows that this is indeed what happens to the probability distribution of NF-κB as TNF amplitude is increased—both within the chaotic regime, as well as across single-mode oscillations, mode-hopping and chaos. Thus, we conclude that the differential control of HAGs vs. LAGs is directly caused by the broadening of the range of NF-κB levels as one goes deeper into the chaotic regime. The increase of peak NF-κB levels and the decrease of minimum NF-κB levels are both necessary for such differential control.

Robustness to variations in parameters and noise

We tested our central result from the previous section at other TNF frequencies (see the heatmaps in Fig. 2j–l and Supplementary Figure 2A–F) and, for TNF time period in the range 30–120 min, we found the same trends in average protein levels, as a function of TNF amplitude.

Since biological systems are often characterised by large fluctuations and much noise, we also varied the level of intrinsic noise in the NF-κB system by varying the effective volume of the system. Decreasing the volume leads to larger fluctuations, but as shown in Fig. 2d–f, the average protein levels are quite robust to such increases of intrinsic noise. The mode-hopping region is of specific interest to changes in noise, since these affect the rate at which the system jumps from one entrained state to another32. The chaotic regime, in contrast, already exhibits many hallmarks of randomness even in the absence of noise, so adding noise does not affect the behaviour much.

Next, we also wanted to include extrinsic noise into the variation of TNF. In experimental procedures, as well as in vivo, it is of course very likely that there will be considerable stochasticity in the TNF signal. Could such fluctuations mask the differential control of genes, especially in the chaotic regime? We added Langevin noise to the periodic TNF waveform at a sufficiently high level to smear out the predominant frequency in a Fourier spectrum of the noisy waveform (see Supplementary Figure 2G-H). We found that this did not affect our results—NF-κB still showed the same transition from single-mode oscillation to mode-hopping to chaos as TNF amplitude was increasing, and HAGs and LAGs showed the same opposite trends in average protein level as in the absence of TNF noise (Fig. 2g–i). As with intrinsic noise, the extrinsic noise had most effect in the mode-hopping regime and minimal effect in the chaotic regime.

Finally, we also found that our results were unchanged when we used non-sinusoidal waveforms for TNF (Supplementary Figure 2I), and when we varied the Hill coefficient (Supplementary Figure 2J). Thus, these results show that the enhancement of LAGs in chaotic dynamics is robust to both internal and external noise, and this effect is a striking feature of chaos in transcription factors for a large set of parameters.

Chaos increases efficiency in protein complex formation

In eukaryotic cells, many functions are carried out by complexes of proteins that are constructed from multiple subunits, for instance haemoglobin, that consists of four subunits from two genes that are located on different chromosomes. A study of the NF-κB interactome found that amongst 384 genes that are regulated by NF-κB there were 572 protein–protein interactions33. While these complexes have not been deeply investigated, we expect at least some will have a functional role. For instance, there seems to be evidence that NF-κB controls autophagy via multiple pathways, including the up-regulation of both Beclin 1 and A20, which interact with each other inhibiting Beclin 1 ubiquitination, and thereby repressing autophagy34. Therefore, we tested how the concentration of protein complexes, whose subunits were encoded by NF-κB controlled genes, was altered as the NF-κB dynamics became chaotic and the LAGs were up regulated.

We first consider a complex that consists of two subunits. In this case, the model has the following additional equations, where P1 and P2 represent the concentrations of the two proteins and C2,1 the concentration of the complex:

$$\dot P_1 = {\mathrm{\Gamma }}_1m_1 - \lambda _CP_1P_2 - {\mathrm{\Delta }}_1P_1,$$
(3)
$$\dot P_2 = {\mathrm{\Gamma }}_2m_2 - \lambda _CP_1P_2 - {\mathrm{\Delta }}_2P_2,$$
(4)
$$\dot C_{2,1} = \lambda _CP_1P_2 - {\mathrm{\Delta }}C_{2,1}.$$
(5)

In the following we will, in order to keep things as simple and transparent as possible, keep the values of the parameters λ and Δ fixed even though these could easily differ between complexes. An exploitation of the effects of the entire parameter space will be interesting to pursue in future work, but is beyond the scope of this paper. Obviously if the two subunits are both HAG proteins, the complex has the highest average level in the oscillatory regime, while if it consists of two LAG proteins, the highest average level will be found in the chaotic regime (Fig. 3b, c). However, if the complex is heterogeneous and consists of one HAG and one LAG subunit, as shown schematically in Fig. 3a, the result is not as obvious. Simulating the above equations for a heterogenous complex, we find a significantly higher level of the complex in the chaotic regime, as seen in Fig. 3e.

Fig. 3
figure3

Effects of chaos on protein complex formation. a Schematic picture of how LAG and HAG encoded proteins may form protein complexes. b Protein concentration for HAG (K = 1, h = 2) with oscillatory and chaotic dynamics, respectively. TTNF = 50 min. c Protein concentration for LAG with (K = 4.5, h = 4) oscillatory and chaotic dynamics, respectively. TTNF = 50 min. d Time series of NF-κB (yellow) and the corresponding protein level. Red: Level of HAG protein. Blue: Level of LAG protein (multiplied by 20). TTNF = 50 min. e Concentration of a heterogenous two-protein complex (shown upper left) with oscillatory and chaotic dynamics respectively. f Concentration of a heterogenous three-protein complex in chaotic dynamics depending on the hierarchical assembly (shown above). g Relative concentration for complexes of different compositions. The y-axis show the concentration in chaos divided by the concentration in the oscillatory regime, and the black line show where these are equal. h Relative concentration per NF-κB for complexes of different compositions measured by the fraction \(\frac{{\left\langle {C_{N,n_{\mathrm {H}}}} \right\rangle }}{{\langle {\mathrm {NFkB}}\rangle }}\). Same axis as in g. i Relative concentration per unused subunits for complexes of different compositions measured by the fraction \(\frac{{\left\langle {C_{N,n_{\mathrm {H}}}} \right\rangle }}{{\mathop {\sum}\nolimits_{i = 1}^N \langle P_i\rangle }}\). Same axis as in g. For gi, the exact ratios are found in the tables in Supplementary Note 5

We then test larger complexes. The concentration of the protein complex \(C_{n,n_{\mathrm{H}}}\) consisting of n subunits, of which nH are from an HAG and the rest from an LAG, is modelled by

$$\dot C_{n,n_{\mathrm {H}}} = \lambda \mathop {\prod}\limits_{i = 1}^n P_i - {\mathrm{\Delta }}_nC_{n,n_{\mathrm {H}}}.$$
(6)

For n = 3 and nH = 2, we found that the production was also highest in the chaotic regime and, before moving further, we tested whether the outcome was different if all complexes combined randomly (yellow curve in Fig. 3f), or if there was a hierarchical structure in the assembly (blue and red curves in Fig. 3f). As we see in Fig. 3f the outcome is quite similar, and we could therefore focus on the non-hierarchical assembly of complexes, calculated as shown above. We subsequently tested for n [2–10] and in each case we tried with all different different combinations of HAG and LAG subunits. Unexpectedly, we find that all heterogeneous complexes exhibit a higher average lvel in the chaotic regime (Fig. 3g). This means that only homogenous HAG complexes would be present at a high level in the single-mode oscillatory regime. One might ask, whether this is simply the result of higher mean levels of NF-κB. Therefore, we normalised the concentration of the complexes by the mean NF-κB concentration—when this ratio is large we will say the complexes are produced more efficiently. As seen in Fig. 3h, all complexes are produced more efficiently in the chaotic regime—even the homogenous HAG complexes. Another economical argument for the cell is that if only the complexes are of importance, then it is necessary to minimise the number of unused subunits. In Fig. 3i, we see the ratio between the average concentration of complexes to the concentration of unused subunits. This ratio too is largest in the chaotic regime for all complexes, except those made only from HAG proteins. Thus, a chaotically varying transcription factor not only up regulates LAGs, but also results in higher and more economical production of protein complexes composed of subunits from different genes.

Chaos generates advantageous population heterogeneity

We now consider how the dynamics of NF-κB can affect a population of cells. In the following, we consider the deterministic NF-κB system, and study a population of N independent cells that are affected by the same oscillating TNF stimulus. In all simulations, cells have randomly distributed initial conditions, i.e., the NF-κB oscillations in different cells are not initially synchronised. Within each cell, we will track one LAG and one HAG; parameters are chosen so that the two corresponding proteins have the same average protein level. In Fig. 4a–d we see that when NF-κB is in a single-mode oscillatory state, the average level of both Protein 1 and Protein 2 is homogenous across the population, whereas if NF-κB is mode-hopping then the distribution of protein levels across the populaiton is bimodal. In the chaotic regime, the distribution is broad and heterogenous for both proteins (Fig. 4e, f), but the LAG has on average a higher expression in this state (for TNFPeriod = 95 min, we note a special tail, which is caused by the occurrence of some high-frequency oscillations).

Fig. 4
figure4

Population heterogeneity emerges from chaos. a Protein concentration from an HAG with K = 1, h = 2 and external TNF period 50 min. Bottom: The concentration corresponding to a single-mode oscillation; TNF amplitude: 0.04. Middle: The concentration corresponding to mode-hopping; TNF amplitude: 0.12. Top: The concentration corresponding to chaos; TNF amplitude: 0.36. b Protein concentration from an LAG with K = 4.5, h = 4. TNF period 50 min. TNF amplitudes are identical to those used in a. c Protein concentration from the HAG. TNF period 95 min. Bottom: The concentration corresponding to a single-mode oscillation; TNF amplitude: 0.1. Middle: The concentration corresponding to mode-hopping; TNF amplitude: 0.2. Top: The concentration corresponding to chaos; TNF amplitude: 0.4. d Protein concentration from the LAG. TNF period 95 min. TNF amplitudes are identical to those used in c. e Distribution of protein concentrations in the chaotic state (TNF period: 50 min, TNF amplitude: 0.36). f Distribution of protein concentrations in the chaotic state (TNF period: 95 min, TNF amplitude: 0.4). g Number of surviving cells vs. time (drug is added at T = 4000 min). D1 = 6000, D2 = 0. h Same as g with D1 = 0, D2 = 6000. i Same as g with D1 = D2 = 3000. j Same as g with \(\dot D_{1 + 2} = {\cal N}(0,100.0)\) and D1+2(0) = 3000. The panel below shows a specific trajectory on this pattern. In general D1 is above D2 50% of the times and vice versa. k Same as g with \(D_{1 + 2}(t) = 3000 + 1500 \cdot {\mathrm {sin}}\left( {\frac{t}{{5000}} + {\mathrm{\Omega }}} \right)\). l Same as g with D1+2(t) = 7000 if \({\mathrm {sin}}\left( {\frac{t}{{5000}} + \Omega } \right) > \, 0.95\) and otherwise D1+2(t) = 3000

Such heterogeneity in a cell population can provide a selective advantage when the population is exposed to some potentially lethal stresses. Imagine each cell in the population is exposed to two toxic drugs at concentrations D1 and D2. We assume that at each time step each cell is killed with probability

$${\cal P}_{{\mathrm {Die}}} = {\cal P}_0\left( {\frac{{D_1^{\mathrm {h}}}}{{D_1^{\mathrm {h}} + P_1^{\mathrm {h}}}} + \frac{{D_2^{\mathrm {h}}}}{{D_2^{\mathrm {h}} + P_2^{\mathrm {h}}}}} \right).$$
(7)

This describes a situation where the two proteins P1 and P2 are stress-responders that can help the cell survive stressed conditions. \({\cal P}_0\) represents the probability that the drugs kill in the absence of the protective proteins. We consider the case where P1 is encoded by an HAG and P2 by an LAG, both under control of NF-κB.

First we consider the situation where only one of these drugs is present, shown in Fig. 4g, h. When only Drug 1 is added in a high amount, cells where NF-κB is in a single-mode oscillating state will have a higher survival rate than cells where NF-κB is mode-hopping or chaotic. This is what one would expect from Fig. 3, since HAG proteins are on average at higher levels in the single-mode oscillatory state. When only Drug 2 is added in a high amount, cells in chaotic states will have a slightly higher survival rate, but due to large fluctuations, these cells will also eventually die due to temporary low levels of Protein 2. Now we consider what will happen to the system if both drugs are added in a comparable amounts. We test four different patterns of adding the drugs (Fig. 4i–l) and find that the cells in the chaotic state will have significantly higher survival rate compared to the others. In the Supplementary Note 6, we provide some mathematical arguments for these results and here we also show tests of the robustness of these results, and here we found similar results as shown above (Supplementary Figure 3). From this we conclude that in the presence of multiple toxic drugs, a population of cells is better off having a large heterogeneity in gene expression and up regulating the LAGs and thus up regulating the product of genes. This is obtained in the chaotic regime for NF-κB dynamics and this enhances the survival rate.

Discussion

Transcription factors are known to have different dynamics, depending on external conditions, but how this may be exploited to differentially control downstream genes is not well understood. We have shown how dynamically varying transcription factors can differentially regulate genes based on an effective affinity that characterises the interaction between the gene and the transcription factor. In particular, we suggest that chaotic dynamics can produce differential control of high vs. LAGs, down regulating the former while simultaneously up regulating the latter. We show that this can be used not only to control single non-interacting genes, but also for upregulating specific complexes of proteins and generating useful heterogeneities in cell populations.

Our results are derived from a model of the NF-κB system. Such models have been used to explain numerous experimentally observed features of NF-κB oscillations3,35, and therefore form a good basis for our exploration of the effects on downstream genes. Our model has already successfully predicted the existence of mode-hopping for a range of TNF amplitudes21. Since chaotic behaviour within overlapping Arnold tongues is such a fundamental feature of driven nonlinear oscillators11,12,36, we are confident that NF-κB driven by sufficiently large TNF amplitudes will exhibit deterministic chaos. However, an experimental realisation of our model37,38 would necessarily be subject to various sources of noise and stochasticity, and it is not obvious that deterministically chaotic behaviour can be practically discerned in the presence of such fluctuations. Fortunately, many sophisticated methods exist that allow chaos to be distinguished from noise without requiring unreasonably long time series; see for example refs. 39,40. Once chaos is found in the NF-κB system, the next step of testing whether HAGs respond differently from LAGs can be tackled using genes that have previously investigated in the regime where NF-κB shows single-mode oscillations1,8. Since the expression level of some of these genes track NF-κB oscillations closely, while others track the mean NF-κB levels, it is likely that these genes already span a range of affinity values4. The robustness of our results to many parameter values suggests that these genes may be directly used to study the chaotic regime, without worrying too much about details, such as their maximal transcription/translation rates or the stabilities of the mRNA and proteins they encode.

Our model uses periodic variation of TNF to produce complex dynamics of NF-κB. Uncovering conditions where TNF naturally varies periodically and thereby entrains the NF-κB oscillations would add substantial weight to our results. Oscillatory dynamics is believed to be of importance to several processes in the immune system41 and there exists evidence that TNF does indeed vary in a pulsatile or periodic manner in some situations42,43,44,45, as well as mathematical models that attempt to explain the underlying mechanisms42,46, but it is unclear whether these natural oscillations entrain NF-κB. The positive feedback between NF-κB and TNF that has been hypothesised to produce travelling waves of TNF is perhaps the most promising scenario we are aware of where periodic TNF modulation may occur naturally46.

Chaotic dynamics has thus far been underestimated as a means for controlling genes, perhaps because of its unpredictability. Our work shows that deterministic chaos potentially expands the toolbox available for single cells to control gene expression dynamically and specifically. We hope this will inspire theoretical and experimental exploration of the presence and utility of chaos in living cells.

Methods

Simulations

All deterministic simulations were performed by numerically integrating the dynamical equations using the Runge–Kutta fourth-order method, and for optimisation reasons, some of the equations were simulated using Euler integration. Whenever Euler integration was used it was tested that it generated similar results as the Runge–Kutta fourth-order method. For all stochastic simulations of NF-kB dynamics, we used the Gillespie algorithm23. For noise in the external TNF oscillations we used Langevin simulations of the different oscillations.

Regions of chaos

To find the regions of parameter space that exhibit chaotic dynamics, we first computed the standard deviation in the NF-kB amplitudes from each time series, and found the parameter points at which this grew discontinuously, as we increased the TNF amplitude. Within these regions, we further tested for chaos by calculating the divergence of trajectories that started at almost identical initial points, using deterministic simulations. Parameter regions where such trajectories diverged exponentially were labelled as regions exhibiting chaos.

Code availability

All computer code is available upon request at heltberg@nbi.ku.dk or mhjensen@nbi.dk. The majority of scripts can also be found at https://github.com/Mathiasheltberg/ChaoticDynamicsInTranscriptionFactors.

Data availability

All the data in this paper, was generated using deterministic and stochastic simulations. All scripts to generate the data are available upon request at heltberg@nbi.ku.dk or mhjensen@nbi.dk. The majority of scripts can also be found at https://github.com/Mathiasheltberg/ChaoticDynamicsInTranscriptionFactors.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  1. 1.

    Hoffmann, A., Levchenko, A., Scott, M. L. & Baltimore, D. The IκB-NF-κB signaling module: temporal control and selective gene activation. Science 298, 1241–1245 (2002).

  2. 2.

    Nelson, D. E. et al. Oscillations in NF-κB signaling control the dynamics of gene expression. Science 306, 704–708 (2004).

  3. 3.

    Krishna, S., Jensen, M. H. & Sneppen, K. Spiky oscillations in NF-κB signalling. Proc. Natl Acad. Sci. USA 103, 10840–10845 (2006).

  4. 4.

    Mengel, B. et al. Modeling oscillatory control in NF-κB, p53 and Wnt signaling. Curr. Opin. Genet. Dev. 20, 656–664 (2010).

  5. 5.

    Levine, JoeH., Lin, H. & Elowitz, M. Functional roles of pulsing in genetic circuits. Science 342, 1193–1200 (2013).

  6. 6.

    Gonze, D., Halloy, J. & Goldbeter, A. Robustness of circadian rhythms with respect to molecular noise. Proc. Natl Acad. Sci. USA 99, 673–678 (2002).

  7. 7.

    Lahav, G. et al. Dynamics of the p53-Mdm2 feedback loop in individual cells. Nat. Genet. 36, 147 (2004).

  8. 8.

    Tay, S. & Kellogg, R. Noise facilitates transcriptional control under dynamic inputs. Cell 160, 381–392 (2015).

  9. 9.

    Jensen, M. H. & Krishna, S. Inducing phase-locking and chaos in cellular oscillators by modulating the driving stimuli. FEBS Lett. 586, 1664–1668 (2012).

  10. 10.

    Arnold, V. I. & Avez, A. Ergodic Problems of Classical Mechanics (Addison-Wesley, New York, 1989).

  11. 11.

    Jensen, M. H., Bak, P. & Bohr, T. Complete devil’s staircase, fractal dimension and universality of mode-locking structure in the circle map. Phys. Rev. Lett. 50, 1637–1639 (1983).

  12. 12.

    Jensen, M. H., Bak, P. & Bohr, T. Transition to chaos by interaction of resonances in dissipative systems. I. Circle maps. Phys. Rev. A 30, 1960–1969 (1984).

  13. 13.

    Pikovsky, A., Rosenblum, M. & Kurths, J. Synchronization: A Universal Concept in Nonlinear Sciences. (Cambridge University Press, Cambridge, 2003).

  14. 14.

    Stavans, J., Heslot, F. & Libchaber, A. Fixed winding number and the quasiperiodic route to chaos in a convective fluid. Phys. Rev. Lett. 55, 596–599 (1985).

  15. 15.

    Brown, S. E., Mozurkewich, G. & Gruner, G. : Subharmonic Shapiro steps and devil’s-staircase behavior in driven charge-density-wave systems. Phys. Rev. Lett. 52, 2277–2380 (1984).

  16. 16.

    Gwinn, E. G. & Westervelt, R. M. Frequency locking, quasiperiodicity, and chaos in extrinsic Ge. Phys. Rev. Lett. 57, 1060–1063 (1986).

  17. 17.

    Tsai, T. Y. et al. Robust, tunable biological oscillations from interlinked positive and negative feedback loops. Science 321, 126–129 (2008).

  18. 18.

    Goldbeter, A. Computational approaches to cellular rhythms. Nature 420, 238–245 (2002).

  19. 19.

    Woller, A., Duez, H., Staels, B. & Lefranc, M. A mathematical model of the liver circadian clock linking feeding and fasting cycles to clock function. Cell Rep. 17, 1087–1097 (2016).

  20. 20.

    Mondragon-Palomino, O., Danino, T., Selimkhanov, J., Tsimring, L. & Hasty, J. Entrainment of a population of synthetic genetic oscillators. Science 333, 1315–1319 (2011).

  21. 21.

    Heltberg, M. L., Kellogg, R. A., Krishna, S., Tay, S. & Jensen, M. H. Noise induces hopping between NF-κB entrainment modes. Cell Syst. 3, 532–539 (2016).

  22. 22.

    Ashall, L. et al. Pulsatile stimulation determines timing and specificity of NF-B-dependent transcription. Science 324, 242 (2009).

  23. 23.

    Gillespie, D. T. Exact stochastic simulation of coupled chemical reactions. J. Phys. Chem. 81, 2340–2361 (1977).

  24. 24.

    Maienschein-Cline, M., Warmflash, M. A. & Dinner, A. R. Defining cooperativity in gene regulation locally through intrinsic noise. IET Syst. Biol. 4.6, 379–392 (2010).

  25. 25.

    Werner, M., Zhu, L. & Aurell, E. Cooperative action in eukaryotic gene regulation: physical properties of a viral example. Phys. Rev. E 76, 061909 (2007).

  26. 26.

    Kaplan, S., Bren, A., Zaslaver, A., Dekel, E. & Alon, U. Diverse two-dimensional input functions control bacterial sugar genes. Mol. Cell 29, 786–792 (2008).

  27. 27.

    Sneppen, K., Krishna, S. & Semsey, S. Simplified models of biological networks. Annu. Rev. Biophys. 39, 43–59 (2010).

  28. 28.

    Poincaré, H. Science and Method, 68 (Courier Corporation, Dover Publications, Mineola, New York, 2013).

  29. 29.

    Lorenz, E. N. Deterministic nonperiodic flow. J. Atmos. Sci. 20, 130–141 (1963).

  30. 30.

    Jensen, M. H., Kadanoff, L. P., Libchaber, A., Procaccia, I. & Stavans, J. Global Universality at the onset of chaos: results of a forced Rayleigh Benard experiment. Phys. Rev. Lett. 55, 2798–2801 (1985).

  31. 31.

    Strogatz, S. H. Dynamical Systems and Chaos, 278–279 (Westview Press, Boulder, Colorado, 2000).

  32. 32.

    Heltberg, M. L., Krishna & Jensen, M. H. Time Correlations in mode hopping of coupled oscillators. J. Stat. Phys. 167, 792–805 (2017).

  33. 33.

    Tieri, P. et al. Charting the NF-kB pathway interactome map. PLoS One 7, e32678 (2012).

  34. 34.

    Trocoli, A. & Djavaheri-Mergny, M. The complex interplay between autophagy and NF-kB signaling pathways in cancer cells. Am. J. Cancer Res. 391, 629–649 (2011).

  35. 35.

    Basak, S., Behar, M. & Hoffmann, A. Lessons from mathematically modeling the NF-kB pathway. Immunol. Rev. 246, 221–238 (2012).

  36. 36.

    Bohr, T. & Gunaratne, G. Scaling for supercritical circle maps: numerical investigation of the onset of bistability and period doubling. Phys. Lett. 113A, 55 (1985).

  37. 37.

    Piehler, A., Ghorashian, N., Zhang, C. & Tay, S. Universal signal generator for dynamic cell stimulation. Lab Chip 17, 2218–2224 (2017).

  38. 38.

    Dettinger, P. et al. Automated microfluidic system for dynamic stimulation and tracking of single cells. Anal. Chem. 90, 10695–10700 (2018).

  39. 39.

    Amon, A. & Lefranc, M. Topological signature of deterministic chaos in short nonstationary signals from an optical parametric oscillator. Phys. Rev. Lett. 92, 094101 (2004).

  40. 40.

    Gilmore, R. & Lefranc, M. The Topology of Chaos (John Wiley and Sons Ltd., New York, 2002).

  41. 41.

    Stark, J., Chan, C. & George, A. J. Oscillations in the immune system. Immunol. Rev. 216, 213–231 (2007).

  42. 42.

    Chan, C. C. W., Stark, J. & George, A. J. T. Analysis of cytokine network dynamics in corneal allograft rejection. Proc. R. Soc. B 266, 2217–2223 (1999).

  43. 43.

    Rayner, S. A. et al. Local bioactive tumour necrosis factor (TNF) in corneal allotransplantation. Clin. Exp. Immunol. 122, 109–116 (2000).

  44. 44.

    Ruohonen, S. et al. Cytokine responses during chronic denervation. J. Neuroinflamm. 2, 26 (2005).

  45. 45.

    Keller, M. et al. A circadian clock in macrophages controls inflammatory immune responses. Proc. Natl Acad. Sci. USA 106, 21407–21412 (2009).

  46. 46.

    Yde, P., Mengel, B., Jensen, M. H., Krishna, S. & Trusina, A. Modeling the NF-κB mediated inflammatory response predicts cytokine waves in tissue. BMC Syst. Biol. 5, 115 (2011).

Download references

Acknowledgements

We are grateful Jordi Garcia-Ojalvo, Namiko Mitarai, Andrew Oates and Ala Trusina for valuable discussions. S.K. thanks the NCBS-TIFR and the Simons Foundation for funding. M.L.H. and M.H.J. acknowledge support from the Danish Council for Independent Research and Danish National Research Foundation through StemPhys Center of Excellence, grant number DNRF116.

Author information

M.L.H., S.K. and M.H.J. developed the models. M.L.H. performed the numerical simulations. M.L.H., S.K. and M.H.J. wrote the paper.

Competing interests

The authors declare no competing interests.

Correspondence to Sandeep Krishna or Mogens H. Jensen.

Supplementary information

  1. Supplementary Information

  2. Peer Review File

Rights and permissions

Creative Commons BY

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.