Abstract
Electrophysiological recordings in cortex in vivo have revealed a rich variety of dynamical regimes ranging from irregular asynchronous states to a diversity of synchronized states, depending on species, anesthesia, and external stimulation. The average population firing rate in these states is typically low. We study analytically and numerically a network of sparsely connected excitatory and inhibitory integrateandfire neurons in the inhibitiondominated, low firing rate regime. For sufficiently high values of the external input, the network exhibits an asynchronous low firing frequency state (L). Depending on synaptic time constants, we show that two scenarios may occur when external inputs are decreased: (1) the L state can destabilize through a Hopf bifucation as the external input is decreased, leading to synchronized oscillations spanning d δ to β frequencies; (2) the network can reach a bistable region, between the low firing frequency network state (L) and a quiescent one (Q). Adding an adaptation current to excitatory neurons leads to spontaneous alternations between L and Q states, similar to experimental observations on UP and DOWN states alternations.
Introduction
Electrophysiological recordings in anaesthetised, asleep and awake animals have revealed that cortical networks exhibit a diversity of dynamical states. In awake cats and monkeys, recordings seem to be compatible with an asynchronous network state in which the population firing rate is relatively constant in time, neurons receive synaptic inputs that are in average subthreshold but large fluctuations in these inputs lead to spiking^{1,2,3}. Other studies, most prominently in rodents, have offered a different picture. In those recordings, synaptic inputs to neurons seem to be highly synchronous^{4,5,6,7,8}. In some circumstances, recordings reveal an alternation between socalled UP states, in which neurons are depolarized compared to their resting potential, receive a large amount of excitatory and inhibitory inputs and emit spikes at a rates of a few Hz to a few tens of Hz, depending on cell type; and DOWN states, essentially quiescent states in which most neurons have their membrane potential close to the resting potential and fire very few spikes, if any^{1,9,10,11}. Similar UP and DOWN state alternations have been observed in in vitro preparations^{12,13,14,15,16}. The same networks can alternate between synchronous and asynchronous states, depending on the state of the animal (anesthetized, awake or asleep^{9}), sensory stimulation^{3}, and/or arousal^{17}.
Most theoretical studies of cortical dynamics have focused either on asynchronous states or UP/DOWN state alternations, but have not explained how both types of dynamics could be observed in the same network and what could lead to transitions between both types of behaviors. The dominant model for asynchronous states in cortex has been the ‘balanced network’ model, in which strong excitatory and inhibitory inputs approximately cancel each other, leading to subthreshold average membrane potential, whose large fluctuations generate irregular firing at low rates^{18,19,20,21,22}. Such a state can be shown to be stable in a wide parameter range, provided inhibition is sufficiently strong to dominate the strong positive feedback induced by recurrent excitation, and external inputs are suprathreshold. A previous analytical study of a sparsely connected network of excitatory and inhibitory leaky integrateandfire neurons^{21} revealed the potential presence of oscillatory instabilities of this asynchronous irregular state, both for strong external inputs (leading to fast network oscillations) and weaker external inputs (leading to slower oscillations). However, while the mechanisms of fast oscillations occurring in such networks have been studied in great detail^{23,24,25}, slow oscillations in the low external inputs regime have been essentially unexplored.
Other studies have focused on UP and DOWN state dynamics, using purely numerical approaches^{26,27,28}. The dominant model has been one in which strong recurrent excitation leads to a bistability between two states, an active and an inactive state^{26}. In such a scenario, transitions between states are due to a slow negative feedback variable, such as an intrinsic current leading to firing rate adaptation^{26}, or synaptic shortterm depression^{27,29}. While this scenario reproduces the basic UP/DOWN state alternation seen in experiments, it suffers from a number of shortcomings. First, these models assume a dominant role for cortical excitation, at odds with balanced network models, and with a growing body of evidence indicating the inhibition dominates the dynamics of cortical networks in vivo ^{2,30}. Second, these models do not explain how the same network can switch between UP/DOWN state transitions and stable asynchronous irregular dynamics.
The observation of UP/DOWN state transitions suggests that the underlying network has the potential for bistability between a low activity state L (the UP state) and an essentially quiescent state Q (the DOWN state). Transitions between the two states then occur either due to noise, or to a slow negative feedback mechanism. Only few theoretical studies have indicated the possibility of a L/Q bistability in networks dominated by inhibition. In a randomly connected network of excitatory and inhibitory neurons^{21}, showed that multiple fixed points can coexist in the inhibition dominated regime, but that in practice the potential UP state is destabilized due to an oscillatory instability. Other studies have shown, using a purely numerical approach, that in conductancebased models of spiking neurons it is in principle possible to achieve bistability between an active state at low rates and a quiescent state^{31,32,33}. Further, it has been shown that UP/DOWN state dynamics can be achieved by adding adaptation to excitatory neurons, and coupling together two networks, representing either cortex and thalamus, or two cortical layers^{32}. It remains however unclear whether such dynamics can be achieved in a single network, whose feedback is dominated by inhibition.
In the present paper, we analyze the dynamics of a sparsely connected network of LIF neurons, in a regime of strong recurrent inhibition, using both analytical and numerical tools. We identify for a broad range of parameters a region where multiple fixed points coexist, including a low activity state and a quiescent state. We show that in this region the low activity state is unstable unless excitatory synaptic time constants are significantly longer than inhibitory time constants. Finally, we show that adding firing rate adaptation leads to slow alternations between the two states, similar to UP/DOWN state alternations observed in cortical networks. Thus, this network model can serve as a minimal network model that can either settle in a stable asynchronous state (for sufficiently large external inputs) or in UP/DOWN state alternations (for intermediate values of external inputs).
Methods
Spiking Network Model
We consider a model network of sparsely connected excitatory and inhibitory current based LIF neurons introduced by^{21}. The network is composed of N _{ E } excitatory and N _{ I } inhibitory neurons. Each neuron in the network receives C randomly chosen connections from other neurons, of which C _{ E } = cN _{ E } are from excitatory neurons and C _{ I } = cN _{ I } are from inhibitory neurons, where c = 0.1 is the connection probability. It also receives external inputs.
The depolarization V _{ i,a }(t) of neuron i in population a = E (excitatory) or I (inhibitory) obeys the equation
where τ _{ m,a } is the membrane time constant of neurons in population a, \({I}_{i,a}^{ext}(t)\) and \({I}_{i,a}^{rec}(t)\) are the external/recurrent synaptic inputs to neuron i in population a. When V _{ i }(t) reaches the firing threshold θ, an action potential is emitted and the depolarization is reset to the reset potential V _{ r } after a refractory period τ _{ rp } during which the potential is insensitive to stimulation.
The recurrent synaptic current received by a neuron i in population a = E,I are
where the first term on the r.h.s. describes excitatory inputs, while the second term describes inhibitory inputs; c _{ ij,ab } is the binary (0, 1) connectivity (adjacency) matrix from population b to population a, whose entries are drawn randomly subject to the constraint ∑_{ j } c _{ ij,ab } = C _{ b }; J _{ ab } is the synaptic efficacy (measuring the amplitude of postsynaptic potential due to a single presynaptic spike) of synapses from a neuron in population b to a neuron in population a; \({t}_{j,a}^{k}\) is the time of the k − th spike from presynaptic neuron j in population a; and D _{ ij,ab } is the transmission delay from neuron j in population b to neuron i in population a. D _{ ij,ab } s are drawn randomly and independently from an exponential distribution with mean D _{ ab } for synapses connecting population b to population a, for a,b = E,I. Instantaneous synapses with a wide distribution of delays is an analytically tractable way of describing synaptic interactions with a multiplicity of time constants : short (a few ms) time constants due to AMPA receptor activation, and longer (a few 10s of ms) time constants due to NMDA receptor activation. In Section “Spiking Network Model with firing rate adaptation” synaptic interactions are described in a more realistic fashion. Each neuron receives in addition C _{ X } connections from excitatory neurons outside the network. Assuming external spike trains are uncorrelated Poisson processes with rate ν _{ X } activating synapses of strength J _{ aX } and using the diffusion approximation, the external synaptic current received by a neuron i can be written as:
where μ _{ aX } describes the mean input, σ _{ aX } the amplitude of the fluctuations around the mean, and η _{ i }(t) are uncorrelated Gaussian white noises with 〈η _{ i }(t)〉 = 0 and 〈η _{ i }(t)η _{ j }(t′)〉 = δ _{ ij } δ(t − t′). μ _{ aX } and σ _{ aX } are given by
The external frequency ν _{ X } will be compared in the following to the frequency that is needed for a neuron to reach threshold in absence of feedback, ν _{ θ,a } = θ/(J _{ aX } C _{ X } τ _{ m,a }).
Parameter choices
We choose N _{ E } = 0.8N, N _{ I } = 0.2N (80 % of excitatory neurons). This implies C _{ E } = 4C _{ I }, where we set γ = 1/4 so that C _{ I } = γC _{ E }. The number of connections from outside the network is taken to be equal to the number of recurrent excitatory ones, C _{ X } = C _{ E }, and likewise, the synaptic efficacies from outside the network J _{ aX } = J _{ aE } for a = E,I. Single neuron parameters are θ _{ E } = θ _{ I } = 20 mV; V _{ r,E } = V _{ r,I } = 10 mV; τ _{ rp } = 2 ms, τ _{ m,E } = 20 ms, τ _{ m,I } = 10 ms.
The remaining parameters are the parameters describing the coupling (the J and D twobytwo matrices); ν _{ ext }, the frequency of the external input and C _{ E }, the number of recurrent excitatory connections. To reduce further the number of parameters, we choose D _{ EE } = D _{ IE } and D _{ EI } = D _{ II }. We also introduce the I/E balance parameters g _{ E } = JEI/JEE, g _{ I } = JII/JIE. In some cases we choose this I/E balance to be identical in both, in which case g _{ E } = gI = g.
Meanfield approach: Fixed points
We use a meanfield approach to investigate the dynamics of the network^{19,21}. Using the diffusion approximation, the average firing rate ν _{ a0} in population a = E,I in asynchronous states (i.e. states in which the instantaneous firing rates are constant in time) is given by
where Φ is the fI curve of the LIF neuron in the presence of white noise^{34,35},
where erf is the standard error function, while μ _{ a0} and σ _{ a0} represent the mean inputs and magnitude of the temporal fluctuations in inputs,
The equations are solved numerically by introducing sets of ODEs whose fixed points are given by Eqs ((6)–(9)) and integrating these ODEs until they converge to a fixed point (see Appendix A for more details). Comparisons between meanfield analysis and numerical simulations are shown in Appendix B.
Meanfield approach: Stability analysis of fixed points
To study the stability of fixed points, we performed a linear stability analysis of the stationary solutions of the FokkerPlanck equations describing the probability distribution of membrane potentials in both populations, as well as the associated instantaneous firing rates^{21,36,37,38}. Details of this stability analysis are presented in Appendix C.
Results
Existence of multiple fixed points in the inhibition dominated region
We started by exploring parameter regions in which multiple fixed points of network activity exist, using meanfield equations described in Methods. For a given set of parameters, we solve numerically meanfield equations ((6)–(9)) to compute the firing rates in the asynchronous states of the network. We choose to present the results in the g − ν _{ X }/ν _{ θ,E } plane, for fixed values of C _{ E } and J ^{21}.
We show in Fig. 1A the ‘phase diagram’ in the g − ν _{ X }/ν _{ θ,E } plane, for C _{ E } = 1000, J _{ EE } = 0.2 mV, J _{ IE } = 0.34 mV. g _{ E } = g _{ I } = g. This phase diagram shows seven qualitatively different regions, in which one, three or five fixed points exist, out of which one, two or three are potentially stable (see below). The potentially stable fixed points are: H, a high firing state (close to saturation), which exists in the weak inhibition region, up to a critical value of g (\(g\sim 3\) in Fig. 1A); L, a low but nonzero firing state, which exists in the strong inhibition region (\(g\sim 2.5\) in Fig. 1A), and above a critical value of external inputs, that depend on g; Q, a quiescent state, in which the firing rate is extremely small, that exists when the external inputs are sufficiently far from threshold (ν _{ X } < 0.78ν _{ thr } in Fig. 1A). All these fixed points appear/disappear on saddlenode bifurcation lines (indicated by blue lines), together with the associated unstable fixed points. There are a total of 4 regions in which multiple fixed points coexist. All possible combinations are possible.
In the following, we focus on the inhibitiondominated regime, in which the H state does not exist. In this regime, there exists a region with three fixed points, out of which two are potentially stable: the Q and the L fixed points. We next study how the size of the L/Q coexistence region depends on the parameters characterizing the strength of the coupling. First, this region exists provided J _{ IE } τ _{ I } is sufficiently below J _{ EE } τ _{ E } ^{21}. When this condition is fulfilled, the mean external inputs to excitatory neurons is stronger than the mean external inputs to inhibitory neurons, which creates a window of opportunity for a coexistence region between the Q and L states. If J _{ IE } becomes stronger, then the coexistence region is destroyed since inhibition becomes too powerful to sustain it. Decreasing J _{ EE } together with J _{ IE } so as to keep their ratio constant, increases the size of the L/Q region (Fig. 1B). This effect can again be understood by considering that J _{ EE } τ _{ mE } J _{ IE } τ _{ mI }. In this scenario, the coexistence of L and Q is favored by the fact that the mean external inputs to E neurons are stronger than the mean external inputs to I neurons (by a factor proportional to the ratio J _{ EE } τ _{ mE }/J _{ IE } τ _{ mI }). Decreasing all synaptic coupling strengths maintains this ratio constant, but decreases the size of the fluctuations in the inputs, weakening inhibition close to the bifurcation leading to the appearance of the L state, thereby moving this bifurcation down (i.e. L appears for smaller external input values).
Varying g _{ I }, i.e. the strength of inhibition on inhibitory neurons, with respect to g _{ E }, i.e. the strength of inhibition on excitatory neurons, has a different effect (Fig. 1C). It does not affect significantly the bifurcation leading to the appearance of the L state at large values of g _{ E }, but changes the location of the quasivertical saddlenode bifurcation. Increasing g _{ I } weakens inhibition, so the L state destabilizes to the H state at higher values of g _{ E }. Figure 1D–G) shows that the firing rates of both E and I populations are in the order of a few spikes per second.
Stability of the L and Q stationary solutions
The next step is to investigate the stability of the L and Q solutions. We perform a linear stability analysis of the corresponding stationary solutions of the FokkerPlank equation, which describes the evolution of the probability distribution of a neuron depolarization^{21} (Appendix C). The analysis boils down to solving an eigenvalue equation. The sign of the real part of the eigenvalues λ establishes whether perturbations are amplified and an instability arises (Re(λ) 0), or, conversely, whether perturbations decay (Re(λ) < 0). The stationary solution is therefore stable provided all eigenvalues have negative real parts. The points at which the eigenvalue with the largest real part satisfies Re(λ) = 0 indicate a bifurcation, which can be either a saddlenode or a Hopf bifurcation, depending on whether the eigenvalue is real or imaginary.
The stability analysis shows that as the external inputs are decreased from the suprathreshold region, the low rate asynchronous state destabilizes through a Hopf bifurcation (see Fig. 2A,B for two different parameter sets). However, the location of this Hopf bifurcation depends strongly on the average synaptic delays. This oscillatory instability is due to excitatoryinhibitory interactions. When the average synaptic delays are equal for E and I synapses, the L state tends to destabilise outside the coexistence region L/Q (Fig. 2C,D) which becomes therefore unreachable. In this regime the network exhibits pronounced oscillations whose frequency vary between a few Hz and \(\sim 50\) Hz depending on average delays and g, as shown in Fig. 3A. Simulations confirm the presence of these oscillations below the instability line, with a frequency that decreases as the external input is decreased (Fig. 3B). In the examples shown in Fig. 3B, the population frequency is close to 5 Hz for D = 20 ms (top), and about 14 Hz for D = 5 ms (bottom). In the D = 20 ms case, neurons have a firing rate that is close to the population frequency, while in the D = 5 ms case, the firing frequencies of both E and I populations are much lower than the global oscillation frequency (around 3/s).
When the average E synaptic delays are larger than the I delays, the stability region of the L state expands considerably (compare panels C, D of Fig. 2 with panels E, F). Note that it is not unreasonable to expect that average E synaptic time constants are longer than I time constants, because a large fraction of the charge transmitted by EPSCs in cortex is mediated by NMDA receptors^{39}. Moreover, decreasing the strength of inhibition, through a decrease of the synaptic efficacy J _{ IE }, not only makes the coexistence region appear for smaller values of the external input and survive for larger g values, but also enlarges the stability region of the L solution. In fact, in Fig. 2F, the L state survives up to the point where no external inputs are present. When the Hopf bifurcation line lies within the coexistence region (as in the case of the red line in Fig. 2A,B), numerical simulations show that the amplitude of the oscillation increases rapidly until the network falls in the quiescent state. The value of the external inputs at which this happens is very close to the analytically computed Hopf bifurcation lines, as shown by the comparison between solid red line and red circles in Fig. 2A,B). Finally, note that the Q solution is stable in all the coexistence region L/Q and only disappears through the saddle node bifurcation by coalescing with the unstable fixed point separating the L and Q states.
Transitions between UP and DOWN states in the bistable region
To reproduce the observed phenomenology of UP and DOWN states, we now focus on the region in which the mean field analysis reveals a coexistence between the L (UP) state and the Q (DOWN) state. UP and DOWN state transitions could then in principle arise in two possible ways: (1) from stochastic jumps between these two fixed points, due to finitesize effects; (2) from slow oscillations between L and Q states, caused by an additional variable that provides negative feedback with a slow time constant. The latter scenario will be studied in the following sections when considering the effects of firing rate adaptation.
Network simulations show that sufficiently far from the bifurcation points, both states are stable over long time scales (tens of seconds or longer, see Fig. 4B in which an external stimulation is needed to cause a transition from the DOWN to the UP state). To obtain shorter lifetimes of these states, one needs to fine tune the external inputs so that they are close to the boundary of the stability region of the corresponding state, in order to cause noiseinduced, spontaneous transitions from one state to the other. For instance, in Fig. 4A, the external inputs are very close to the Hopf bifurcation leading to destabilization of the asynchronous UP state. In this case, UP states have short lifetimes (of order 1s), but DOWN states have very long life times  in A, an external input is needed to provoke a transition from the DOWN to the UP state at t = 5 s. Figure 4C shows the opposite scenario of an external input close to the saddlenode bifurcation where the DOWN state disappears. In this case, DOWN states have short life times (of order 1s) but UP states are much more stable (again, external stimulation is needed to interrupt temporarily the UP state). Hence, the phenomenology of UP and DOWN states in vitro (very long DOWN states, ≈1 s long UP states) can be reproduced only when the external inputs are fined tuned to be close to the bifurcation where the L state destabilizes (Fig. 4A), while the in vivo phenomenology (both DOWN and UP states lasting approximately 1 s) can only be observed if two parameters are simultaneously fine tuned: a parameter controlling the size of the coexistence region of UP and DOWN states, and the external inputs (Fig. 4D).
Spiking Network Model with firing rate adaptation
A well established mechanism to control the time scale of UP states is firing rate adaptation^{26,32}. Firing rate adaptation is prominent in pyramidal cells, while it is much weaker in fastspiking interneurons^{16,40}. We therefore investigated a network in which excitatory neurons (but not inhibitory neurons) are endowed with an adaptation current. The equation for the membrane potential of excitatory neurons becomes:
When the potential V _{ i,E } reaches the firing threshold θ, a spike is emitted, the adaptation current A _{ i,E } is increased by β/τ _{ A } and V _{ i,E } is reset to the resting potential V _{ R }. Thus, β controls the strength of adaptation (it corresponds to the integral of the A variable following a single spike), while τ _{ A } is the decay time constant of the adaptation current.
To study the effect of adaptation on the L/Q bistable range, we first modified the meanfield equations to account for the adaptation current, using an adiabatic approximation that replaces adaptation currents by their mean^{41} (Appendix D). Figure 5A,B show that the stronger the adaptation, the smaller the bistable range, as one would expect, until the bistable range disappears for \(\beta \sim \)1.5 mVs. Furthermore, the firing rates of both excitatory and inhibitory populations also gradually decrease as a function of the adaptation variable.
We first focused on a parameter region such that the bistable region between L and Q states is still present, but reduced in size due to adaptation (β = 0.7 mV.s, see blue diamond in Fig. 5A; compare the extent of the L/Q region with Fig. 2A). In this regime, L and Q states are indeed stable on short time scales, but they destabilize on longer time scales due to noiseinduced transitions. As a result, both UP and DOWN states have highly variable durations (Fig. 5C,D,E  see Appendix G for details on how durations are computed). In this regime, the external input still needs to be finely tuned in order to observe realistic lifetimes of UP and DOWN states, but only a single parameter needs to be fine tuned in order to obtain UP/DOWN state durations of the order of 1 s. In practice, the external inputs needs to be close to the bifurcation leading to the disappearance of the Q state. The presence of adaptation considerably shortens the duration of UP states, that are also of the order of 1s.
We next investigated a scenario in which the bistable region has completely disappeared due to adaptation (β = 5 mV.s, see green and brown diamonds in Fig. 5A). In this regime, adaptation generates slow oscillations between UP and DOWN states, whose time scales is controlled by the adaptation time constant (see Fig. 5F,G). This scenario is similar to the one discussed in^{42} and^{26}. UP and DOWN states in this scenario have much less variable durations  CV of durations of UP/DOWN states are in the range 0.4–0.6/0.1–0.2, respectively, approximately three times smaller than the values observed in Fig. 5C.
Figure 6A shows the average time duration of UP and DOWN states in the noiseinduced transition regime, as a function of the adaptation strength β, computed from network simulations. The smaller β, the longer is the UP state, which terminates due to the variance of the synaptic input. This stochasticity of the UP/DOWN transitions is reflected in the wide distributions of time durations shown in Fig. 6C. For larger β values (Fig. 6D), the L state is quickly pulled towards Q by the adaptation, whose contribution is now at least as large as the synaptic input fluctuations. In this case, the mean duration of the UP state is much shorter and its distribution narrower than in the previous case. On the other hand, DOWN states duration is essentially unaffected by the adaptation strength, since firing rates are so low in the Q state that the adaptation current is essentially negligible. Note that contrary to UP states, DOWN state durations cannot be smaller than a few hundreds ms. This is due to the fact that it takes time for the adaptation current to decay to a very small value after transitions from L to Q, making it harder for the network to make a transition back to the UP state during that interval. The adaptation current lowers the average population firing frequencies of the network in the UP state, but has very little effect on the firing frequencies of the DOWN state, which are close to zero for any β value (Fig. 6B).
We also simulated networks with more realistic synaptic currents (see Appendix E for details). Excitatory currents were mediated by a combination of slow (NMDAlike) and fast (AMPAlike) synaptic currents, while inhibitory currents were mediated by fast, GABA_{ A }like, synaptic currents. We found that this more realistic network model exhibited very similar dynamics as the network with instantaneous PSCs. The presence of slow NMDAlike synaptic excitation played the same role as the longer average excitatory delays in the network with instantaneous PSCs in stabilizing the UP state well into the coexistence region. Figure 7A shows that the duration of both UP and DOWN states increase as a function of the fraction of charge x _{ E } mediated by the slow NMDA receptors. This is due to the fact that NMDA stabilizes both states, by reducing the magnitude of fluctuations in the recurrent inputs. The distributions of both states (Fig. 7C,D) show again an exponential tail, consistent with stochastic transitions.
Finally, we checked that our results are qualitatively valid in networks with conductancebased synapses (see Appendix F for details). In particular, bistability between low activity states and quiescent states occur in large regions of parameters^{43,44}. Adding an adaptation current to excitatory neurons readily converts this bistability into an alternation between UP and DOWN states, as shown in Fig. 8, which shows a slow oscillation with a frequency of about 1.6 Hz.
Discussion
We have explored the dynamics of a sparsely connected network of excitatory and inhibitory spiking neurons, in a strong recurrent inhibition, low firing rate regime. Our network is the simplest analytically tractable spiking network model which can exhibit both stable asynchronous irregular dynamics and UP/DOWN state alternations, and switch between the two regimes by changing the external inputs. The size of this bistable range is controlled by all parameters describing the connectivity between neurons, such as numbers and strengths of excitatory and inhibitory connections. We investigated the stability of the L state as the external inputs are decreased, and show that it generically destabilizes through a Hopf bifurcation, leading to oscillations whose frequency is determined by synaptic time constants. When synaptic time constants are short, the Hopf bifurcation appears for values of the external input that are above the L/Q coexistence range, preventing any bistability. On the other hand, longer synaptic time constants lead to a stabilization of the L state deep into the coexistence region. Oscillations appearing beyond the Hopf bifurcation outside the coexistence range have frequencies that range from a few Hz to a few tens of Hz.
In the L/Q bistable regime, we show that noiseinduced transitions can occur between the two states, giving rise to UP and DOWN state alternations. The lifetime of these states are however extremely long, unless parameters are chosen to be close to the boundaries of the bistable range. Finally, we investigated the effect of firing rate adaptation on excitatory neurons. We showed that weak to moderate firing rate adaptation reduces the size of the bistable range, alleviating to some extent the need to fine tuning to obtain realistic lifetimes of UP and DOWN states. For strong adaptation, bistability is destroyed, and is replaced by an oscillatory regime in which the network alternates rhythmically between UP and DOWN states.
In our model, different experimentally observed regimes can be reproduced by varying a single parameter, the frequency of external inputs. In vivo, external inputs represent inputs coming to the network from subcortical structures, nearby cortical networks through lateral connections, and inputs from other cortical areas. In vitro, external inputs represent spontaneous neurotransmitter release^{45}, or spontaneous activity in subsets of neurons. For sufficiently high external inputs, the network exhibits a stable asynchronous state while, for lower external inputs, it switches to a synchronized state due to a variety of potential mechanisms (i) slow stochastic UP/DOWN state alternations; (ii) UP/DOWN alternations due to firing rate adaptation; or (iii) oscillations due to E/I feedback loop, whose frequency can range from a few Hz to a few tens of Hz.
In the first scenario, transitions between stable states are due to fluctuations in the network spiking activity due to finite size effects. In this case, fine tuning is needed to achieve UP and DOWN states lifetimes that are consistent with data. However, the fine tuning problem would be strongly alleviated in the presence of slow global fluctuations in external inputs or in the cellular excitability. The time scales of this slow variable would then determine, to a large extent, the time scales of UP and DOWN state transitions.
In the second scenario, the asynchronous state destabilizes due to the slow negative feedback induced by firing rate adaptation^{42,46,47,48}. In both the noiseinduced and the adaptationinduced regimes, our network can reproduce the diversity of phenomenologies of durations of UP/DOWN states seen in different experiments: with weak external inputs, UP states are much shorter than DOWN states, similar to what is seen in vitro ^{12}. In vivo, the opposite often occurs^{49,50,51,52,53,54}. Transitions between UP and DOWN states often seem irregular and stochastic, as in our model^{50,52,55,56}. These stochastic transitions between UP and DOWN states could explain to a large extent noise correlations in cortical circuits^{54}.
In the third scenario, the oscillatory instability is due to the E/I interactions, similar to the classic EI instability that occurs in many EI networks, including firing rate models^{57}. In this case, the asynchronous state destabilizes outside the bistable region, i.e. for higher values of the external input, and the network generate oscillations with a frequency that depends on synaptic delays.
The dependence of the dynamics on external inputs is consistent with experimental observations, where there is a general trend of observing synchronous dynamics in asleep and anesthetized preparations, while the network tends to be more asynchronous in awake animals^{1,9}. Furthermore, recordings in awake monkeys are consistent with transitions from synchronized activity in the absence of sensory stimulation, to asynchronous activity in the presence of such a stimulation^{3}. Similar observations have been made as a function of arousal, as measured by pupil diameter^{17}. In all scenarios, the frequency of UP/DOWN state alternations increases with external inputs. This is again consistent with experimental observations showing slow frequencies in vitro (1 Hz or less), while synchronized activity in vivo is often characterized by faster frequencies in the 1–5 Hz range^{3,7}.
The inhibition dominated regime we have studied here is consistent with a large body of in vitro ^{16}, as well as in vivo data^{2,30,58,59,60}. However, other experiments have found results consistent with a dominance of weak and sparse excitatory inputs^{5}. Interestingly, these results can also be reconciled with our model, which often produces I rates that are lower than E rates for low values of external inputs (see Fig. 1). In rodent cortex, whether networks are inhibition dominated (and in particular inhibition stabilized) is still an open question (see e.g. ref.^{61}).
Our work investigates the dynamics of standard LIF network of E and I neurons in the low rate regime in greater detail than in previous studies of the same network^{21}. We show that the discrepancies between numerical and analytical results are due to deviations from the diffusion approximation, and disappear when one uses a transfer function Φ derived from a shotnoise process.
Our scenario for the emergence of UP/DOWN state transitions is distinct from most previous studies, which relied on an excitation dominated network with a slow negative feedback leading to slow UP and DOWN states alternations^{26,27,62,63}. In these models rhythmic alternations are elicited in the absence of noise. We propose a different scenario of an inhibitorydominated network in which bistability can arise when the mean external inputs are stronger in excitatory neurons than in inhibitory neurons. This scenario is similar to the one proposed recently in simpler firing rate models^{64,65}. We showed that in LIF networks, bistability can be achieved provided excitatory synaptic time constants are slower than inhibitory time constants.
Consistently with^{33}, we find bistability of LIF networks for subthreshold values of external inputs, confirming that bistability between quiescent and active states is not an exclusive property of conductancebased networks^{31,32}. Our model and analysis bear similarities with a recently published study which investigated the interplay between bistability and oscillations in both a simple excitatoryinhibitory firing rate model, and a network of LIF neurons, close to a TakensBogdanov bifurcation^{66}. One difference with the Roxin and Compte contribution is that they considered a fully connected network with 1/N coupling in the large N limit, while we analyzed a randomly connected network with finite coupling using the diffusion approximation. Consequently, our analysis (similarly to^{21}) takes into account the fluctuations in the recurrent inputs, that vanish in the fully connected network with 1/N coupling. However, while variance dynamics can in some circumstances have a strong impact on the dynamics of the network^{67}, it has a relatively minor impact on the location of both saddlenode and Hopf bifurcations for the parameters that were considered here.
The model makes several testable predictions. First, we predict that transitions from sleep (UP and DOWN oscillations) to wakefulness (asynchronous irregular activity) is controlled to a large extent by the magnitude of external inputs. Second, the average population firing frequency in the asynchronous state is higher than the firing frequency during an UP state. This holds true for both E and I populations, although the increase in firing rate is larger for I than for E (Fig. 1D to G).
Our model is both realistic enough to generate both asynchronous states at low rates and UP/DOWN state alternations, but also simple enough to allow us to study it analytically. It should be possible to generalize it in a number of directions. For instance, it would be interesting to use conductancebased, rather than currentbased, synaptic inputs^{68}. It would also be of interest to perform the linear stability analysis of the master equation describing the dynamics of the distribution of membrane potentials in the presence of shotnoise inputs^{69}. Another promising extension would be to generalize the meanfield analysis to a network composed of multiple layers and/or multiple interneuron types^{70}, in order to clarify the specific roles of each layer and/or cell type in the generation of UP/DOWN state alternations. Finally, it would be worthwhile to be able to capture analytically the statistics of the durations of both UP and DOWN states, similarly to what has been done in simpler models^{71}.
Data availability
All the codes used for generating the figures in this paper are available upon request.
References
Steriade, M., Timofeev, I. & Grenier, F. Natural waking and sleep states: a view from inside neocortical neurons. J. Neurophysiol. 85, 1969–1985 (2001).
Haider, B., Hausser, M. & Carandini, M. Inhibition dominates sensory responses in the awake cortex. Nature 493, 97–100 (2013).
Tan, A. Y., Chen, Y., Scholl, B., Seidemann, E. & Priebe, N. J. Sensory stimulation shifts visual cortex from synchronous to asynchronous states. Nature 509, 226–229 (2014).
DeWeese, M. R. & Zador, A. M. NonGaussian membrane potential dynamics imply sparse, synchronous activity in auditory cortex. J. Neurosci. 26, 12206–12218 (2006).
Waters, J. & Helmchen, F. Background synaptic activity is sparse in neocortex. J. Neurosci. 26, 8267–8277 (2006).
Crochet, S. & Petersen, C. C. Correlating whisker behavior with membrane potential in barrel cortex of awake mice. Nat. Neurosci. 9, 608–610 (2006).
Poulet, J. F. & Petersen, C. C. Internal brain state regulates membrane potential synchrony in barrel cortex of behaving mice. Nature 454, 881–885 (2008).
Okun, M., Naim, A. & Lampl, I. The subthreshold relation between cortical local field potential and neuronal firing unveiled by intracellular recordings in awake rats. J. Neurosci. 30, 4440–4448 (2010).
Steriade, M., Nunez, A. & Amzica, F. A novel slow (<1 Hz) oscillation of neocortical neurons in vivo: depolarizing and hyperpolarizing components. J. Neurosci. 13, 3252–3265 (1993).
Hahn, T. T., Sakmann, B. & Mehta, M. R. Phaselocking of hippocampal interneurons’ membrane potential to neocortical updown states. Nat. Neurosci. 9, 1359–1361 (2006).
Sakata, S. & Harris, K. D. Laminar structure of spontaneous and sensoryevoked population activity in auditory cortex. Neuron 64, 404–418 (2009).
SanchezVives, M. V. & McCormick, D. A. Cellular and network mechanisms of rhythmic recurrent activity in neocortex. Nat Neurosci 3, 1027–34 (2000).
Cossart, R., Aronov, D. & Yuste, R. Attractor dynamics of network up states in the neocortex. Nature 423, 283–288 (2003).
MacLean, J. N., Watson, B. O., Aaron, G. B. & Yuste, R. Internal dynamics determine the cortical response to thalamic stimulation. Neuron 48, 811–823 (2005).
Fanselow, E. E. & Connors, B. W. The roles of somatostatinexpressing (GIN) and fastspiking inhibitory interneurons in UPDOWN states of mouse neocortex. J. Neurophysiol. 104, 596–606 (2010).
Neske, G. T., Patrick, S. L. & Connors, B. W. Contributions of diverse excitatory and inhibitory neurons to recurrent network activity in cerebral cortex. J. Neurosci. 35, 1089–1105 (2015).
McGinley, M. J., David, S. V. & McCormick, D. A. Cortical Membrane Potential Signature of Optimal States for Sensory Signal Detection. Neuron 87, 179–192 (2015).
van Vreeswijk, C. & Sompolinsky, H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274, 1724–1726 (1996).
Amit, D. J. & Brunel, N. Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cerebral Cortex 7, 237–252 (1997).
van Vreeswijk, C. & Sompolinsky, H. Chaotic balanced state in a model of cortical circuits. Neural Computation 10, 1321–1371 (1998).
Brunel, N. Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J. Comput. Neurosci. 8, 183–208 (2000).
Renart, A. et al. The asynchronous state in cortical circuits. Science 327, 587–590 (2010).
Brunel, N. & Wang, X.J. What determines the frequency of fast network oscillations with irregular neural discharges? J. Neurophysiol. 90, 415–430 (2003).
Brunel, N. & Hansel, D. How noise affects the synchronization properties of networks of inhibitory neurons. Neural Comp. 18, 1066–1110 (2006).
Ledoux, E. & Brunel, N. Dynamics of networks of excitatory and inhibitory neurons in response to timedependent inputs. Front Comput Neurosci 5, 25 (2011).
Compte, A., SanchezVives, M. V., McCormick, D. A. & Wang, X. J. Cellular and network mechanisms of slow oscillatory activity (<1 Hz) and wave propagations in a cortical network model. J. Neurophysiol. 89, 2707–2725 (2003).
Holcman, D. & Tsodyks, M. The emergence of Up and Down states in cortical networks. PLoS Comput. Biol. 2, e23 (2006).
Parga, N. & Abbott, L. F. Network model of spontaneous activity exhibiting synchronous transitions between up and down States. Front Neurosci 1, 57–66 (2007).
Dao Duc, K. et al. Synaptic dynamics and neuronal network connectivity are reflected in the distribution of times in Up states. Front Comput Neurosci 9, 96 (2015).
Rudolph, M., Pospischil, M., Timofeev, I. & Destexhe, A. Inhibition determines membrane potential dynamics and controls action potential generation in awake and sleeping cat cortex. J. Neurosci. 27, 5280–5290 (2007).
Vogels, T. P. & Abbott, L. F. Signal propagation and logic gating in networks of integrateandfire neurons. J. Neurosci. 25, 10786–10795 (2005).
Destexhe, A. Selfsustained asynchronous irregular states and UpDown states in thalamic, cortical and thalamocortical networks of nonlinear integrateandfire neurons. J Comput Neurosci 27, 493–506 (2009).
Kriener, B. et al. Dynamics of selfsustained asynchronousirregular activity in random networks of spiking neurons with strong synapses. Front Comput Neurosci 8, 136 (2014).
Siegert, A. J. F. On the first passage time probability problem. Phys.Rev. 81, 617–623 (1951).
Ricciardi, L. M. Diffusion processes and Related topics on biology (SpringerVerlag, Berlin, 1977).
Abbott, L. F. & van Vreeswijk, C. Asynchronous states in a network of pulsecoupled oscillators. Phys. Rev. E 48, 1483–1490 (1993).
Treves, A. Meanfield analysis of neuronal spike dynamics. Network 4, 259–284 (1993).
Brunel, N. & Hakim, V. Fast global oscillations in networks of integrateandfire neurons with low firing rates. Neural Comp. 11, 1621–1671 (1999).
Hempel, C. M., Hartman, K. H., Wang, X.J., Turrigiano, G. G. & Nelson, S. B. Multiple forms of shortterm plasticity at excitatory synapses in rat medial prefrontal cortex. Journal of neurophysiology 83, 3031–3041 (2000).
Connors, B. W. & Gutnick, M. J. Intrinsic firing patterns of diverse neocortical neurons. TINS 13, 99–104 (1990).
La Camera, G., Rauch, A., Luscher, H. R., Penn, W. & Fusi, S. Minimal models of adapted neuronal responses to invivo like input currents. Neural Comp. 16, 2101–2124 (2004).
Tabak, J., Senn, W., O’Donovan, M. J. & Rinzel, J. Modeling of spontaneous activity in developing spinal cord using activitydependent depression in an excitatory network. J Neurosci 20, 3041–3056 (2000).
Vogels, T. P., Rajan, K. & Abbott, L. F. Neural network dynamics. Annu. Rev. Neurosci. 28, 357–376 (2005).
Kumar, A., Schrader, S., Aertsen, A. & Rotter, S. The highconductance state of cortical networks. Neural Comput 20, 1–43 (2008).
Orlandi, J. G., Soriano, J., AlvarezLacalle, E., Teller, S. & Casademunt, J. Noise focusing and the emergence of coherent activity in neuronal cultures. Nature Physics 9, 582–590 (2013).
van Vreeswijk, C. & Hansel, D. Patterns of synchrony in neural networks with spike adaptation. Neural Computation 13, 959–992 (2001).
Fuhrmann, G., Markram, H. & Tsodyks, M. Spike frequency adaptation and neocortical rhythms. J. Neurophysiol. 88, 761–770 (2002).
Gigante, G., Mattia, M. & Del Giudice, P. Diverse populationbursting modes of adapting spiking neurons. Phys. Rev. Lett. 98, 148101 (2007).
Contreras, D., Timofeev, I. & Steriade, M. Mechanisms of longlasting hyperpolarizations underlying slow sleep oscillations in cat corticothalamic networks. J. Physiol. (Lond.) 494(Pt 1), 251–264 (1996).
Cowan, R. L. & Wilson, C. J. Spontaneous firing patterns and axonal projections of single corticostriatal neurons in the rat medial agranular cortex. J. Neurophysiol. 71, 17–32 (1994).
Massimini, M. & Amzica, F. Extracellular calcium fluctuations and intracellular potentials in the cortex during the slow sleep oscillation. J. Neurophysiol. 85, 1346–1350 (2001).
Stern, E. A., Kincaid, A. E. & Wilson, C. J. Spontaneous subthreshold membrane potential fluctuations and action potential variability of rat corticostriatal and striatal neurons in vivo. J. Neurophysiol. 77, 1697–1715 (1997).
Timofeev, I., Grenier, F. & Steriade, M. Disfacilitation and active inhibition in the neocortex during the natural sleepwake cycle: an intracellular study. Proc. Natl. Acad. Sci. USA. 98, 1924–1929 (2001).
Mochol, G., HermosoMendizabal, A., Sakata, S., Harris, K. D. & de la Rocha, J. Stochastic transitions into silence cause noise correlations in cortical circuits. Proc. Natl. Acad. Sci. USA. 112, 3529–3534 (2015).
Lampl, I., Reichova, I. & Ferster, D. Synchronous membrane potential fluctuations in neurons of the cat visual cortex. Neuron 22, 361–374 (1999).
Pare, D., Shink, E., Gaudreau, H., Destexhe, A. & Lang, E. J. Impact of spontaneous synaptic activity on the resting properties of cat neocortical pyramidal neurons In vivo. J. Neurophysiol. 79, 1450–1460 (1998).
Wilson, H. R. & Cowan, J. D. Excitatory and inhibitory interactions in localized populations of model neurons. Biophysical journal 12, 1–24 (1972).
Destexhe, A., Rudolph, M. & Paré, D. The highconductance state of neocortical neurons in vivo. Nat Rev Neurosci 4, 739–51 (2003).
Haider, B., Duque, A., Hasenstaub, A. R. & McCormick, D. A. Neocortical network activity in vivo is generated through a dynamic balance of excitation and inhibition. J. Neurosci. 26, 4535–4545 (2006).
Okun, M. & Lampl, I. Instantaneous correlation of excitation and inhibition during ongoing and sensoryevoked activities. Nature neuroscience 11, 535–537 (2008).
Miller, K. D. Canonical computations of cerebral cortex. Curr. Opin. Neurobiol. 37, 75–84 (2016).
Mejias, J. F., Kappen, H. J. & Torres, J. J. Irregular dynamics in up and down cortical states. PLoS ONE 5, e13651 (2010).
Mattia, M. & SanchezVives, M. V. Exploring the spectrum of dynamical regimes and timescales in spontaneous cortical activity. Cognitive Neurodynamics 6, 239–250 (2012).
Lerchner, A. & Latham, P. A unifying framework for understanding statedependent network dynamics in cortex (2015). ArXiv:1511.00411.
Jercog, D. et al. UPDOWN cortical dynamics reflect state transitions 1 in a bistable balanced network (2016). BioRxiv.
Roxin, A. & Compte, A. Oscillations in the bistable regime of neuronal networks. Phys Rev E 94, 012410 (2016).
Renart, A., MorenoBote, R., Wang, X.J. & Parga, N. Meandriven and fluctuationdriven persistent activity in recurrent networks. Neural Comput 19, 1–46 (2007).
Richardson, M. J. E. Effects of synaptic conductance on the voltage distribution and firing rate of spiking neurons. Phys Rev E Stat Nonlin Soft Matter Phys 69, 051918 (2004).
Richardson, M. J. & Swarbrick, R. Firingrate response of a neuron receiving excitatory and inhibitory synaptic shot noise. Phys. Rev. Lett. 105, 178102 (2010).
Bos, H., Diesmann, M. & Helias, M. Identifying anatomical origins of coexisting oscillations in the cortical microcircuit. PLoS computational biology 12, e1005132 (2016).
Lim, S. & Rinzel, J. Noiseinduced transitions in slow wave neuronal dynamics. J Comput Neurosci 28, 1–17 (2010).
Acknowledgements
We would like to thank Jason MacLean for enligthening discussions on UP and DOWN state in slice preparations, and Yonatan Aljadeff, Maurizio de Pittà and Gianluigi Mongillo for comments on a previous version of the manuscript. EMT and NB acknowledge the support of the SICODE project of the Future and Emerging Technologies (FET) programme within the Seventh Framework Programme for Research of the European Commission, under FETOpen grant number: FP7284553. EMT acknowledges the financial support of ANR Essilor SilverSight Chair ANR14CHIN0001.
Author information
Authors and Affiliations
Contributions
E.M.T. and N.B. conceived and analysed the model, wrote the manuscript, prepared figures and reviewed the manuscript.
Corresponding author
Ethics declarations
Competing Interests
The authors declare that they have no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tartaglia, E.M., Brunel, N. Bistability and up/down state alternations in inhibitiondominated randomly connected networks of LIF neurons. Sci Rep 7, 11916 (2017). https://doi.org/10.1038/s4159801712033y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s4159801712033y
Further reading

neurolib: A Simulation Framework for WholeBrain Neural Mass Modeling
Cognitive Computation (2021)

Synchronization and multistability in the coupled neurons with propagation and processing delays
Nonlinear Dynamics (2020)

Sleeplike cortical OFFperiods disrupt causality and complexity in the brain of unresponsive wakefulness syndrome patients
Nature Communications (2018)

Dynamics of spontaneous activity in random networks with multiple neuron subtypes and synaptic noise
Journal of Computational Neuroscience (2018)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.