Abstract
We present an analytical framework that allows the quantitative study of statistical dynamic properties of networks with adaptive nodes that have memory and is used to examine the emergence of oscillations in networks with response failures. The frequency of the oscillations was quantitatively found to increase with the excitability of the nodes and with the average degree of the network and to decrease with delays between nodes. For networks of networks, diverse cluster oscillation modes were found as a function of the topology. Analytical results are in agreement with large-scale simulations and open the horizon for understanding network dynamics composed of finite memory nodes as well as their different phases of activity.
Similar content being viewed by others
Introduction
Networks and networks of networks are important concepts in many fields of physics1,2,3. The quantitative study of such complex systems presents a better understanding of the physical process in a verity of fields4, e.g. lasers5, power grids6 and even economics7. Common questions address the structural properties of networks or the dynamics within the networks, given the statistics of the interactions, links. However, the complexity of the analytical approach increases immensely when the activity of the nodes is not trivial. Here we examine a model where nodes have memory and their responses are dependent on the history of the activity of connected nodes.
We develop an analytical framework, which allows the examination of the statistical properties of such networks and their dynamics, based on stochastic equations in the mean-field limit. We test our analytical framework on a model where nodes have activity-dependent response probability. Although this model is based on experimental results on neural networks8,9,10,11, their dynamics resemble many other physical systems12. Results are quantitatively found to be in a good agreement with large-scale simulations and support that the examined model leads to collective network oscillations. Generalization to more structured topologies, consisting of networks of networks13, 14, is presented, indicating additional diverse intra-cluster modes of collective oscillations which are determined by the topology of the complex network15.
Results
The model
In the manuscript we examine a network of firing neurons, where neurons sum up the inputs they receive and respond stochastically if a threshold is crossed. The probability for a neuronal response is a function of the previous activity of its neighbors and the several previous threshold crossings of the neuron. In the general case, the dynamics are in continues time, however, if all the delays between connected neurons are equal, the situation can be simplified to an iterative map.
Excitatory neural networks can be modeled using leaky integrate and fire neurons16, 17. The dynamics of each neuron within the network is then described by a voltage equation
where i indicates the neuron indexing, w ji and d ji are the connection’s strength and delay from neuron j to i, respectively, N stands for the number of neurons and the values used are τ = 20 ms for the membrane time constant and V st = −70 mV for the stable membrane (resting) potential. The summation over t j (n) sums all the past firing times of neuron j and spontaneous stochastic synaptic currents, i.e. external noise. Notice that when several spikes arrive simultaneously, they sum up to a single input pulse with a larger amplitude. A neuronal threshold is typically defined at V th = −54 mV and a threshold crossing results in an evoked spike followed by a refractory period of a few milliseconds, e.g. 2 ms. During this period no evoked spikes are possible and the voltage is set to −75 mV.
A persistent challenge in neuroscience is that the neuron’s membrane voltages change continuously most of the time, but occasionally spikes sharply. Therefore, certain aspects of the dynamics are best described by a discrete-time approach while others require continuous dynamics. When writing a continues-time equation, one needs to take into account that the focal neuron, i, will receive sharp inputs from other neurons, approximate by delta spikes. Since the spikes fired by neuron j arrive at a neighbor neuron i with some time delay d ji we have to take into account all previously fired spikes, such that the input received by i from j can be expressed as the sum ∑ n δ(t − t j (n) − d ji ), last term in eq. (1).
In the case where the connections between neurons are supra-threshold, V th -V st < w ji , the dynamical evolutions of Eq. (1) is simplified and the only relevant information is whether a neuron fire or not. The case of a network composed of binary neurons is easier to analyze and is at the center of this study, where the extension for sub-threshold connections is discussed later.
The standard version of the presented model is modified, according to recent experimental observations8, 9, by introducing probability for the intrinsic spike generation8, 9. Experiments report that each neuron is characterized by a critical stimulation frequency, f c , ranging from sub-Hertz to about 30. When a neuron is repeatedly stimulated (supra-threshold), its average firing frequency is saturated at f c . In the case of regular stimulations, with inter-stimulation intervals equal to Δt, the probability for a spike given a stimulation is
indicating that the response probability is Δt·f c , or unity in case Δt·f c > 1. Note that the response failures were found to be stochastic and statistically independent.
In the general case of irregular (supra-threshold) stimulations, with non-identical inter-stimulation intervals, experimental results reveal that the response probability depends on the last several stimulations with an exponentially decaying memory8, 9. Quantitatively, the neuronal response probability for the n th voltage threshold crossing of a neuron is given by
where 0 ≤ α < 1 measures the neuronal memory, Δt m is the time-lag between the (m − 1) th and m th voltage threshold crossings, p sp is the neuronal response probability for given weighted inter-stimulation-intervals, Eq. (2), and (1 − α) stands for the normalization factor of the weights, e.g. if all Δt m = Δt, the weighted average is equal to Δt. In the case of a response failure, the voltage is set to −65 mV, response failures are also counted as voltage threshold crossings.
Neural networks are commonly assumed to be composed of many weak connections and sparse strong connections, where several simultaneous stimulations lead to threshold crossings18, 19. Here we neglect the weak connections and assume solely strong connections (w ji ), such that each stimulation leads to a threshold crossing.
The parameters of the examined systems, if not stated otherwise, are N = 2000, d = 10 ms, f c = 10 Hz, α = 0 and the probability for a neuron to have k random incoming (presynaptic) connections is C k = <k> k ·exp(−<k>)/k! as in a sparse ER random graph3, where <k> = 3 stands for the average connectivity. The reported qualitative results were found to be insensitive to these parameters and are independent of initial conditions. In addition, stochastic uncorrelated stimulations, imitating spontaneous stochastic synaptic currents, were injected into the system with an average rate of f ext = 0.1 Hz per neuron, which also excludes the death possibility of the activity of the entire finite network. An example of such a simulation is presented in Fig. 1a.
Analytical approach
Using the following mean-field approach, statistical features of the dynamics, e.g. the dominating oscillation frequency20 (Fig. 1b), are well estimated.
The analytical study is further simplified where all delays are equal to d, hence, the time domain is discretized to steps of multiples of d. We look on the statistical properties of the activity, such as the probability of a neuron to be stimulated and the probability of a neuron to fire during the time steps. Our analytical framework divides neurons into groups, where each group consists of neurons with a given incoming connectivity. For each group we define a conditional probability, i.e. the probability for a neuron in that group to be stimulated at a given time step and then to produce an evoked spike. The mean-field approximation of all these conditional probabilities enables the estimation the time evolution of macroscopic quantities such as the average firing rate.
We start from a simplified case without long-term nodal memory (α ≪ 1). The quantization of the time domain to multiples of d (time = i∙d), enables to describe the fraction of firing neurons, R(i), at each time step as
where k max is the maximal possible number of incoming connections per node, C k is the probability for a neuron of having k incoming connections, p st k (i) stands for the fraction of stimulated neurons at time step i out of all neurons that have k incoming connections and the susceptibility χ k (i) stands for their probability for evoked spike.
Equation (4) can be interpreted as a simple weighted summation of independent probabilities. Specifically, the probability for a neuron to fire at time step i, R(i), is the weighted summation (C k is the weight function) over the probabilities (p st k (i)∙χ k (i)) of a neuron to fire at time step i, given it has k incoming connections, where the summation is over k. The term p st k (i)∙χ k (i) is simply the [probability for a stimulation at time step i, given the neuron has k incoming connection] multiplied by [the probability for a spike, given a stimulation at time step i to a neuron with k incoming connections].
The fraction p st k (i) can be estimated as
where [1 − R(i − 1)]k is the probability that no presynaptic neuron evoked a spike at the previous time step, (1 − f ext ∙d) is the probability that a neuron was not stimulated since the last step by synaptic noise and the last term stands for random fluctuations in finite networks which scale with N −0.5 (Gaussian random variable with a zero mean and a variance equals to < p st k (i) > ·(1 −< p st k (i) > )/(C k ·N), where < · > averages over the noise term).
Throughout the manuscript, we study the case of homogeneous external stimulations, i.e. f ext is time-independent and the probability of external stimulation is constant in each time step, a Poisson process. As a result, the probability of a neuron to be stimulated in a time step of duration d is 1 − exp(−f ext ·d), which for small values is well approximated by f ext ·d (around 0.001). However, for non-homogeneous external stimulations, e.g. the external input depends on time, the equations can be generalized to include time-dependent external stimulation frequency, f ext (i).
The susceptibility, χ k (i), is estimated by classifying the nodes into subgroups according to the number of time steps passed since their last stimulations, e.g a group of neurons that were stimulated at step i-3 but not at i-2 nor i-1. We denote by h k (i,m) the probability that m time steps passed from the last stimulation for a neuron at time i that has k incoming connections. This quantity, h k (i,m), can be approximated as a nonhomogeneous Poisson process, i.e. the probability to be stimulated at time step i-m multiplied by the probability not to be stimulated at all time steps between i−m and i:
where the last term stands for random fluctuations in finite networks which scale with N −0.5 (Gaussian random variable with a variance of < h k (i,m) > ·(1 −< h k (i,m) > )/(p st k (i)·C k ·N) and a zero mean). All neurons belonging to h k (i,m) have a response probability of p sp (m∙d), Eq. (2), thus, the susceptibility is:
Taking into account that h k (i,m) is normalized for each i (Eqs S1 and S2), and that p sp (m∙d)=m∙d∙f c for all m < (f c ∙d) −1 and 1 for m > (f c ∙d) −1, Eq. (7) can be written as a finite sum:
In case any of the probabilities stochastically deviates from [0,1], it truncates to the boundaries.
Note that the noisy terms of Eqs (5) and (6) result from a random selection process, the summation of many Bernoulli trials which leads to a Gaussian random variable, according to the central limit theorem. Specifically, in Eq. (5) the stochastic term is a result of Bernoulli trials where the “success” is a stimulation to a neuron. The stochastic term in Eq. (6) is similar, however, there is a constraint that the sum of h k (i,m) = 1, when summing over m from 1 to infinity, thus some non-intuitive correlation appears within the terms. We solved this correlation by renormalizing the terms (Eqs S1 and S2, supplementary). Nevertheless, a more sophisticated and complicated approach is possible (not shown), where the noise terms are calculated in a recursive way, creating dependencies. Preliminary results indicate that the complicated approach does not lead to a noticeable advantage over the simplified one.
Comparison of analytical and simulation results
The fraction of firing neurons, R(i), was found by solving numerically Eqs (4–8) for various networks. A comparison between this analytical approach and simulations is demonstrated in Fig. 1. Results indicate a fair agreement in the power spectrum of the activity with a maxima around 8.3 Hz, which is defined as the oscillation frequency. The dependency of the oscillation frequency on the parameters defining the network is analyzed in Fig. 2. Both analytical and simulation results clearly indicate that the oscillation frequency increases with f c and with the average incoming connectivity <k> and decreases with the delay, d (Fig. 2a–c).
The case of nodes with a longer memory, i.e. α is not small, as was found experimentally8, can be also examined using a similar analytical framework with the following generalized Eq. (8):
where <R> i is the average of R(i) over i and is estimated numerically (Eqs S3 and S4) as the steady state solution of Eqs (4–8) while setting R(i) = <R> i for all i and solving without the noise terms. The effect of α on the oscillation frequency is illustrated in Fig. 2d, indicating that the oscillation frequency decreases with α.
The reported trends are controlled by the neuronal response failures and the topology of the network. Increasing <k> or decreasing d leads to a faster formation of the oscillations and distribution of activity through the network, hence allowing higher frequency oscillations. Similarly, increasing the saturated firing frequency of the neurons, f c , increases the rate of the information propagation through the network, allowing faster oscillations. On the other hand, increasing α reduces the sensitivity of the nodes to changes in the network activity, challenging the synchronization between nodes and reducing the oscillation frequency.
The comparison between the oscillation frequencies measured in simulations of finite N and mean-field is presented in Fig. 2e,f. Results clearly indicate that at N = 2000 the difference is negligible. In addition the finite size scaling, Fig. 2f, indicates a convergence of the error, which results from the finite size, as N −0.5, which is probably attributed to the variance of the noise (Eqs (5 and 6)).
Network of networks
The generalization of the presented analytical framework to the case of n connected sub-networks, e.g. Fig. 3, is straightforward. In such a case, the activity of each sub-network is characterized by R g (i), g = 1, 2, …, n and the stimulation probability p st k (i) is then changed according to the connectivity among sub-networks, i.e. the probability for a neuron to be stimulated, given it has k 1 , k 2 , k 3 , …, k n connections from sub-network 1, 2, 3, …, n, respectively, is
The full set of the modified Eqs (4–8) are presented in Eq. S5.
An example of the activity of a network of networks, with the topology as in Fig. 3, is presented in Fig. 4. All neurons have 1 incoming connection from their own sub-network with delay d = 10 ms and 2 incoming connections from the connected sub-networks with delay D = 2d. This network of networks configuration produces cluster zero-lag synchronization15 which coexists with new oscillation modes within each sub-network.
The activity of each of the four sub-networks is exemplified in Fig. 4a, color coded according to Fig. 3. A power spectrum of the activity of the top-left (orange) network is presented (Fig. 4b), indicating new modes of oscillations among the sub-networks, which coexists with the low-frequency self-oscillations within the dynamics of each sub-network (Fig 2). The emergence of the additional modes of oscillations is attributed to the structure of the entire network, creating two inner-loops among sub-networks, 2D (40 ms, 25 Hz) and 4D (80 ms, 12.5 Hz). These local loops create two dominating non-local zero-lag synchronized clusters15, blue with green and orange with red. It represents a non-local mechanism for zero-lag synchronization, since the orange and the red sub-networks, for instance, are not directly connected. A direct evidence for the zero-lag synchronization is exemplified by the cross-correlation between the rate of the orange sub-network and the red sub-network (Fig. 4c) emerging simultaneously with a leader-laggard synchronization between the connected, green and blue, sub-networks. Note that the activity of the networks is affected by the intrinsic noise and the driving force from connected networks, which lead to a more noisy and structured activity than of a single network (Fig. 1), and is within the line of reported experimental results21, 22. The dissipation timescale of emerging fluctuations approximately depends on the deterministic part of Eqs (1–4).
In the presented case, the connectivity between sub-networks is higher than the connectivity within each sub-network, however, the opposite case where the intra-cluster connectivity is above the average is also very interesting23. This limit can be studied by using Eq. S5 (supplementary). Specifically, when the intra-cluster connectivity is above the average connectivity, preliminary results indicate that qualitatively different dynamics emerge and the activity presents other traits, which might be related to bistable regimes23, however, this examination deserves future research using the presented analytical framework.
Discussion
We have presented a quantitative analytical approach to analyze the dynamics of excitatory neural networks where the nodal rules imitate adaptive response probability with a finite memory. Results indicate that cooperative network oscillations stem from such nodes even without any inhibition. The generalization of the results to more complex topologies24 as well as for networks with a distribution of f c among neurons or inhibition is straightforward. In addition, the analytical approach can be improved by taking into account the correlation between the activity of a node and its presynaptic nodes, however, for many cases the presented mean-field equations accurately pinpoint the oscillation frequencies. Moreover, the equations can be generalized to a continues-time version which can take into account a distribution for the delays by transforming the sums into integrals. The continues-time version of the equations is numerically and analytically more challenging, and deserves future research.
Throughout the manuscript we assumed that the links are supra-threshold, this assumption allowed the presentation of a simpler version of the equations. The generalization to the case of sub-threshold connections is possible and requires additional nonlinear equation, similar to Eq. 6, to take into account correlations between stimulations. Oscillations in neural networks with sub-threshold interactions were experimentally observed25, and the generalization of the analytical framework to the case of delay-coupled networks with sub-threshold interactions26 would vastly expand the horizon and potential impact of the presented framework.
Our analytical approach simplifies a problem from a complex nonlinear set of N equations to a finite small set of equations, where only the magnitude of the noise is dependent on N. For the specific case of a neural network where the activity depends on the history, in a nonlinear (multiplicative) way, Eq. (6), the resulting set of equations (Eqs 4–8) are difficult to solve analytically and we used numerical analysis. It might be possible to solve some approximated version of the equations and compute the approximated power spectrum analytically following standard techniques27,28,29.
The presented analytical approach is applicable also to other types of graphs, including scale-free networks30. It is possible to numerally solve such models when the graphs consist of a finite number of classes of nodes, similar to the four classes presented in Figs 3 and 4, or sub-sampling a scale-free distribution. Such solutions might reveal an interesting interplay between the oscillation modes and the topology of the network. However, the extension of our results to an infinite number of classes (the entire distribution of the scale-free connectivity), presents a challenge which certainly deserves further research.
The examined model is based on two features, hyperactive nodes degenerate their neighbors and nodes having memory. These features are common in a diversity of real-world complex networks, where competition exists, e.g. economics12. Nevertheless, the exemplified framework can describe the dynamical properties of the different type of network models, by modifying Eqs (3) and (5) according to the response of the nodes and the details of the graph, respectively. We anticipate the presented analytical framework and our results to bring a better understanding as well as an advanced methodology for the investigation of coexisting cooperative modes of activity in a variety of complex networks of networks and scale-free networks.
References
Albert, R. & Barabási, A.-L. Statistical mechanics of complex networks. Reviews of modern physics 74, 47 (2002).
Opper, M. & Kinzel, W. In Models of neural networks III 151–209 (Springer, 1996).
Cohen, R. & Havlin, S. Complex networks: structure, robustness and function. (Cambridge University Press, 2010).
Gross, T. & Feudel, U. Generalized models as a universal approach to the analysis of nonlinear dynamical systems. Physical Review E 73, 016205 (2006).
Nixon, M., Ronen, E., Friesem, A. A. & Davidson, N. Observing geometric frustration with thousands of coupled lasers. Physical review letters 110, 184102 (2013).
Chen, G., Dong, Z. Y., Hill, D. J., Zhang, G. H. & Hua, K. Q. Attack structural vulnerability of power grids: A hybrid approach based on complex networks. Physica A: Statistical Mechanics and its Applications 389, 595–603 (2010).
Mantegna, R. N. & Stanley, H. E. Scaling behaviour in the dynamics of an economic index. Nature 376, 46–49 (1995).
Vardi, R. et al. Neuronal response impedance mechanism implementing cooperative networks with low firing rates and μs precision. Frontiers in neural circuits 9 (2015).
Goldental, A., Vardi, R., Sardi, S., Sabo, P. & Kanter, I. Broadband macroscopic cortical oscillations emerge from intrinsic neuronal response failures. Frontiers in neural circuits 9 (2015).
Domany, E., Van Hemmen, J. L. & Schulten, K. Models of neural networks I. (Springer Science & Business Media, 2012).
Kinzel, W. & Opper, M. In Models of neural networks 149–171 (Springer, 1991).
Schuster, H. G., Plenz, D. & Niebur, E. Criticality in neural systems. (John Wiley & Sons, 2014).
Gao, J., Buldyrev, S. V., Stanley, H. E. & Havlin, S. Networks formed from interdependent networks. Nature physics 8, 40–48 (2012).
Ivanov, P. C. & Bartsch, R. P. In Networks of Networks: the last Frontier of Complexity 203–222 (Springer, 2014).
Kanter, I. et al. Nonlocal mechanism for cluster synchronization in neural circuits. EPL (Europhysics Letters) 93, 66001 (2011).
Gerstner, W. & Kistler, W. M. Spiking neuron models: Single neurons, populations, plasticity. (Cambridge university press, 2002).
Friedrich, J. & Kinzel, W. Dynamics of recurrent neural networks with delayed unreliable synapses: metastable clustering. Journal of computational neuroscience 27, 65–80 (2009).
Teramae, J.-n., Tsubo, Y. & Fukai, T. Optimal spike-based communication in excitable networks with strong-sparse and weak-dense links. Scientific Reports 2 (2012).
Klemm, K., Bornholdt, S. & Schuster, H. G. Beyond Hebb: Exclusive-OR and biological learning. Physical Review Letters 84, 3013 (2000).
Buzsaki, G. Rhythms of the Brain. (Oxford University Press, 2006).
Litwin-Kumar, A. & Doiron, B. Slow dynamics and high variability in balanced cortical networks with clustered connections. Nature neuroscience 15, 1498–1505 (2012).
Churchland, M. M. et al. Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nature neuroscience 13, 369–378 (2010).
Klinshov, V. V., Teramae, J.-n., Nekorkin, V. I. & Fukai, T. Dense neuron clustering explains connectivity statistics in cortical microcircuits. PloS one 9, e94292 (2014).
Kosmidis, K., Havlin, S. & Bunde, A. Structural properties of spatially embedded networks. EPL (Europhysics Letters) 82, 48005 (2008).
Goldental, A., Sabo, P., Sardi, S., Vardi, R. & Kanter, I. Mimicking Collective Firing Patterns of Hundreds of Connected Neurons using a Single-Neuron Experiment. Frontiers in neuroscience 9 (2015).
Lücken, L., Rosin, D. P., Worlitzer, V. M. & Yanchuk, S. Pattern reverberation in networks of excitable systems with connection delays. Chaos: An Interdisciplinary Journal of Nonlinear Science 27, 013114 (2017).
Van Kampen, N. G. & Reinhardt, W. P. Stochastic processes in physics and chemistry. (AIP, 1983).
Galla, T. Intrinsic fluctuations in stochastic delay systems: Theoretical description and application to a simple model of gene regulation. Physical Review E 80, 021909 (2009).
Boland, R. P., Galla, T. & McKane, A. J. Limit cycles, complex Floquet multipliers, and intrinsic noise. Physical Review E 79, 051131 (2009).
Barabási, A.-L. Scale-free networks: a decade and beyond. Science 325, 412–413 (2009).
Acknowledgements
This work was supported by the TELEM grant of the planning and budgeting Committee of the Council of Higher Education, 2015, Israel.
Author information
Authors and Affiliations
Contributions
A.G. developed the analytical framework together with H.U. and performed the simulations. S.S. performed some of the simulations. I.K. initiated the study and supervised all aspects of the work. All authors discussed the results and commented on the manuscript.
Corresponding author
Ethics declarations
Competing Interests
The authors declare that they have no competing interests.
Additional information
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Goldental, A., Uzan, H., Sardi, S. et al. Oscillations in networks of networks stem from adaptive nodes with memory. Sci Rep 7, 2700 (2017). https://doi.org/10.1038/s41598-017-02814-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-017-02814-w
This article is cited by
-
Optimal responsiveness and information flow in networks of heterogeneous neurons
Scientific Reports (2021)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.