Review Article | Published:

Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding

Nature Reviews Neuroscience volume 11, pages 615627 (2010) | Download Citation

Abstract

The brain is a highly modular structure. To exploit modularity, it is necessary that spiking activity can propagate from one module to another while preserving the information it carries. Therefore, reliable propagation is one of the key properties of a candidate neural code. Surprisingly, the conditions under which spiking activity can be propagated have received comparatively little attention in the experimental literature. By contrast, several computational studies in the last decade have addressed this issue. Using feedforward networks (FFNs) as a generic network model, they have identified two dynamical activity modes that support the propagation of either asynchronous (rate code) or synchronous (temporal code) spiking. Here, we review the dichotomy of asynchronous and synchronous propagation in FFNs, propose their integration into a single extended conceptual framework and suggest experimental strategies to test our hypothesis.

Key points

  • One of the central problems in neuroscience is the characterization and understanding of the neural code. In 1968 Perkel and Bullock defined four key functions for a candidate neural code: stimulus representation, interpretation, transformation and transmission. Although the first three have been studied extensively, surprisingly, the fourth has been largely ignored in experiments. Yet, signal transmission is a vital functions for a neural code in ensuring communication among highly specialized brain regions.

  • Feedforward networks with convergent or divergent connections between subsequent groups of neurons have been the model system of choice in the study of spiking-activity propagation. The simple feedforward topology captures key features of the modular architecture of the brain. Moreover, from a functional perspective, certain classes of recurrent networks can be treated as feedforward networks.

  • Theoretical studies have identified two dominant modes for propagating spiking activity in feedforward networks: the aynchronous rate mode, in which the average spike count is propagated across the sub-networks; and the synchronous event mode, in which only synchronous volleys of spikes are propagated.

  • Various properties of individual neurons and the structure of feedforward networks can amplify even weak correlations in spiking-activity propagation. Such amplification rapidly degenerates the fidelity of an asynchronous rate code. Thus, only feedforward networks with weak shared connectivity are suitable for propagating asynchronous firing rates. Large, shared connectivity favours the propagation of a synchrony code.

  • Structural properties of feedforward networks, in particular connection probability and synaptic strengths, have a crucial role in determining whether asynchronous firing rates or synchronous spikes are propagated. Thus, appropriate architecture of the FFN may support stable propagation of asynchronous and synchronous neural codes simultaneously.

  • Indirect experimental evidence suggests that neural networks in vivo may indeed induce synchrony in their propagating activity. However, a direct testing of theoretical predictions is currently lacking. Controlled stimulation of appropriately selected neural networks in vivo to generate activity patterns mimicking either asynchronous or synchronous input and monitoring of their temporal evolution downstream could provide an effective paradigm for testing these predicitions.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    Psychology: The Briefer Course. (Henry Holt and Company, New York, 1890).

  2. 2.

    & Neural coding: a report based on an NRP work session. Neurosci. Res. Program Bull. 6, 219–349 (1968). A seminal report that defines key properties of a neural code and describes various candidate neural codes.

  3. 3.

    Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro. Nature Neurosci. 6, 593–599 (2003). The only study that has addressed the issue of spiking-activity propagation in experiments. Using an innovative method this study showed the emergence of synchrony in feedforward networks.

  4. 4.

    , & Stable propagation of synchronous spiking in cortical neural networks. Nature 402, 529–533 (1999). The first study to systematically investigate the propagation of synchronous spiking in computer simulations of feedforward networks.

  5. 5.

    & Fokker–Planck approach to the pulse packet propagation in synfire chain. Neural Netw. 14, 657–685 (2001).

  6. 6.

    , & Fast propagation of firing rates through layered networks of noisy neurons. J. Neurosci. 22, 1956–1966 (2002).

  7. 7.

    & Stable propagation of activity pulses in populations of spiking neurons. Neural Comput. 14, 987–997 (2002).

  8. 8.

    et al. On the transmission of rate code in long feedforward networks with excitatory-inhibitory balance. J. Neurosci. 23, 3006–3015 (2003).

  9. 9.

    , & Conditions for propagating synchronous spiking and asynchronous firing rates in a cortical network model. J. Neurosci. 28, 5268–5280 (2008). The first study to show that asynchronous–irregular ongoing activity in a recurrent network facilitates propagation of both synchronous spiking and asynchronous firing rates in an embedded feedforward network.

  10. 10.

    & Signal propagation and logic gating in networks of integrate-and-fire neurons. J. Neurosci. 25, 10786–10795 (2005).

  11. 11.

    & Gating multiple signals through detailed balance of excitation and inhibition in spiking networks. Nature Neurosci. 12, 483–491 (2009).

  12. 12.

    , & Propagation of synchronous spiking activity in feedforward neural networks. J. Physiol. (Paris) 90, 243–247 (1996).

  13. 13.

    , & Propagation of cortical synfire activity: survival probability in single trials and stability in the mean. Neural Netw. 14, 657–673 (2001).

  14. 14.

    , & Neural assemblies. IEEE Trans. Biomed. Eng. 36, 1–11 (1989).

  15. 15.

    Neural signatures of cell assembly organization. Nature Rev. Neurosci. 6, 399–407 (2005).

  16. 16.

    The Organization of Behavior: A Neuropsychological Theory. (John Wiley & Sons, New York, 1949).

  17. 17.

    et al. Dynamics of ongoing activity: explanation of the larger variability in evoked cortical responses. Science 273, 1868–1871 (1996).

  18. 18.

    et al. Spontaneously emerging cortical representations of visual attributes. Nature 425, 954–956 (2003).

  19. 19.

    & The variable discharge of cortical neurons: implication for connectivity, computation, and information coding. J. Neurosci. 18, 3870–3896 (1998).

  20. 20.

    A quantitative map of the circuit of cat primary visual cortex. J. Neurosci. 24, 8441–8453 (2004).

  21. 21.

    & Cortex: Statistics and Geometry of Neuronal Connectivity. (Springer-Verlag, Berlin, 1998).

  22. 22.

    et al. Hippocampal pyramidal cells excite inhibitory neurons through a single release site. Nature 366, 683–687 (1993).

  23. 23.

    , & The probability of transmitter release at a mammalian central synapse. Nature 366, 569–572 (1993).

  24. 24.

    , & Cooperativity in brain function: assemblies of approximately 30 neurons. Exp. Neurol. 77, 324–358 (1982).

  25. 25.

    Corticonics: Neural Circuits of the Cerebral Cortex. (Cambridge Univ. Press, Cambridge, UK, 1991).

  26. 26.

    & Parallel versus serial processing: new vistas on the distributed organization of the visual system. Curr. Opin. Neurobiol. 5, 497–503 (1995).

  27. 27.

    & Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1, 1–46 (1991).

  28. 28.

    Mind and Body: The Theories of Their Relation. (D. Appleton and Company, New York, 1875).

  29. 29.

    Man on his Nature. (Cambridge Univ. Press, Cambridge, UK, 1942).

  30. 30.

    Local Cortical Circuits: An Electrophysiological Study. (Berlin, Heidelberg, New York, 1982).

  31. 31.

    The quantification and graphic display of correlations among three spike trains. IEEE Trans. Biomed. Eng. 30, 235–239 (1983).

  32. 32.

    et al. Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. J. Neurophysiol. 70, 1629–1638 (1993).

  33. 33.

    & Favored patterns in spike trains. II. Application. J. Neurophysiol. 49, 1349–1363 (1983).

  34. 34.

    , & Recurring discharge patterns in multiple spike trains. II. Application in forebrain areas related to cardiac and respiratory control during different sleep–waking states. Biol. Cybern. 62, 495–502 (1990).

  35. 35.

    et al. Synfire chains and cortical songs: temporal modules of cortical activity. Science 304, 559–564 (2004).

  36. 36.

    et al. Stochastic emergence of repeating cortical motifs in spontaneous membrane potential fluctuations in vivo. Neuron 53, 413–425 (2007).

  37. 37.

    et al. Spatiotemporal structure of cortical activity: properties and behavioral relevance. J. Neurophysiol. 79, 2857–2874 (1998).

  38. 38.

    , & The statistics of repeating patterns of cortical activity can be reproduced by a model network of stochastic binary neurons. J. Neurosci. 28, 10734–10745 (2008).

  39. 39.

    in Models of Neural Networks II Ch. 2 (eds Domany, E., van Hemmen, J. L. & Schulten, K.) 95–119 (Springer Verlag, Berlin, 1981).

  40. 40.

    & Visual feature integration and the temporal correlation hypothesis. Annu. Rev. Neurosci. 18, 555–586 (1995).

  41. 41.

    The Cat Primary Visual Cortex (eds Payne, B. & Peters, A.) 521–559 (Academic Press, San Diego, 2002).

  42. 42.

    On the stability of brain-like structures. Biophys. J. 3, 299–308 (1963).

  43. 43.

    Memory without feedback in a neural network. Neuron 61, 621–634 (2009). This theoretical study and references 44 and 47 showed that, from a functional perspective, a certain class of recurrent networks can be considered as feedforward networks.

  44. 44.

    & Balanced amplification: a new mechanism of selective amplification of neural activity patterns. Neuron 61, 635–648 (2009).

  45. 45.

    et al. Detecting synfire chain activity using massively parallel spike train recording. J. Neurophysiol. 100, 2165–2176 (2008).

  46. 46.

    & Embedding multiple trajectories in simulated recurrent neural networks in a self-organizing manner. J. Neurosci. 29, 13172–13181 (2009).

  47. 47.

    , & Memory traces in dynamical systems. Proc. Natl Acad. Sci. 105, 18970–18975 (2008).

  48. 48.

    Embedding of synchronous spike activity in cortical networks. Deutsche National Bibliotek (2001).

  49. 49.

    , & Spike-timing dynamics of neuronal groups. Cereb. Cortex 14, 933–944 (2004).

  50. 50.

    et al. On embedding synfire chains in a balanced network. Neural Comput. 15, 1321–1340 (2003).

  51. 51.

    et al. Activity dynamics and propagation of synchronous spiking in locally connected random networks. Biol. Cybern. 88, 395–408 (2003).

  52. 52.

    et al. The spread of rate and correlation in stationary cortical networks. Neurocomputing 52–54, 949–954 (2003).

  53. 53.

    , & The ground state of cortical feed-forward networks. Neurocomputing 44–46, 673–678 (2002).

  54. 54.

    & Limits to the temporal fidelity of cortical spike rate signals. Nature Neurosci. 5, 463–471 (2002). This study showed for the first time that even weak correlations can impair stimulus encoding in the form of firing rates in an ensemble of neurons.

  55. 55.

    et al. Population coding in neuronal systems with correlated noise. Phys. Rev. E Stat. Nonlin. Soft Matter Phys. 64, 051904 (2001).

  56. 56.

    et al. Correlation between neural spike trains increases with firing rate. Nature 448, 802–807 (2007).

  57. 57.

    , & Can. spike coordination be differentiated from rate covariation? Neural Comput. 20, 1973–1999 (2008).

  58. 58.

    et al. Dynamics of neuronal firing correlation: modulation of 'effective connectivity.' J. Neurophysiol. 61, 900–917 (1989).

  59. 59.

    , & Unitary events in multiple single-neuron spiking activity: I. Detection and significance. Neural Comput. 14, 43–80 (2002).

  60. 60.

    , & Unitary events in multiple single-neuron spiking activity: II. Nonstationary data. Neural Comput. 14, 81–119 (2002).

  61. 61.

    , & Statistical significance of coincident spikes: count-based versus rate-based statistics. Neural Comput. 14, 121–153 (2002).

  62. 62.

    Gruen S. & Rotter S. Higher-order correlations in non-stationary parallel spike trains: statistical modeling and inference. Front. Comput. Neurosci. 4, 16 (2010).

  63. 63.

    , & Correlated firing in macaque visual area MT: time scales and relationship to behavior. J. Neurosci. 21, 1676–1697 (2001).

  64. 64.

    , & Optimal decoding of correlated neural population responses in the primate visual cortex. Nature Neurosci. 9, 1412–1420 (2006).

  65. 65.

    et al. Spike synchronization and rate modulation differentially involved in motor cortical function. Science 278, 1950–1953 (1997).

  66. 66.

    & Short-term memory in olfactory network dynamics. Nature 402, 664–668 (1999).

  67. 67.

    et al. Dynamics of neuronal interactions in monkey cortex in relation to behavioural events. Nature 373, 515–518 (1995).

  68. 68.

    & Odour encoding by temporal sequences of firing in oscillating neural assemblies. Nature 384, 162–166 (1996).

  69. 69.

    & Relationship between afferent and central temporal patterns in the locust olfactory system. J. Neurosci. 19, 381–390 (1999).

  70. 70.

    , & Correlated neuronal discharge rate and its implications for psychophysical performance. Nature 370, 140–143 (1994).

  71. 71.

    & The impulses produced by sensory nerve-endings: part II. The response of a Single End-Organ. J. Physiol. 61, 151–171 (1926).

  72. 72.

    Single units and sensation: a neuron doctrine for perceptual psychology? Perception 1, 371–394 (1972).

  73. 73.

    & Posterior parietal cortex encodes autonomously selected motor plans. Neuron 56, 552–559 (2007).

  74. 74.

    et al. Neuronal correlates of parametric working memory in the prefrontal cortex. Nature 399, 470–473 (1999).

  75. 75.

    & Dynamics of the hippocampal ensemble code for space. Science 261, 1055–1058 (1993).

  76. 76.

    & Orthogonal coding of object location. Trends Neurosci. 32, 101–108 (2009).

  77. 77.

    , & Independent rate and temporal coding in hippocampal pyramidal cells. Nature 425, 828–832 (2003).

  78. 78.

    & Synaptic plasticity: taming the beast. Nature Neurosci. 3, 1178–1183 (2000).

  79. 79.

    et al. Learning input correlations through nonlinear temporally asymmetric hebbian plasticity. J. Neurosci. 23, 3697–3714 (2003).

  80. 80.

    , & Stable Hebbian learning from spike timing-dependent plasticity. J. Neurosci. 20, 8812–8821 (2000).

  81. 81.

    , & Neuronal integration of synaptic input in the fluctuation-driven regime. J. Neurosci. 24, 2345–2356 (2004).

  82. 82.

    , & Higher-order statistics of input ensembles and the response of simple model neurons. Neural Comput. 16, 67–101 (2003).

  83. 83.

    , & On the relationship between synaptic input and spike output jitter in individual neurons. Proc. Natl Acad. Sci. 94, 736–740 (1997).

  84. 84.

    & Impact of correlated synaptic input on output firing rate and variability in simple neuronal models. J. Neurosci. 20, 6193–6209 (2000).

  85. 85.

    & Integrate-and-fire neurons driven by correlated stochastic input. Neural Comput. 14, 2111–2155 (2002).

  86. 86.

    & Analysis of integrate-and-fire neurons: synchronization of synaptic input and spike output. Neural Comput. 11, 871–901 (1999).

  87. 87.

    Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons. J. Comput. Neurosci. 8, 183–208 (2000).

  88. 88.

    et al. The high-conductance state of cortical networks. Neural Comput. 20, 1–43 (2008).

  89. 89.

    et al. The asynchronous state in cortical circuits. Science 327, 587–590 (2010).

  90. 90.

    et al. Decorrelated neuronal firing in cortical microcircuits. Science 327, 584–587 (2010).

  91. 91.

    & Neural correlations increase between consecutive processing levels in the auditory system of locusts. J. Neurophysiol. 97, 3376–3385 (2007).

  92. 92.

    et al. Functional consequences of correlated excitatory and inhibitory conductances in cortical networks. J. Comput. Neurosci. 28, 579–594 (2010). The first study to systematically investigate the role of correlated excitatory and inhibitory inputs on the stability and propagation of spiking activity in feedforward networks that are embedded in recurrent networks.

  93. 93.

    et al. New attractor states for synchronous activity in synfire chains with excitatory and inhibitory coupling. Biol. Cybern. 86, 367–378 (2002).

  94. 94.

    & Local cortical circuit model inferred from power-law distributed neuronal avalanches. J. Comput. Neurosci. 22, 301–312 (2007).

  95. 95.

    & The mechanism of synchronization in feed-forward neuronal networks. New J. Phys. 10, 015007 (2008).

  96. 96.

    et al. Cellular, circuit, and synaptic mechanisms in song learning. Ann. NY Acad. Sci. 1016, 495–523 (2004).

  97. 97.

    , & Neurons in a forebrain nucleus required for vocal plasticity rapidly switch between precise firing and variable bursting depending on social context. J. Neurosci. 28, 13232–13247 (2008).

  98. 98.

    , & Propagation of correlated activity through multiple stages of a neural circuit. J. Neurosci. 23, 5750–5761 (2003).

  99. 99.

    & Activity propagation in an avian basal ganglia-thalamocortical circuit essential for vocal learning. J. Neurosci. 29, 4782–4793 (2009).

  100. 100.

    & Cortex is driven by weak but synchronously active thalamocortical synapses. Science 312, 1622–1627 (2006).

  101. 101.

    A model of neocortex. Netw. Comp. Neural Syst. 6, 179–224 (1995). This paper proposed a model of neocortex functioning based on interacting feedforward networks.

  102. 102.

    et al. Millisecond-scale differences in neural activity in auditory cortex can drive decisions. Nature Neurosci. 11, 1262–1263 (2008).

  103. 103.

    , & Precisely correlated firing in cells of the lateral geniculate nucleus. Nature 383, 815–819 (1996).

  104. 104.

    et al. Temporal precision in the neural code and the timescales of natural vision. Nature 449, 92–96 (2007).

  105. 105.

    et al. Synaptic and network nechanisms of sparse and reliable nisual cortical activity during nonclassical receptive field stimulation. Neuron 65, 107–121 (2010).

  106. 106.

    et al. Controlling synfire chain by inhibitory synaptic input. J. Physical Soc. Japan 76, 044806 (2007).

  107. 107.

    , & Modeling compositionality by dynamic binding of synfire chains. J. Comput. Neurosci. 17, 179–201 (2004). One of the first papers to explore the computational properties of interacting feedforward networks exploiting synchrony propagation.

  108. 108.

    Neural Networks: A Comprehensive Foundation. (Prentice Hall, New Jersey, USA, 1999).

  109. 109.

    , & Speed of processing in the human visual system. Nature 381, 520–522 (1996).

  110. 110.

    , & Spike-based strategies for rapid processing. Neural Netw. 14, 715–725 (2001).

  111. 111.

    & Rate coding versus temporal order coding: what the retinal ganglion cells tell the visual cortex. Neural Comput. 13, 1255–1283 (2001).

  112. 112.

    & Rapid neural coding in the retina with relative spike latencies. Science 319, 1108–1111 (2008).

  113. 113.

    & Stimulus dependence of neuronal correlation in primary visual cortex of the macaque. J. Neurosci. 25, 3661–3673 (2005).

  114. 114.

    & Sparse coding of sensory inputs. Curr. Opin. Neurobiol. 14, 481–487 (2004).

  115. 115.

    & Behavioural report of single neuron stimulation in somatosensory cortex. Nature 451, 65–68 (2008).

  116. 116.

    et al. Sparse coding via thresholding and local competition in neural circuits. Neural Comput. 20, 2526–2563 (2008).

  117. 117.

    , & Sparse and powerful cortical spikes. Curr. Opin. Neurobiol. 20, 306–312 (2010).

  118. 118.

    , & Spontaneous events outline the realm of possible sensory responses in neocortical populations. Neuron 62, 413–425 (2009).

  119. 119.

    & Learning short synfire chains by self-organization. Netw. Comp. Neural Syst. 7, 357–363 (1996).

  120. 120.

    , & Spike-timing-dependent plasticity in balanced random networks. Neural Comput. 19, 1437–1467 (2007).

  121. 121.

    A Textbook of Psychology. (W. B. Saunders Company, Philadelphia and London, 1958).

  122. 122.

    & An approach to the quantitative analysis of electrophysiological data from single neurons. Biophys. J. 1, 15–28 (1960).

  123. 123.

    , & Single-trial estimation of neuronal firing rates: from single-neuron spike trains to population activity. J. Neurosci. Methods 94, 82–92 (1999).

  124. 124.

    , & Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. Biophys. J. 7, 419–440 (1967).

  125. 125.

    , & On the significance of correlations among neuronal spike trains. Biol. Cybern. 59, 1–11 (1988).

  126. 126.

    et al. Dependence of neuronal correlations on filter characteristics and marginal spike-train statistics. Neural Comput. 20, 2133–2184 (2008).

  127. 127.

    & Information-geometric measure for neural spikes. Neural Comput. 14, 2269–2316 (2002).

  128. 128.

    et al. Detecting higher-order interactions among the spiking events in a group of neurons. Biol. Cybern. 73, 69–81 (1995).

  129. 129.

    , , & Sensory neural codes using multiplexed temporal scales. Trends Neurosci. 33, 111–120 (2010).

Download references

Acknowledgements

We thank J. Kremkow and T. Vogels for helpful discussions, G. Grah for preparing some of the graphical illustrations and U. Froriep for proofreading the manuscript. We also thank the editorial staff at the Nature Reviews Neuroscience for their continuous help in organizing the manuscript. This work was supported by the German Federal Ministry of Education and Research (grant 01GQ0420 to the Bernstein Center for Computational Neuroscience, Freiburg), the EU (grant no. 15,879-FACETS) and the German Research Foundation (Collaborative Research Center 780).

Author information

Affiliations

  1. Bernstein Center Freiburg and Faculty of Biology, University of Freiburg, Hansastrasse 9a, 79104, Freiburg, Germany.

    • Arvind Kumar
    • , Stefan Rotter
    •  & Ad Aertsen

Authors

  1. Search for Arvind Kumar in:

  2. Search for Stefan Rotter in:

  3. Search for Ad Aertsen in:

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to Arvind Kumar.

Supplementary information

PDF files

  1. 1.

    Supplementary information S1 (box)

    Network model

Glossary

Convergent–divergent connection

A connectivity scheme in which neurons in a group receive inputs from many neurons in a previous group (convergent connections) and at the same time project to many neurons in subsequent groups (divergent connections).

Unreliable synapses

Synapses may fail to induce a postsynaptic potential in the target neuron despite stimulation owing to the probabilistic nature of synaptic vesicle release.

Read-out problem

The problem of how the neural activity of a single neuron or group of neurons received and transformed ('decoded') by a postsynaptic group of neurons, to result in, for example, a decision, perception or motor act.

Embedding recurrent network

A large recurrent network typically composed of excitatory and inhibitory neurons that contain feedforward networks as subnetworks.

In- and out-degree

In-degree refers to the number of input synapses that a neuron receives. Out-degree refers to the number of synapses a neuron makes.

Asynchronous–irregular

A network state characterized by irregular firing of individual neurons (measured by the coefficient of variation of the inter-spike-interval distribution) and by asynchronous population activity (measured by pairwise correlation or fano factor) (Box 2).

Fixed point

If the system arrives at this point in its state-space, it remains there permanently in the absence of disturbances (a steady state). Fixed points can be stable or unstable.

Attractor

A fixed point in the state-space that attracts all of the system trajectories passing through its neighbourhood.

Saddle node

A fixed point that attracts some nearby trajectories but repels others.

State-space

A multi-dimensional space defined by variables that characterize the system state. If there are N such variables, each state is represented by a point in an N-dimensional state-space.

Rank-order coding

A spatiotemporal pattern of spikes in which the temporal rank of spikes carries information about a stimulus or cognitive state.

Sparse code

A coding scheme in which strong activation of a relatively small set of available neurons is used for information representation.

About this article

Publication history

Published

DOI

https://doi.org/10.1038/nrn2886

Further reading