Abstract
Shared neural variability is ubiquitous in cortical populations. While this variability is presumed to arise from overlapping synaptic input, its precise relationship to local circuit architecture remains unclear. We combine computational models and in vivo recordings to study the relationship between the spatial structure of connectivity and correlated variability in neural circuits. Extending the theory of networks with balanced excitation and inhibition, we find that spatially localized lateral projections promote weakly correlated spiking, but broader lateral projections produce a distinctive spatial correlation structure: nearby neuron pairs are positively correlated, pairs at intermediate distances are negatively correlated and distant pairs are weakly correlated. This non-monotonic dependence of correlation on distance is revealed in a new analysis of recordings from superficial layers of macaque primary visual cortex. Our findings show that incorporating distance-dependent connectivity improves the extent to which balanced network theory can explain correlated neural variability.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Rent or buy this article
Prices vary by article type
from$1.95
to$39.95
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
Change history
25 May 2017
A more complete analysis suite has been added to the Supplementary Software.
References
Ermentrout, B. Neural networks as spatio-temporal pattern-forming systems. Rep. Prog. Phys. 61, 353 (1998).
Faisal, A.A., Selen, L.P. & Wolpert, D.M. Noise in the nervous system. Nat. Rev. Neurosci. 9, 292–303 (2008).
Pouget, A., Beck, J.M., Ma, W.J. & Latham, P.E. Probabilistic brains: knowns and unknowns. Nat. Neurosci. 16, 1170–1178 (2013).
Shamir, M. Emerging principles of population coding: in search for the neural code. Curr. Opin. Neurobiol. 25, 140–148 (2014).
Softky, W.R. & Koch, C. The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J. Neurosci. 13, 334–350 (1993).
Shadlen, M.N. & Newsome, W.T. Noise, neural codes and cortical organization. Curr. Opin. Neurobiol. 4, 569–579 (1994).
van Vreeswijk, C. & Sompolinsky, H. Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274, 1724–1726 (1996).
Denève, S. & Machens, C.K. Efficient codes and balanced networks. Nat. Neurosci. 19, 375–382 (2016).
Lim, S. & Goldman, M.S. Balanced cortical microcircuitry for spatial working memory based on corrective feedback control. J. Neurosci. 34, 6790–6806 (2014).
Hansel, D. & van Vreeswijk, C. The mechanism of orientation selectivity in primary visual cortex without a functional map. J. Neurosci. 32, 4049–4064 (2012).
Shu, Y., Hasenstaub, A. & McCormick, D.A. Turning on and off recurrent balanced cortical activity. Nature 423, 288–293 (2003).
Haider, B., Duque, A., Hasenstaub, A.R. & McCormick, D.A. Neocortical network activity in vivo is generated through a dynamic balance of excitation and inhibition. J. Neurosci. 26, 4535–4545 (2006).
Okun, M. & Lampl, I. Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities. Nat. Neurosci. 11, 535–537 (2008).
Dorrn, A.L., Yuan, K., Barker, A.J., Schreiner, C.E. & Froemke, R.C. Developmental sensory experience balances cortical excitation and inhibition. Nature 465, 932–936 (2010).
Graupner, M. & Reyes, A.D. Synaptic input correlations leading to membrane potential decorrelation of spontaneous activity in cortex. J. Neurosci. 33, 15075–15085 (2013).
Zhou, M. et al. Scaling down of balanced excitation and inhibition by active behavioral states in auditory cortex. Nat. Neurosci. 17, 841–850 (2014).
Xue, M., Atallah, B.V. & Scanziani, M. Equalizing excitation-inhibition ratios across visual cortical neurons. Nature 511, 596–600 (2014).
Amit, D.J. & Brunel, N. Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb. Cortex 7, 237–252 (1997).
Ko, H. et al. Functional specificity of local synaptic connections in neocortical networks. Nature 473, 87–91 (2011).
Fino, E. & Yuste, R. Dense inhibitory connectivity in neocortex. Neuron 69, 1188–1203 (2011).
Levy, R.B. & Reyes, A.D. Spatial profile of excitatory and inhibitory synaptic connectivity in mouse primary auditory cortex. J. Neurosci. 32, 5609–5619 (2012).
Oswald, A.M., Doiron, B., Rinzel, J. & Reyes, A.D. Spatial profile and differential recruitment of GABAB modulate oscillatory activity in auditory cortex. J. Neurosci. 29, 10321–10334 (2009).
Renart, A. et al. The asynchronous state in cortical circuits. Science 327, 587–590 (2010).
Ecker, A.S. et al. Decorrelated neuronal firing in cortical microcircuits. Science 327, 584–587 (2010).
Cohen, M.R. & Kohn, A. Measuring and interpreting neuronal correlations. Nat. Neurosci. 14, 811–819 (2011).
Doiron, B., Litwin-Kumar, R., Rosenbaum, R., Ocker, G.K. & Josić, K. The mechanics of state-dependent neural correlations. Nat. Neurosci. 19, 383–393 (2016).
Kohn, A., Zandvakili, A. & Smith, M.A. Correlations and brain states: from electrophysiology to functional imaging. Curr. Opin. Neurobiol. 19, 434–438 (2009).
Poulet, J.F. & Petersen, C.C. Internal brain state regulates membrane potential synchrony in barrel cortex of behaving mice. Nature 454, 881–885 (2008).
Cohen, M.R. & Maunsell, J.H. Attention improves performance primarily by reducing interneuronal correlations. Nat. Neurosci. 12, 1594–1600 (2009).
Mochol, G., Hermoso-Mendizabal, A., Sakata, S., Harris, K.D. & de la Rocha, J. Stochastic transitions into silence cause noise correlations in cortical circuits. Proc. Natl. Acad. Sci. USA 112, 3529–3534 (2015).
Ecker, A.S. et al. State dependence of noise correlations in macaque primary visual cortex. Neuron 82, 235–248 (2014).
Hansen, B.J., Chelaru, M.I. & Dragoi, V. Correlated variability in laminar cortical circuits. Neuron 76, 590–602 (2012).
Smith, M.A., Jia, X., Zandvakili, A. & Kohn, A. Laminar dependence of neuronal correlations in visual cortex. J. Neurophysiol. 109, 940–947 (2013).
Lund, J.S., Angelucci, A. & Bressloff, P.C. Anatomical substrates for functional columns in macaque monkey primary visual cortex. Cereb. Cortex 13, 15–24 (2003).
Wimmer, K. et al. The dynamics of sensory integration in a hierarchical network explains choice probabilities in MT. Nat. Commun. 6, 6177 (2015).
Smith, M.A. & Kohn, A. Spatial and temporal scales of neuronal correlation in primary visual cortex. J. Neurosci. 28, 12591–12603 (2008).
Rosenbaum, R. & Doiron, B. Balanced networks of spiking neurons with spatially dependent recurrent connections. Phys. Rev. X 4, 021039 (2014).10.1103/PhysRevX.4.021039
Yu, B., Kohn, A. & Smith, M.A. Estimating shared firing rate fluctuations in neural populations. Soc. Neurosci. abstr. 483.18 (2011).
Lin, I.C., Okun, M., Carandini, M. & Harris, K.D. The nature of shared cortical variability. Neuron 87, 644–656 (2015).
Schölvinck, M.L., Saleem, A.B., Benucci, A., Harris, K.D. & Carandini, M. Cortical state determines global variability and correlations in visual cortex. J. Neurosci. 35, 170–178 (2015).
Yu, B.M. et al. Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity. J. Neurophysiol. 102, 614–635 (2009).
Litwin-Kumar, A. & Doiron, B. Slow dynamics and high variability in balanced cortical networks with clustered connections. Nat. Neurosci. 15, 1498–1505 (2012).
Chelaru, M.I. & Dragoi, V. Negative correlations in visual cortical networks. Cereb. Cortex 26, 246–256 (2016).
Bosking, W.H., Zhang, Y., Schofield, B. & Fitzpatrick, D. Orientation selectivity and the arrangement of horizontal connections in tree shrew striate cortex. J. Neurosci. 17, 2112–2127 (1997).
Pfeffer, C.K., Xue, M., He, M., Huang, Z.J. & Scanziani, M. Inhibition of inhibition in visual cortex: the logic of connections between molecularly distinct interneurons. Nat. Neurosci. 16, 1068–1076 (2013).
Kriener, B., Helias, M., Rotter, S., Diesmann, M. & Einevoll, G.T. How pattern formation in ring networks of excitatory and inhibitory spiking neurons depends on the input current regime. Front. Comput. Neurosci. 7, 187 (2014).
Rikhye, R.V. & Sur, M. Spatial correlations in natural scenes modulate response reliability in mouse visual cortex. J. Neurosci. 35, 14661–14680 (2015).
Tan, A.Y., Chen, Y., Scholl, B., Seidemann, E. & Priebe, N.J. Sensory stimulation shifts visual cortex from synchronous to asynchronous states. Nature 509, 226–229 (2014).
Kelly, R.C. et al. Comparison of recordings from microelectrode arrays and single electrodes in the visual cortex. J. Neurosci. 27, 261–264 (2007).
De Valois, R.L., Albrecht, D.G. & Thorell, L.G. Spatial frequency selectivity of cells in macaque visual cortex. Vision Res. 22, 545–559 (1982).
Acknowledgements
We are grateful to T.S. Lee and A. Movshon for research support. This work was supported by National Science Foundation grants NSF-DMS-1517828 (R.R.), NSF-DMS-1313225 (B.D.), NSF-DMS-1517082 (B.D.), NSF-DMS-1612913 (J.E.R.), NSF-DMS-1516288 (J.E.R.) and NSF-DMS-1312508 (J.E.R.); National Institute of Health grants R01NS070865 (B.D., J.E.R.), CRCNS-R01DC015139 (B.D.), R01EY016774 (A.K.), R01EY022928 (M.A.S.) and P30EY008098 (M.A.S.); two grants from the Simons Foundation collaboration on the global brain (SCGB#325293MC;BD, B.D. and 364994AK, A.K.); by the Eye and Ear Foundation of Pittsburgh (M.A.S.); and by Research to Prevent Blindness (A.K., M.A.S.).
Author information
Authors and Affiliations
Contributions
R.R. and B.D. conceived the project; R.R. performed the simulations, data analysis and mathematical calculations; M.A.S. and A.K. provided the experimental data. J.E.R. and B.D. supervised the project. All authors contributed to writing the manuscript.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Integrated supplementary information
Supplementary Figure 1 Fitting f-I curves of neurons from simulations.
a) Firing rate as a function of time-averaged total synaptic input from the simulation in Figure 4. Blue dots are from 400 randomly selected excitatory neurons, the black curve is the best fit thresholded quadratic and the red dot is placed at the population-average firing rates, at which the gain can be computed as the derivative of the black curve. b) Same as (a), but for inhibitory neurons.
Supplementary Figure 2 Correlation as a function of distance for various connection probability profiles.
a) Bottom: Connection probability from feedforward layer (black) and connection probability within the recurrent layer (purple) as a function of neuron distance. Each curve is normalized by its peak. Top: Mean spike count correlation between excitatory neurons as a function of neuron distance from simulations (black) and from the theoretical calculation using Eq. (S.49) (red). b-h) Same as (a) except in (e) where recurrent excitatory (blue) and inhibitory (red) connection probabilities have different profiles.
Supplementary Figure 3 Dependence of cross-spectra on Fourier mode.
a) The cross-spectrum, <Se,Se>(n), between excitatory neurons as a function of the magnitude of the spatial Fourier mode, |n|, computed using Eq. (S.49) with parameters from the example in Figure 4. The curve is normalized by its peak. b) The approximation, h(n), to the cross-spectrum computed using Eq. (S.53) and plotted as a function of spatial Fourier mode, |n|, with parameters from the simulation in Figure 4.
Supplementary Figure 4 Spike count correlations, firing rates, and input currents at increasing network size.
a) Average excitatory (bottom) and inhibitory (top) firing rates from simulations with increasing numbers of neurons (solid curves) and from from the theoretical predictions in Eqs. (S.5) (dotted gray lines). Blue (red) curves are for simulations identical to the one in Figure 3 (Figure 4), except that the number of neurons was varied, with connection probability held fixed, and simulation time was increased from 22 s to 42 s. b) Average excitatory (top), inhibitory (bottom) and total (middle) synaptic input current to 200 randomly sampled excitatory neurons from the simulations in (a). Synaptic input currents were normalized by capacitance and are therefore reported in units V/s. c) Mean spike count correlation between neuron pairs whose distance is between 0 and 0.1 (purple); between pairs with distance between 0.2 and 0.3 (green); and between pairs chosen randomly at all distances (black). Computed for simulations from the blue curves in (a). d) Same as (c), but on a log-log scale. Dashed lines are best fit lines of slope -1. e,f) Same as (c,d), but for the simulations from the red curves in (a,b).
Supplementary Figure 5 Further statistical analysis of correlations in macaque V1.
a,b) Same as Figures 5b and 7b respectively, but distances are binned more finely. Correlations decreased from the first to the second bin, from the first to the third bin and from the second to the third bin (all three with p<10^−5; one-sided unpaired t-test). Correlations increased from the fifth to the seventh bin (p=0.008; one-sided un- paired t-test; t-value=2.4; df=1,704). The increase of correlations over the last three bins is significant under a Bonferroni correction for multiple comparisons over the last three bins (corrected p-value = 0.024). The apparent increase in correlation from the third to fourth bin is not significant (p=0.18; one-sided unpaired t-test; t-value=0.9; df=2,249). Distances 3.5-5mm are not shown since there were few such pairs and distances 5+mm are not shown because the precise distances for such pairs are not known, so they cannot be resolved into 0.5 mm bins (see Experimental Procedures and Figure 7b). Including these data does not alter significance (p-values remain <0.025). c) Histogram of all residual correlations. d,e,f) Solid black curves are the same as Figures 5b, 5c and 7b respectively, except we only included data from the two recording sessions in which linear electrodes were present. The increase from the third to the fifth bin was still significant when only including data from these two recording sessions (p=10^−4; one-sided, unpaired t-test; t-value=3.7; df=1,064). The dashed gray curves are the same as Figures 5b, 5c and 7b respectively.
Supplementary Figure 6 Correlations as a function of tuning similarity.
a) Mean spike count correlation and b) residual correlation between putative L2/3 neurons in macaque primary cortex as a function of tuning similarity. Same as Figures 5b and 7b respectively, but correlations are partitioned by tuning similarity instead of distance. c,d) Same as (a,b), but from a computational model where αffwd = 20 degrees and for different values of αrec (see legend). e) Residual correlation as a function of the difference between preferred orientations in the model. All plots show mean +/- SEM. The non-monotonicity in (b) is not significant (p = 0.051; one-sided unpaired t-test between first and third bins; t-value=1.6; df=872).
Supplementary information
Supplementary Text and Figures
Supplementary Figures 1–6 and Supplementary Notes 1–5 (PDF 2373 kb)
Rights and permissions
About this article
Cite this article
Rosenbaum, R., Smith, M., Kohn, A. et al. The spatial structure of correlated neuronal variability. Nat Neurosci 20, 107–114 (2017). https://doi.org/10.1038/nn.4433
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nn.4433
This article is cited by
-
Response sub-additivity and variability quenching in visual cortex
Nature Reviews Neuroscience (2024)
-
Distributing task-related neural activity across a cortical network through task-independent connections
Nature Communications (2023)
-
Uncovering hidden network architecture from spiking activities using an exact statistical input-output relation of neurons
Communications Biology (2023)
-
Residual dynamics resolves recurrent contributions to neural computation
Nature Neuroscience (2023)
-
Gradient-based learning drives robust representations in recurrent neural networks by balancing compression and expansion
Nature Machine Intelligence (2022)