Improved Estimation and Interpretation of Correlations in Neural Circuits

Ambitious projects aim to record the activity of ever larger and denser neuronal populations in vivo. Correlations in neural activity measured in such recordings can reveal important aspects of neural circuit organization. However, estimating and interpreting large correlation matrices is statistically challenging. Estimation can be improved by regularization, i.e. by imposing a structure on the estimate. The amount of improvement depends on how closely the assumed structure represents dependencies in the data. Therefore, the selection of the most efficient correlation matrix estimator for a given neural circuit must be determined empirically. Importantly, the identity and structure of the most efficient estimator informs about the types of dominant dependencies governing the system. We sought statistically efficient estimators of neural correlation matrices in recordings from large, dense groups of cortical neurons. Using fast 3D random-access laser scanning microscopy of calcium signals, we recorded the activity of nearly every neuron in volumes 200 μm wide and 100 μm deep (150–350 cells) in mouse visual cortex. We hypothesized that in these densely sampled recordings, the correlation matrix should be best modeled as the combination of a sparse graph of pairwise partial correlations representing local interactions and a low-rank component representing common fluctuations and external inputs. Indeed, in cross-validation tests, the covariance matrix estimator with this structure consistently outperformed other regularized estimators. The sparse component of the estimate defined a graph of interactions. These interactions reflected the physical distances and orientation tuning properties of cells: The density of positive ‘excitatory’ interactions decreased rapidly with geometric distances and with differences in orientation preference whereas negative ‘inhibitory’ interactions were less selective. Because of its superior performance, this ‘sparse+latent’ estimator likely provides a more physiologically relevant representation of the functional connectivity in densely sampled recordings than the sample correlation matrix.

[1]  Alexander J. Sadovsky,et al.  Mouse Visual Neocortex Supports Multiple Stereotyped Patterns of Microcircuit Activity , 2014, The Journal of Neuroscience.

[2]  J. Tiago Gonçalves,et al.  Internally Mediated Developmental Desynchronization of Neocortical Network Activity , 2009, The Journal of Neuroscience.

[3]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[4]  David Pfau,et al.  Robust learning of low-dimensional dynamics from large neural ensembles , 2013, NIPS.

[5]  Adriano B. L. Tort,et al.  Neuronal Assembly Detection and Cell Membership Specification by Principal Component Analysis , 2011, PloS one.

[6]  G. Varoquaux,et al.  Markov models for fMRI correlation structure: Is brain functional connectivity small world, or decomposable into networks? , 2012, Journal of Physiology-Paris.

[7]  Shiqian Ma,et al.  Alternating Direction Methods for Latent Variable Gaussian Graphical Model Selection , 2012, Neural Computation.

[8]  Balázs Rózsa,et al.  Fast two-photon in vivo imaging with three-dimensional random-access scanning in large tissue volumes , 2012, Nature Methods.

[9]  G. Silberberg,et al.  Neural progenitors organize in small-world networks to promote cell proliferation , 2013, Proceedings of the National Academy of Sciences.

[10]  B. Efron,et al.  Stein's Paradox in Statistics , 1977 .

[11]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[12]  George H. Denfield,et al.  Pupil Fluctuations Track Fast Switching of Cortical States during Quiet Wakefulness , 2014, Neuron.

[13]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[14]  J. Alonso,et al.  Functional connectivity between simple cells and complex cells in cat striate cortex , 1998, Nature Neuroscience.

[15]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[16]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[17]  Adam Kohn,et al.  Laminar dependence of neuronal correlations in visual cortex. , 2013, Journal of neurophysiology.

[18]  Anne-Marie M Oswald,et al.  Maturation of intrinsic and synaptic properties of layer 2/3 pyramidal neurons in mouse auditory cortex. , 2008, Journal of neurophysiology.

[19]  Diego Contreras,et al.  The structure of pairwise correlation in mouse primary visual cortex reveals functional organization in the absence of an orientation map. , 2014, Cerebral cortex.

[20]  M. Scanziani,et al.  How Inhibition Shapes Cortical Activity , 2011, Neuron.

[21]  G. Orban,et al.  The response variability of striate cortical neurons in the behaving monkey , 2004, Experimental Brain Research.

[22]  G. P. Moore,et al.  Statistical signs of synaptic interaction in neurons. , 1970, Biophysical journal.

[23]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[24]  Valentin Dragoi,et al.  Correlated Variability in Laminar Cortical Circuits , 2012, Neuron.

[25]  Pei Wang,et al.  Partial Correlation Estimation by Joint Sparse Regression Models , 2008, Journal of the American Statistical Association.

[26]  Marc A Sommer,et al.  Spatial and Temporal Scales of Neuronal Correlation in Visual Area V4 , 2013, The Journal of Neuroscience.

[27]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[28]  W. A. Clark,et al.  Simultaneous Studies of Firing Patterns in Several Neurons , 1964, Science.

[29]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Alexander S. Ecker,et al.  Reassessing optimal neural population codes with neurometric functions , 2011, Proceedings of the National Academy of Sciences.

[31]  Jessika Weiss,et al.  Graphical Models In Applied Multivariate Statistics , 2016 .

[32]  C. Gray,et al.  Higher Order Correlations within Cortical Layers Dominate Functional Connectivity in Microcolumns , 2012, 1301.0050.

[33]  R. Shibata,et al.  PARTIAL CORRELATION AND CONDITIONAL CORRELATION AS MEASURES OF CONDITIONAL INDEPENDENCE , 2004 .

[34]  R. Yuste,et al.  Dense, Unspecific Connectivity of Neocortical Parvalbumin-Positive Interneurons: A Canonical Microcircuit for Inhibition? , 2011, The Journal of Neuroscience.

[35]  A. Reyes,et al.  Spatial Profile of Excitatory and Inhibitory Synaptic Connectivity in Mouse Primary Auditory Cortex , 2012, The Journal of Neuroscience.

[36]  Michael J. Goard,et al.  Basal Forebrain Activation Enhances Cortical Coding of Natural Scenes , 2009, Nature Neuroscience.

[37]  A. Aertsen,et al.  Neuronal assemblies , 1989, IEEE Transactions on Biomedical Engineering.

[38]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[39]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[40]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[41]  N. Meinshausen,et al.  High-dimensional graphs and variable selection with the Lasso , 2006, math/0608017.

[42]  R. Segev,et al.  Sparse low-order interaction network underlies a highly correlated and learnable neural population code , 2011, Proceedings of the National Academy of Sciences.

[43]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[44]  Michael Weliky,et al.  Relationship of Correlated Spontaneous Activity to Functional Ocular Dominance Columns in the Developing Visual Cortex , 2002, Neuron.

[45]  Gustavo Deco,et al.  Stimulus-dependent variability and noise correlations in cortical MT neurons , 2013, Proceedings of the National Academy of Sciences.

[46]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[47]  Mehdi Khamassi,et al.  Principal component analysis of ensemble recordings reveals cell assemblies at high temporal resolution , 2009, Journal of Computational Neuroscience.

[48]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[49]  M. Carandini,et al.  Population Rate Dynamics and Multineuron Firing Patterns in Sensory Cortex , 2012, The Journal of Neuroscience.

[50]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[51]  Pablo A. Parrilo,et al.  Latent variable graphical model selection via convex optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[52]  S. Geer,et al.  Regularization in statistics , 2006 .

[53]  Alexander S. Ecker,et al.  The Effect of Noise Correlations in Populations of Diversely Tuned Neurons , 2011, The Journal of Neuroscience.

[54]  M. A. Smith,et al.  Correlations and brain states: from electrophysiology to functional imaging , 2009, Current Opinion in Neurobiology.

[55]  M. Stryker,et al.  A Cortical Circuit for Gain Control by Behavioral State , 2014, Cell.

[56]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[57]  I. Nelken,et al.  Functional organization and population dynamics in the mouse primary auditory cortex , 2010, Nature Neuroscience.

[58]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[59]  M. Nicolelis,et al.  Principal component analysis of neuronal ensemble activity reveals multidimensional somatosensory representations , 1999, Journal of Neuroscience Methods.

[60]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[61]  H. Adesnik,et al.  Lateral competition for cortical space by layer-specific horizontal circuits , 2010, Nature.

[62]  J. Friedman Regularized Discriminant Analysis , 1989 .

[63]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[64]  Eric Shea-Brown,et al.  Stimulus-Dependent Correlations and Population Codes , 2008, Neural Computation.

[65]  M. A. Smith,et al.  Stimulus Dependence of Neuronal Correlation in Primary Visual Cortex of the Macaque , 2005, The Journal of Neuroscience.

[66]  R. Reid,et al.  Cellular Imaging of Visual Cortex Reveals the Spatial and Functional Organization of Spontaneous Activity , 2010, Front. Integr. Neurosci..

[67]  Matthias Bethge,et al.  Supervised learning sets benchmark for robust spike detection from calcium imaging signals , 2015 .

[68]  W. Newsome,et al.  Context-Dependent Changes in Functional Circuitry in Visual Area MT , 2008, Neuron.

[69]  Haim Sompolinsky,et al.  Erratum: Population coding in neuronal systems with correlated noise [Phys. Rev. E 64, 051904 (2001)] , 2002 .

[70]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[71]  Kaustubh Supekar,et al.  Estimation of functional connectivity in fMRI data using stability selection-based sparse partial correlation with elastic net penalty , 2012, NeuroImage.

[72]  A Grinvald,et al.  Coherent spatiotemporal patterns of ongoing activity revealed by real-time optical imaging coupled with single-unit recording in the cat visual cortex. , 1995, Journal of neurophysiology.

[73]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[74]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[75]  Philipp J. Keller,et al.  Whole-brain functional imaging at cellular resolution using light-sheet microscopy , 2013, Nature Methods.

[76]  Peter E. Latham,et al.  Pairwise Maximum Entropy Models for Studying Large Biological Systems: When They Can Work and When They Can't , 2008, PLoS Comput. Biol..

[77]  D. Fitzpatrick,et al.  Three-dimensional mapping of microcircuit correlation structure , 2013, Front. Neural Circuits.

[78]  Matthias Bethge,et al.  Supervised learning sets benchmark for robust spike rate inference from calcium imaging signals , 2015, bioRxiv.

[79]  Michael J. Berry,et al.  Searching for Collective Behavior in a Large Network of Sensory Neurons , 2013, PLoS Comput. Biol..

[80]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[81]  J. Schmee An Introduction to Multivariate Statistical Analysis , 1986 .

[82]  Shan Yu,et al.  A Small World of Neuronal Synchrony , 2008, Cerebral cortex.

[83]  Wei Ji Ma,et al.  A Fast and Simple Population Code for Orientation in Primate V1 , 2012, The Journal of Neuroscience.

[84]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[85]  Vítor Lopes-dos-Santos,et al.  Detecting cell assemblies in large neuronal populations , 2013, Journal of Neuroscience Methods.

[86]  David S. Greenberg,et al.  Population imaging of ongoing neuronal activity in the visual cortex of awake rats , 2008, Nature Neuroscience.

[87]  Yong Gu,et al.  Perceptual Learning Reduces Interneuronal Correlations in Macaque Visual Cortex , 2011, Neuron.

[88]  P. Saggau,et al.  Fast three-dimensional laser scanning scheme using acousto-optic deflectors. , 2005, Journal of biomedical optics.

[89]  Olivier Ledoit,et al.  Improved estimation of the covariance matrix of stock returns with an application to portfolio selection , 2003 .

[90]  Edward T. Bullmore,et al.  On the use of correlation as a measure of network connectivity , 2012, NeuroImage.

[91]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[92]  K. Strimmer,et al.  Statistical Applications in Genetics and Molecular Biology A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics , 2011 .

[93]  Robert Rosenbaum,et al.  Mechanisms That Modulate the Transfer of Spiking Correlations , 2011, Neural Computation.

[94]  Benjamin F. Grewe,et al.  High-speed in vivo calcium imaging reveals neuronal network activity with near-millisecond precision , 2010, Nature Methods.

[95]  Rafael Yuste,et al.  Fast nonnegative deconvolution for spike train inference from population calcium imaging. , 2009, Journal of neurophysiology.

[96]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[97]  John Hertz,et al.  Ising Models for Inferring Network Structure From Spike Data , 2011, 1106.1752.

[98]  Philippe Mourrain,et al.  Imaging zebrafish neural circuitry from whole brain to synapse , 2013, Front. Neural Circuits.

[99]  Michael J. Berry,et al.  Ising models for networks of real neurons , 2006, q-bio/0611072.

[100]  C. Clopath,et al.  The emergence of functional microcircuits in visual cortex , 2013, Nature.

[101]  Paul S. Weiss,et al.  The Brain Activity Map , 2013, Science.

[102]  Brain activity. , 2014, Nature nanotechnology.

[103]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[104]  Rosa Cossart,et al.  Dissecting functional connectivity of neuronal microcircuits: experimental and theoretical insights , 2011, Trends in Neurosciences.

[105]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[106]  Hongkui Zeng,et al.  Differential tuning and population dynamics of excitatory and inhibitory neurons reflect differences in local intracortical connectivity , 2011, Nature Neuroscience.

[107]  Jonathon Shlens,et al.  The Structure of Large-Scale Synchronized Firing in Primate Retina , 2009, The Journal of Neuroscience.

[108]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.