A theory of multineuronal dimensionality, dynamics and measurement

In many experiments, neuroscientists tightly control behavior, record many trials, and obtain trial-averaged firing rates from hundreds of neurons in circuits containing billions of behaviorally relevant neurons. Di-mensionality reduction methods reveal a striking simplicity underlying such multi-neuronal data: they can be reduced to a low-dimensional space, and the resulting neural trajectories in this space yield a remarkably insightful dynamical portrait of circuit computation. This simplicity raises profound and timely conceptual questions. What are its origins and its implications for the complexity of neural dynamics? How would the situation change if we recorded more neurons? When, if at all, can we trust dynamical portraits obtained from measuring an infinitesimal fraction of task relevant neurons? We present a theory that answers these questions, and test it using physiological recordings from reaching monkeys. This theory reveals conceptual insights into how task complexity governs both neural dimensionality and accurate recovery of dynamic portraits, thereby providing quantitative guidelines for future large-scale experimental design.

[1]  Alexander Brudnyi,et al.  Extensions of Lipschitz Maps , 2012 .

[2]  Kenneth L. Clarkson,et al.  Tighter bounds for random projections of manifolds , 2008, SCG '08.

[3]  S. Yamane,et al.  Population dynamics of face-responsive neurons in the inferior temporal cortex. , 2005, Cerebral cortex.

[4]  M. Khamassi,et al.  Replay of rule-learning related neural patterns in the prefrontal cortex during sleep , 2009, Nature Neuroscience.

[5]  M. Laubach,et al.  Delay activity in rodent frontal cortex during a simple reaction time task. , 2009, Journal of neurophysiology.

[6]  L. Abbott,et al.  Transferring Learning from External to Internal Weights in Echo-State Networks with Sparse Connectivity , 2012, PloS one.

[7]  Sanjoy Dasgupta,et al.  An elementary proof of a theorem of Johnson and Lindenstrauss , 2003, Random Struct. Algorithms.

[8]  J. Hegdé,et al.  Temporal dynamics of shape analysis in macaque visual area V2. , 2004, Journal of neurophysiology.

[9]  Baranidharan Raman,et al.  Temporally Diverse Firing Patterns in Olfactory Receptor Neurons Underlie Spatiotemporal Neural Codes for Odors , 2010, The Journal of Neuroscience.

[10]  G. Shepherd The Synaptic Organization of the Brain , 1979 .

[11]  Surya Ganguli,et al.  Memory traces in dynamical systems , 2008, Proceedings of the National Academy of Sciences.

[12]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[13]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[14]  Kenneth Ward Church,et al.  Very sparse random projections , 2006, KDD '06.

[15]  W. B. Johnson,et al.  Extensions of Lipschitz mappings into Hilbert space , 1984 .

[16]  Matthew T. Kaufman,et al.  A category-free neural population supports evolving demands during decision-making , 2014, Nature Neuroscience.

[17]  Leslie G. Valiant,et al.  Memorization and Association on a Realistic Neural Model , 2005, Neural Computation.

[18]  M. Nicolelis,et al.  Principal component analysis of neuronal ensemble activity reveals multidimensional somatosensory representations , 1999, Journal of Neuroscience Methods.

[19]  Surya Ganguli,et al.  On simplicity and complexity in the brave new world of large-scale neuroscience , 2015, Current Opinion in Neurobiology.

[20]  Surya Ganguli,et al.  Behavioral/systems/cognitive Spatial Information Outflow from the Hippocampal Circuit: Distributed Spatial Coding and Phase Precession in the Subiculum , 2022 .

[21]  Kevin L. Briggman,et al.  From crawling to cognition: analyzing the dynamical interactions among populations of neurons , 2006, Current Opinion in Neurobiology.

[22]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[23]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.

[24]  B. Nadler,et al.  Global Features of Neural Activity in the Olfactory System Form a Parallel Code That Predicts Olfactory Behavior and Perception , 2010, The Journal of Neuroscience.

[25]  Conformal Rigidity ELEMENTARY PROOF OF A THEOREM ON , 2016 .

[26]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[27]  Byron M. Yu,et al.  Mixture of Trajectory Models for Neural Decoding of Goal-directed Movements a Computational Model of Craving and Obsession Decoding Visual Inputs from Multiple Neurons in the Human Temporal Lobe Encoding Contribution of Individual Retinal Ganglion Cell Responses to Velocity and Acceleration , 2008 .

[28]  Alan Carleton,et al.  Dynamic Ensemble Odor Coding in the Mammalian Olfactory Bulb: Sensory Information at Different Timescales , 2008, Neuron.

[29]  Robert M. Gray,et al.  On the asymptotic eigenvalue distribution of Toeplitz matrices , 1972, IEEE Trans. Inf. Theory.

[30]  Dimitris Achlioptas,et al.  Database-friendly random projections: Johnson-Lindenstrauss with binary coins , 2003, J. Comput. Syst. Sci..

[31]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[32]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[33]  G. Laurent,et al.  Transient Dynamics versus Fixed Points in Odor Representations by Locust Antennal Lobe Projection Neurons , 2005, Neuron.

[34]  Hagai Bergman,et al.  Emerging Patterns of Neuronal Responses in Supplementary and Primary Motor Areas during Sensorimotor Adaptation , 2005, The Journal of Neuroscience.

[35]  Byron M. Yu,et al.  Neural constraints on learning , 2014, Nature.

[36]  G. Laurent,et al.  Adaptive regulation of sparseness by feedforward inhibition , 2007, Nature Neuroscience.

[37]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[38]  E. Miller,et al.  Task-Dependent Changes in Short-Term Memory in the Prefrontal Cortex , 2010, The Journal of Neuroscience.

[39]  K. Miller,et al.  One-Dimensional Dynamics of Attention and Decision Making in LIP , 2008, Neuron.

[40]  Henryk Iwaniec The distribution of eigenvalues , 2002 .

[41]  V. Marčenko,et al.  DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES , 1967 .

[42]  Byron M. Yu,et al.  Dimensionality reduction for large-scale neural recordings , 2014, Nature Neuroscience.

[43]  Christian K. Machens,et al.  Behavioral / Systems / Cognitive Functional , But Not Anatomical , Separation of “ What ” and “ When ” in Prefrontal Cortex , 2009 .

[44]  Konrad P Kording,et al.  How advances in neural recording affect data analysis , 2011, Nature Neuroscience.

[45]  N. Matsuki,et al.  Metastability of Active CA3 Networks , 2007, The Journal of Neuroscience.

[46]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[47]  N. Thacker,et al.  The Effects of a Square Root Transform on a Poisson Distributed Quantity , 2009 .

[48]  V. Jayaraman,et al.  Intensity versus Identity Coding in an Olfactory System , 2003, Neuron.

[49]  Richard G. Baraniuk,et al.  Random Projections of Smooth Manifolds , 2009, Found. Comput. Math..

[50]  Kae Nakamura,et al.  Coding of Task Reward Value in the Dorsal Raphe Nucleus , 2010, The Journal of Neuroscience.