Linear readout of object manifolds.

Objects are represented in sensory systems by continuous manifolds due to sensitivity of neuronal responses to changes in physical features such as location, orientation, and intensity. What makes certain sensory representations better suited for invariant decoding of objects by downstream networks? We present a theory that characterizes the ability of a linear readout network, the perceptron, to classify objects from variable neural responses. We show how the readout perceptron capacity depends on the dimensionality, size, and shape of the object manifolds in its input neural representation.

[1]  Sompolinsky,et al.  Learning from examples in large neural networks. , 1990, Physical review letters.

[2]  Christian Van den Broeck,et al.  Statistical Mechanics of Learning , 2001 .

[3]  E. Gardner.  The space of interactions in neural network models , 1988 .

[4]  Nancy Kanwisher,et al.  The distribution of category and location information across object-selective regions in human visual cortex , 2008, Proceedings of the National Academy of Sciences.

[5]  H E M.  Journal of Neurophysiology , 1938, Nature.

[6]  S. Ganguli,et al.  Statistical mechanics of complex neural systems and high dimensional data , 2013, 1301.7115.

[7]  Davide Zoccolan,et al.  Multifeatural Shape Processing in Rats Engaged in Invariant Visual Object Recognition , 2013, The Journal of Neuroscience.

[8]  Y. Cohen,et al.  The what, where and how of auditory-object perception , 2013, Nature Reviews Neuroscience.

[9]  E. Gardner,et al.  Maximum Storage Capacity in Neural Networks , 1987 .

[10]  David D. Cox,et al.  Untangling invariant object recognition , 2007, Trends in Cognitive Sciences.

[11]  Miao‐kun Sun,et al.  Trends in cognitive sciences , 2012 .

[12]  O. Bagasra,et al.  Proceedings of the National Academy of Sciences , 1914, Science.

[13]  A. Sayed,et al.  Foundations and Trends ® in Machine Learning > Vol 7 > Issue 4-5 Ordering Info About Us Alerts Contact Help Log in Adaptation , Learning , and Optimization over Networks , 2011 .

[14]  Doris Y. Tsao,et al.  Functional Compartmentalization and Viewpoint Generalization Within the Macaque Face-Processing System , 2010, Science.

[15]  Rémi Monasson,et al.  Properties of neural networks storing spatially correlated patterns , 1992 .

[16]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[17]  Daniel L. K. Yamins,et al.  Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition , 2014, PLoS Comput. Biol..

[18]  M. Opper,et al.  Storage of correlated patterns in a perceptron , 1995 .

[19]  J. Gottfried.  Central mechanisms of odour object perception , 2010, Nature Reviews Neuroscience.

[20]  Rémi Monasson,et al.  Theory of spike timing-based neural classifiers. , 2010, Physical review letters.

[21]  J. Nadal,et al.  Optimal Information Storage and the Distribution of Synaptic Weights Perceptron versus Purkinje Cell , 2004, Neuron.

[22]  Thomas B. Kepler,et al.  Universality in the space of interactions for network models , 1989 .

[23]  Nicole C. Rust,et al.  Signals in inferotemporal and perirhinal cortex suggest an “untangling” of visual target information , 2013, Nature Neuroscience.

[24]  Alan Murray,et al.  Advances in Neural Information Processing Systems 2003 , 2003 .

[25]  L. Christophorou.  Science , 2018, Emerging Dynamics: Science, Energy, Society and Values.

[26]  Nicole C. Rust,et al.  Selectivity and Tolerance (“Invariance”) Both Increase as Visual Information Propagates from Cortical Area V4 to IT , 2010, The Journal of Neuroscience.

[27]  R. K. Simpson.  Nature Neuroscience , 2022 .

[28]  J. Herskowitz,et al.  Proceedings of the National Academy of Sciences, USA , 1996, Current Biology.

[29]  IEEE conference on computer vision and pattern recognition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[30]  Hendrik B. Geyer,et al.  Journal of Physics A - Mathematical and General, Special Issue. SI Aug 11 2006 ?? Preface , 2006 .

[31]  D. Saad.  Europhysics Letters , 1997 .

[32]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[33]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[34]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[35]  October I.  Physical Review Letters , 2022 .

[36]  Doris Y. Tsao,et al.  Intelligent Information Loss: The Coding of Facial Identity, Head Pose, and Non-Face Information in the Macaque Face Patch System , 2015, The Journal of Neuroscience.

[37]  D. Amit,et al.  Perceptron learning with sign-constrained weights , 1989 .

[38]  F. Frances Yao,et al.  Computational Geometry , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.