What is the other 85 % of V 1 doing ?

This article will pose the following challenge: that despite four decades of research characterizing the response properties of V1 neurons, we still do not have a decent picture of how V1 really operates—i.e., how a population of its neurons represents natural scenes under realistic viewing conditions. We identify five problems with the current view that stem largely from biases in the design and execution of experiments, in addition to the contributions of non-linearities in the cortex that are not well understood. Our purpose is to open the window to new theories, a number of which we describe along with some proposals for testing them.

[1]  I. G. Priest.  The Optical Society of America , 1962, Nature.

[2]  Nikolaas Tinbergen,et al.  The Animal in Its World (Explorations of an Ethologist, 1932-1972), Volume I: Field Studies , 1972 .

[3]  T. Wiesel,et al.  Morphology and intracortical projections of functionally characterised neurones in the cat visual cortex , 1979, Nature.

[4]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[5]  J. Lund,et al.  Intrinsic laminar lattice connections in primate visual cortex , 1983, The Journal of comparative neurology.

[6]  G. Lynch,et al.  Dentate granule cells in the rat hippocampal formation have the behavioral characteristics of theta neurons , 1983, Brain Research.

[7]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[8]  C. Legéndy,et al.  Bursts and recurrences of bursts in the spike trains of spontaneously active striate cortex neurons. , 1985, Journal of neurophysiology.

[9]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[10]  A. Parker,et al.  Two-dimensional spatial structure of receptive fields in monkey striate cortex. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[11]  P. Best,et al.  Place cells and silent cells in the hippocampus of freely-behaving rats , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[15]  A. B. Bonds,et al.  Classifying simple and complex cells on the basis of response modulation , 1991, Vision Research.

[16]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[17]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[18]  B. McNaughton,et al.  Spatial selectivity of unit activity in the hippocampal granular layer , 1993, Hippocampus.

[19]  A. Grinvald,et al.  Relationship between intrinsic connections and functional architecture revealed by optical imaging and in vivo targeted biocytin injections in primate striate cortex. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[20]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[21]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  A. Peters,et al.  Numerical relationships between geniculocortical afferents and pyramidal cell modules in cat primary visual cortex. , 1993, Cerebral cortex.

[23]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  J. Budd,et al.  A numerical analysis of the geniculocortical input to striate cortex in the monkey. , 1994, Cerebral cortex.

[25]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[26]  J. C. Anderson,et al.  Polyneuronal innervation of spiny stellate neurons in cat visual cortex , 1994, The Journal of comparative neurology.

[27]  S Ullman,et al.  Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex. , 1995, Cerebral cortex.

[28]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[29]  Bruno A. Olshausen,et al.  A Model of the Spatial-Frequency Organization in Primate Striate Cortex , 1995 .

[30]  Victor A. F. Lamme.  The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Shinsuke Shimojo,et al.  Visual surface representation: a critical link between lower-level and higher level vision , 1995 .

[32]  David Mumford,et al.  Neuronal Architectures for Pattern-theoretic Problems , 1995 .

[33]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[34]  Terrence J. Sejnowski,et al.  Bayesian Unsupervised Learning of Higher Order Structure , 1996, NIPS.

[35]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[36]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[37]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[38]  M. Stryker,et al.  The Role of Activity in the Development of Long-Range Horizontal Connections in Area 17 of the Ferret , 1996, The Journal of Neuroscience.

[39]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[40]  J. B. Levitt,et al.  Relation between patterns of intrinsic lateral connectivity, ocular dominance, and cytochrome oxidase-reactive regions in macaque monkey striate cortex. , 1996, Cerebral cortex.

[41]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[42]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[43]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[44]  M. Gur,et al.  Visual Receptive Fields of Neurons in Primary Visual Cortex (V1) Move in Space with the Eye Movements of Fixation , 1997, Vision Research.

[45]  D. V. van Essen,et al.  Spatial Attention Effects in Macaque Area V4 , 1997, The Journal of Neuroscience.

[46]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[47]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[48]  Nicolas J. Kerscher,et al.  State-dependent receptive-field restructuring in the visual cortex , 1998, Nature.

[49]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[50]  D. Ferster,et al.  Strength and Orientation Tuning of the Thalamic Input to Simple Cells Revealed by Electrically Evoked Cortical Suppression , 1998, Neuron.

[51]  U. Polat,et al.  Collinear stimuli regulate visual responses depending on cell's contrast threshold , 1998, Nature.

[52]  D. Mumford,et al.  The role of the primary visual cortex in higher level vision , 1998, Vision Research.

[53]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[54]  M. Tarr.  News On Views: Pandemonium Revisited , 1999, Nature Neuroscience.

[55]  Gerhard Krieger,et al.  The atoms of vision: Cartesian or polar? , 1999 .

[56]  M. Young,et al.  The architecture of visual cortex and inferential processes in vision. , 2000, Spatial vision.

[57]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[58]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[59]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[60]  C. Gilbert,et al.  Spatial distribution of contextual interactions in primary visual cortex and in visual perception. , 2000, Journal of neurophysiology.

[61]  J. Bakin,et al.  Visual Responses in Monkey Areas V1 and V2 to Three-Dimensional Surface Configurations , 2000, The Journal of Neuroscience.

[62]  C. Gray,et al.  Dynamic spike threshold reveals a mechanism for synaptic coincidence detection in cortical neurons in vivo. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Christopher C. Pack,et al.  Dynamic properties of neurons in cortical area MT in alert and anaesthetized macaque monkeys , 2001, Nature.

[64]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[65]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[66]  C. Zetzsche,et al.  Nonlinear and extra-classical receptive field properties and the statistics of natural scenes , 2001, Network.

[67]  Lawrence C. Sincich,et al.  Oriented Axon Projections in Primary Visual Cortex of the Monkey , 2001, The Journal of Neuroscience.

[68]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[69]  Rajesh P. N. Rao,et al.  A Bilinear Model for Sparse Coding , 2002, NIPS.

[70]  D. Snodderly,et al.  Spatial organization of receptive fields of V1 neurons of alert monkeys: comparison with responses to gratings. , 2002, Journal of neurophysiology.

[71]  Robert Shapley,et al.  Receptive field structure of neurons in monkey primary visual cortex revealed by stimulation with natural image sequences. , 2002, Journal of vision.

[72]  D. Ringach,et al.  On the classification of simple and complex cells , 2002, Vision Research.

[73]  Paul Schrater,et al.  Shape perception reduces activity in human primary visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[74]  J. Touryan,et al.  Isolation of Relevant Visual Features from Random Stimuli for Cortical Complex Cells , 2002, The Journal of Neuroscience.

[75]  L. Frank,et al.  Single Neurons in the Monkey Hippocampus and Learning of New Associations , 2003, Science.

[76]  Ben Willmore,et al.  The Receptive-Field Organization of Simple Cells in Primary Visual Cortex of Ferrets under Natural Scene Stimulation , 2003, The Journal of Neuroscience.

[77]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[78]  C. Gray,et al.  Adaptive Coincidence Detection and Dynamic Gain Control in Visual Cortical Neurons In Vivo , 2003, Neuron.

[79]  R. Malach,et al.  Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind , 2003, Nature Neuroscience.

[80]  P. Lennie.  The Cost of Cortical Computation , 2003, Current Biology.

[81]  Bruno A. Olshausen,et al.  Principles of Image Representation in Visual Cortex , 2003 .

[82]  P. Lennie.  Receptive fields , 2003, Current Biology.

[83]  Jerry D. Nguyenkim,et al.  Disparity-Based Coding of Three-Dimensional Surface Orientation by Macaque Middle Temporal Neurons , 2003, The Journal of Neuroscience.

[84]  Bartlett W. Mel,et al.  Dendrites: bug or feature? , 2003, Current Opinion in Neurobiology.

[85]  Margaret S Livingstone,et al.  End-Stopping and the Aperture Problem Two-Dimensional Motion Signals in Macaque V1 , 2003, Neuron.

[86]  Josh H. McDermott,et al.  Psychophysics with junctions in real images. , 2010, Perception.

[87]  Eero P. Simoncelli,et al.  Spike-triggered characterization of excitatory and suppressive stimulus dimensions in monkey V1 , 2004, Neurocomputing.

[88]  B. C. Motter,et al.  Dynamic stabilization of receptive fields of cortical neurons (VI) during fixation of gaze in the macaque , 2004, Experimental Brain Research.

[89]  Christian K. Machens,et al.  Linearity of Cortical Receptive Fields Measured with Natural Sounds , 2004, The Journal of Neuroscience.