How Close Are We to Understanding V1?

A wide variety of papers have reviewed what is known about the function of primary visual cortex. In this review, rather than stating what is known, we attempt to estimate how much is still unknown about V1 function. In particular, we identify five problems with the current view of V1 that stem largely from experimental and theoretical biases, in addition to the contributions of nonlinearities in the cortex that are not well understood. Our purpose is to open the door to new theories, a number of which we describe, along with some proposals for testing them.

[1]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[2]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[3]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[4]  N. Graham,et al.  Detection of grating patterns containing two spatial frequencies: a comparison of single-channel and multiple-channels models. , 1971, Vision research.

[5]  Nikolaas Tinbergen,et al.  The Animal in Its World (Explorations of an Ethologist, 1932-1972), Volume I: Field Studies , 1972 .

[6]  T. Wiesel,et al.  Morphology and intracortical projections of functionally characterised neurones in the cat visual cortex , 1979, Nature.

[7]  D. G. Albrecht,et al.  Spatial frequency selectivity of cells in macaque visual cortex , 1982, Vision Research.

[8]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[9]  H. B. Barlow,et al.  What does the eye see best? , 1983, Nature.

[10]  J. Lund,et al.  Intrinsic laminar lattice connections in primate visual cortex , 1983, The Journal of comparative neurology.

[11]  G. Lynch,et al.  Dentate granule cells in the rat hippocampal formation have the behavioral characteristics of theta neurons , 1983, Brain Research.

[12]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[13]  C. Legéndy,et al.  Bursts and recurrences of bursts in the spike trains of spontaneously active striate cortex neurons. , 1985, Journal of neurophysiology.

[14]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[15]  D. Field,et al.  The structure and symmetry of simple-cell receptive-field profiles in the cat’s visual cortex , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[16]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[17]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[18]  A. Parker,et al.  Two-dimensional spatial structure of receptive fields in monkey striate cortex. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[19]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[20]  P. Best,et al.  Place cells and silent cells in the hippocampus of freely-behaving rats , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  Steven W. Zucker,et al.  Trace Inference, Curvature Consistency, and Curve Detection , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[24]  D. Field,et al.  Human discrimination of fractal images. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[25]  A. B. Bonds,et al.  Classifying simple and complex cells on the basis of response modulation , 1991, Vision Research.

[26]  D. Burr,et al.  Two-dimensional spatial and spatial-frequency selectivity of motion-sensitive mechanisms in human vision. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[27]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[28]  D. G. Albrecht,et al.  Cortical neurons: Isolation of contrast gain control , 1992, Vision Research.

[29]  B. McNaughton,et al.  Spatial selectivity of unit activity in the hippocampal granular layer , 1993, Hippocampus.

[30]  A. Grinvald,et al.  Relationship between intrinsic connections and functional architecture revealed by optical imaging and in vivo targeted biocytin injections in primate striate cortex. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[31]  David J. Field,et al.  Contour integration by the human visual system: Evidence for a local “association field” , 1993, Vision Research.

[32]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  A. Peters,et al.  Numerical relationships between geniculocortical afferents and pyramidal cell modules in cat primary visual cortex. , 1993, Cerebral cortex.

[34]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[35]  J. Budd,et al.  A numerical analysis of the geniculocortical input to striate cortex in the monkey. , 1994, Cerebral cortex.

[36]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[37]  J. C. Anderson,et al.  Polyneuronal innervation of spiny stellate neurons in cat visual cortex , 1994, The Journal of comparative neurology.

[38]  S Ullman,et al.  Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex. , 1995, Cerebral cortex.

[39]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[40]  J. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[41]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[42]  Bruno A. Olshausen,et al.  A Model of the Spatial-Frequency Organization in Primate Striate Cortex , 1995 .

[43]  Victor A. F. Lamme.  The neurophysiology of figure-ground segregation in primary visual cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[44]  Shinsuke Shimojo,et al.  Visual surface representation: a critical link between lower-level and higher level vision , 1995 .

[45]  David Mumford,et al.  Neuronal Architectures for Pattern-theoretic Problems , 1995 .

[46]  C. Gilbert,et al.  Improvement in visual sensitivity by changes in local context: Parallel studies in human observers and in V1 of alert monkeys , 1995, Neuron.

[47]  Terrence J. Sejnowski,et al.  Bayesian Unsupervised Learning of Higher Order Structure , 1996, NIPS.

[48]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[49]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[50]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[51]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[52]  M. Stryker,et al.  The Role of Activity in the Development of Long-Range Horizontal Connections in Area 17 of the Ferret , 1996, The Journal of Neuroscience.

[53]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[54]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[55]  J. B. Levitt,et al.  Relation between patterns of intrinsic lateral connectivity, ocular dominance, and cytochrome oxidase-reactive regions in macaque monkey striate cortex. , 1996, Cerebral cortex.

[56]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[57]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[58]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[59]  M. Gur,et al.  Visual Receptive Fields of Neurons in Primary Visual Cortex (V1) Move in Space with the Eye Movements of Fixation , 1997, Vision Research.

[60]  D. V. van Essen,et al.  Spatial Attention Effects in Macaque Area V4 , 1997, The Journal of Neuroscience.

[61]  D. G. Albrecht,et al.  Visual cortex neurons in monkeys and cats: Detection, discrimination, and identification , 1997, Visual Neuroscience.

[62]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[63]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[64]  J. V. van Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[65]  Nicolas J. Kerscher,et al.  State-dependent receptive-field restructuring in the visual cortex , 1998, Nature.

[66]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[67]  D. Ferster,et al.  Strength and Orientation Tuning of the Thalamic Input to Simple Cells Revealed by Electrically Evoked Cortical Suppression , 1998, Neuron.

[68]  U. Polat,et al.  Collinear stimuli regulate visual responses depending on cell's contrast threshold , 1998, Nature.

[69]  D. Mumford,et al.  The role of the primary visual cortex in higher level vision , 1998, Vision Research.

[70]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[71]  M. Tarr.  News On Views: Pandemonium Revisited , 1999, Nature Neuroscience.

[72]  Gerhard Krieger,et al.  The atoms of vision: Cartesian or polar? , 1999 .

[73]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[74]  I. Ohzawa,et al.  Asymmetric Suppression Outside the Classical Receptive Field of the Visual Cortex , 1999, The Journal of Neuroscience.

[75]  M. Young,et al.  The architecture of visual cortex and inferential processes in vision. , 2000, Spatial vision.

[76]  R. von der Heydt,et al.  Coding of Border Ownership in Monkey Visual Cortex , 2000, The Journal of Neuroscience.

[77]  J L Gallant,et al.  Sparse coding and decorrelation in primary visual cortex during natural vision. , 2000, Science.

[78]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[79]  C. Gilbert,et al.  Spatial distribution of contextual interactions in primary visual cortex and in visual perception. , 2000, Journal of neurophysiology.

[80]  J. Bakin,et al.  Visual Responses in Monkey Areas V1 and V2 to Three-Dimensional Surface Configurations , 2000, The Journal of Neuroscience.

[81]  C. Gray,et al.  Dynamic spike threshold reveals a mechanism for synaptic coincidence detection in cortical neurons in vivo. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[82]  Christopher C. Pack,et al.  Dynamic properties of neurons in cortical area MT in alert and anaesthetized macaque monkeys , 2001, Nature.

[83]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[84]  H Barlow,et al.  Redundancy reduction revisited , 2001, Network.

[85]  C. Zetzsche,et al.  Nonlinear and extra-classical receptive field properties and the statistics of natural scenes , 2001, Network.

[86]  Lawrence C. Sincich,et al.  Oriented Axon Projections in Primary Visual Cortex of the Monkey , 2001, The Journal of Neuroscience.

[87]  P. Fldik,et al.  The Speed of Sight , 2001, Journal of Cognitive Neuroscience.

[88]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[89]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[90]  C. Zetzsche,et al.  Nonlinear and extra-classical receptive field properties and the statistics of natural scenes. , 2001 .

[91]  BsnNr C. Srorn,et al.  CLASSIFYING SIMPLE AND COMPLEX CELLS ON THE BASIS OF RESPONSE MODULATION , 2002 .

[92]  J. Movshon,et al.  Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[93]  D. Snodderly,et al.  Spatial organization of receptive fields of V1 neurons of alert monkeys: comparison with responses to gratings. , 2002, Journal of neurophysiology.

[94]  Duane Q Nykamp,et al.  Full identification of a linear-nonlinear system via cross-correlation analysis. , 2002, Journal of vision.

[95]  Robert Shapley,et al.  Receptive field structure of neurons in monkey primary visual cortex revealed by stimulation with natural image sequences. , 2002, Journal of vision.

[96]  J. Gallant,et al.  Natural Stimulation of the Nonclassical Receptive Field Increases Information Transmission Efficiency in V1 , 2002, The Journal of Neuroscience.

[97]  D. Ringach,et al.  On the classification of simple and complex cells , 2002, Vision Research.

[98]  Paul Schrater,et al.  Shape perception reduces activity in human primary visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[99]  J. Touryan,et al.  Isolation of Relevant Visual Features from Random Stimuli for Cortical Complex Cells , 2002, The Journal of Neuroscience.

[100]  J. Movshon,et al.  Selectivity and spatial distribution of signals from the receptive field surround in macaque V1 neurons. , 2002, Journal of neurophysiology.

[101]  L. Frank,et al.  Single Neurons in the Monkey Hippocampus and Learning of New Associations , 2003, Science.

[102]  Ben Willmore,et al.  The Receptive-Field Organization of Simple Cells in Primary Visual Cortex of Ferrets under Natural Scene Stimulation , 2003, The Journal of Neuroscience.

[103]  N. Lesica,et al.  Adaptive encoding in the visual pathway , 2003, Network.

[104]  Y. Frégnac,et al.  The “silent” surround of V1 receptive fields: theory and experiments , 2003, Journal of Physiology-Paris.

[105]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[106]  C. Gray,et al.  Adaptive Coincidence Detection and Dynamic Gain Control in Visual Cortical Neurons In Vivo , 2003, Neuron.

[107]  R. Malach,et al.  Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind , 2003, Nature Neuroscience.

[108]  P. Lennie.  The Cost of Cortical Computation , 2003, Current Biology.

[109]  Bruno A. Olshausen,et al.  Principles of Image Representation in Visual Cortex , 2003 .

[110]  P. Lennie.  Receptive fields , 2003, Current Biology.

[111]  Jerry D. Nguyenkim,et al.  Disparity-Based Coding of Three-Dimensional Surface Orientation by Macaque Middle Temporal Neurons , 2003, The Journal of Neuroscience.

[112]  Bartlett W. Mel,et al.  Dendrites: bug or feature? , 2003, Current Opinion in Neurobiology.

[113]  Margaret S Livingstone,et al.  End-Stopping and the Aperture Problem Two-Dimensional Motion Signals in Macaque V1 , 2003, Neuron.

[114]  J. Gallant,et al.  Natural Stimulus Statistics Alter the Receptive Field Structure of V1 Neurons , 2004, The Journal of Neuroscience.

[115]  Andreas V. M. Herz,et al.  Searching for Optimal Sensory Signals: Iterative Stimulus Reconstruction in Closed-Loop Experiments , 2004, Journal of Computational Neuroscience.

[116]  Josh H. McDermott,et al.  Psychophysics with junctions in real images. , 2010, Perception.

[117]  Robert Shapley,et al.  A new view of the primary visual cortex , 2004, Neural Networks.

[118]  Eero P. Simoncelli,et al.  Maximum Likelihood Estimation of a Stochastic Integrate-and-Fire Neural Encoding Model , 2004, Neural Computation.

[119]  Eero P. Simoncelli,et al.  Spike-triggered characterization of excitatory and suppressive stimulus dimensions in monkey V1 , 2004, Neurocomputing.

[120]  David J. Field,et al.  An attempt towards a unified account of non-linearities in visual neurons , 2004 .

[121]  D. Perrett,et al.  Rapid serial visual presentation for the determination of neural selectivity in area STSa. , 2004, Progress in brain research.

[122]  William Bialek,et al.  Analyzing Neural Responses to Natural Signals: Maximally Informative Dimensions , 2002, Neural Computation.

[123]  Ohad Ben-Shahar,et al.  Geometrical Computations Explain Projection Patterns of Long-Range Horizontal Connections in Visual Cortex , 2004, Neural Computation.

[124]  J. Hawkins,et al.  On Intelligence , 2004 .

[125]  B. C. Motter,et al.  Dynamic stabilization of receptive fields of cortical neurons (VI) during fixation of gaze in the macaque , 2004, Experimental Brain Research.

[126]  M. Weliky,et al.  Small modulation of ongoing cortical dynamics by sensory input during natural vision , 2004, Nature.

[127]  Bartlett W. Mel,et al.  Computational subunits in thin dendrites of pyramidal cells , 2004, Nature Neuroscience.

[128]  Rajesh P. N. Rao,et al.  Bilinear Sparse Coding for Invariant Vision , 2005, Neural Computation.

[129]  Jeffrey S. Johnson,et al.  The recognition of partially visible natural objects in the presence and absence of their occluders , 2005, Vision Research.

[130]  D. Ringach,et al.  Spatial overlap of ON and OFF subregions and its relation to response modulation ratio in macaque primary visual cortex. , 2005, Journal of neurophysiology.

[131]  K. O’Connor,et al.  Adaptive stimulus optimization for auditory cortical neurons. , 2005, Journal of neurophysiology.

[132]  R. Segev,et al.  How silent is the brain: is there a “dark matter” problem in neuroscience? , 2006, Journal of Comparative Physiology A.

[133]  Romain Brette,et al.  Exact Simulation of Integrate-and-Fire Models with Synaptic Conductances , 2006, Neural Computation.

[134]  M. Mintun,et al.  Brain work and brain imaging. , 2006, Annual review of neuroscience.

[135]  Thomas Dean,et al.  Learning invariant features using inertial priors , 2006, Annals of Mathematics and Artificial Intelligence.

[136]  F. Scholz.  Maximum Likelihood Estimation , 2006 .

[137]  Norbert Krüger,et al.  Symbols as Self-emergent Entities in an Optimization Process of Feature Extraction and Predictions , 2006, Biological Cybernetics.

[138]  Jean-Baptiste Poline,et al.  Inverse retinotopy: Inferring the visual content of images from brain activation patterns , 2006, NeuroImage.

[139]  Frank van der Velde,et al.  Neural blackboard architectures: the realization of compositionality and systematicity in neural networksPart of the 3rd Neuro-IT and Neuroengineering Summer School Tutorial Series. , 2006 .

[140]  Jeffrey Ng,et al.  A Survey of Architecture and Function of the Primary Visual Cortex (V1) , 2007, EURASIP J. Adv. Signal Process..

[141]  RussLL L. Ds Vnlos,et al.  SPATIAL FREQUENCY SELECTIVITY OF CELLS IN MACAQUE VISUAL CORTEX , 2022 .