Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects.

We describe a model of visual processing in which feedback connections from a higher- to a lower- order visual cortical area carry predictions of lower-level neural activities, whereas the feedforward connections carry the residual errors between the predictions and the actual lower-level activities. When exposed to natural images, a hierarchical network of model neurons implementing such a model developed simple-cell-like receptive fields. A subset of neurons responsible for carrying the residual errors showed endstopping and other extra-classical receptive-field effects. These results suggest that rather than being exclusively feedforward phenomena, nonclassical surround effects in the visual cortex may also result from cortico-cortical feedback as a consequence of the visual system using an efficient hierarchical strategy for encoding natural images.

[1]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[2]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[3]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[4]  P. Schiller,et al.  Effect of cooling area 18 on striate cortex cells in the squirrel monkey. , 1982, Journal of neurophysiology.

[5]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  G. Buchsbaum,et al.  Trichromacy, opponent colours coding and optimum colour information transmission in the retina , 1983, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  J. Allman,et al.  Stimulus specific responses from beyond the classical receptive field: neurophysiological mechanisms for local-global comparisons in visual neurons. , 1985, Annual review of neuroscience.

[8]  C. Gilbert,et al.  Generation of end-inhibition in the visual cortex via interlaminar connections , 1986, Nature.

[9]  R. Desimone,et al.  Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form. , 1987, Journal of neurophysiology.

[10]  DH Hubel,et al.  Segregation of form, color, and stereopsis in primate area 18 , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[12]  S. Zucker,et al.  Endstopped neurons in the visual cortex as a substrate for calculating curvature , 1987, Nature.

[13]  P. C. Murphy,et al.  Corticofugal feedback influences the generation of length tuning in the visual pathway , 1987, Nature.

[14]  T. Wiesel,et al.  Pharmacological analysis of cortical circuitry , 1989, Trends in Neurosciences.

[15]  T. Poggio,et al.  A network that learns to recognize three-dimensional objects , 1990, Nature.

[16]  E. Peterhans,et al.  Subjective contours - bridging the gap between psychophysics and physiology , 1991, Trends in Neurosciences.

[17]  R. Desimone,et al.  A neural mechanism for working and recognition memory in inferior temporal cortex. , 1991, Science.

[18]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[19]  D. V. van Essen,et al.  Neuronal responses to static texture patterns in area V1 of the alert macaque monkey. , 1992, Journal of neurophysiology.

[20]  J. G. Taylor,et al.  ARTIFICIAL NEURAL NETWORKS, 2 , 1992 .

[21]  A. Pece.  Redundancy reduction of a Gabor representation: a possible computational role for feedback from primary visual cortex to lateral geniculate nucleus , 1992 .

[22]  Joel L. Davis,et al.  Large-Scale Neuronal Theories of the Brain , 1994 .

[23]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[24]  Alan S. Willsky,et al.  Likelihood calculation for a class of multiscale stochastic models, with application to texture discrimination , 1995, IEEE Trans. Image Process..

[25]  H. Jones,et al.  Visual cortical mechanisms detecting focal orientation discontinuities , 1995, Nature.

[26]  J. Atick,et al.  Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus , 1995 .

[27]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[28]  N. Logothetis,et al.  Psychophysical and physiological evidence for viewer-centered object representations in the primate. , 1995, Cerebral cortex.

[29]  Eero P. Simoncelli,et al.  Computational models of cortical visual processing. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Victor A. F. Lamme,et al.  Contextual Modulation in Primary Visual Cortex , 1996, The Journal of Neuroscience.

[31]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[32]  R C Reid,et al.  Efficient Coding of Natural Scenes in the Lateral Geniculate Nucleus: Experimental Test of a Computational Theory , 1996, The Journal of Neuroscience.

[33]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[34]  C. Bell,et al.  The generation and subtraction of sensory expectations within cerebellum-like structures. , 1997, Brain, behavior and evolution.

[35]  W. D. Ross,et al.  Visual brain and visual perception: how does the cortex do perceptual grouping? , 1997, Trends in Neurosciences.

[36]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[37]  Rajesh P. N. Rao,et al.  Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex , 1997, Neural Computation.

[38]  D C Van Essen,et al.  Neural activity in areas V1, V2 and V4 during free viewing of natural scenes compared to controlled viewing , 1998, Neuroreport.

[39]  D C Van Essen,et al.  Neural activity in areas V1, V2 and V4 during free viewing of natural scenes compared to controlled viewing. , 1998, Neuroreport.

[40]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[41]  C. Gilbert.  Adult cortical dynamics. , 1998, Physiological reviews.

[42]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[43]  Rajesh P. N. Rao,et al.  An optimal estimation approach to visual perception and learning , 1999, Vision Research.