A forward-inverse optics model of reciprocal connections between visual cortical areas

We propose that the feedforward connection from the lower visual cortical area to the higher visual cortical area provides an approximated inverse model of the imaging process (optics), while the backprojection connection from the higher area to the lower area provides a forward model of the optics. By mathematical analysis and computer simulation, we show that a small number of relaxation computations circulating this forward-inverse optics hierarchy achieves fast and reliable integration of vision modules, and therefore might resolve the following problems. (i) How are parallel visual modules (multiple visual cortical areas) integrated to allow a coherent scene perception? (ii) How can ill-posed vision problems be solved by the brain within several hundreds of milliseconds?

[1]  E. Rolls.  Functions of neuronal networks in the hippocampus and neocortex in memory , 1989 .

[2]  S. Shipp,et al.  The functional logic of cortical connections , 1988, Nature.

[3]  DH Hubel,et al.  Segregation of form, color, and stereopsis in primate area 18 , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  T. Inui,et al.  The time needed to judge the order of a meaningful string of pictures. , 1981 .

[5]  C Koch,et al.  Analog "neuronal" networks in early vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[6]  M. Potter.  Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[7]  Christof Koch,et al.  Computing Optical Flow in the Primate Visual System , 1989, Neural Computation.

[8]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985 .

[9]  E. Adelson,et al.  The analysis of moving visual patterns , 1985 .

[10]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[11]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[12]  J. A. Anderson,et al.  Associative learning of scene parameters from images. , 1987, Applied optics.

[13]  Toshiaki Sakaguchi,et al.  Redundant coding for fault tolerant computing on Hopfield network , 1988, Neural Networks.

[14]  T. Poggio,et al.  A computational theory of human stereo vision , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[15]  D. C. Essen,et al.  Modular and hierarchical organization of extrastriate visual cortex in the macaque monkey. , 1990, Cold Spring Harbor symposia on quantitative biology.

[16]  Geoffrey E. Hinton,et al.  Parallel visual computation , 1983, Nature.

[17]  T Poggio,et al.  Parallel integration of vision modules. , 1988, Science.

[18]  T. Wiesel,et al.  Clustered intrinsic connections in cat visual cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  Tomaso Poggio,et al.  Synthesizing a color algorithm from examples , 1988 .

[20]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Leif H. Finkel,et al.  Object Discrimination Based on Depth-from-Occlusion , 1992, Neural Computation.

[22]  B J Richmond,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. II. Quantification of response waveform. , 1987, Journal of neurophysiology.

[23]  Mitsuo Kawato,et al.  A neural network model for arm trajectory formation using forward and inverse dynamics models , 1993, Neural Networks.

[24]  E Harth,et al.  The inversion of sensory processing by feedback pathways: a model of visual cognitive functions. , 1987, Science.

[25]  D. Pandya,et al.  Architecture and Connections of Cortical Association Areas , 1985 .

[26]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[27]  Christoph von der Malsburg,et al.  Pattern recognition by labeled graph matching , 1988, Neural Networks.