Neural networks for complex scene recognition: simulation of a visual system with several cortical areas

A general system for image interpretation based on neurobiological and physiological concepts is presented. All processing is performed by neural networks. The system emulates a robot with a single eye. Its brain has several cortical areas. It is able to learn a given number of objects. The architecture solves the problem of communication between low- and high-level processes in picture analysis. In a classical scheme of image understanding, it is necessary to perform a good segmentation to obtain a good interpretation. In the neural network approach, the concept of mental stages is used. Noisy pictures and partially occluded objects are satisfactorily recognized.<<ETX>>

[1]  Terry Caelli,et al.  Invariant pattern recognition using multiple filter image representations , 1989, Comput. Vis. Graph. Image Process..

[2]  Eric L. Schwartz,et al.  Computational anatomy and functional architecture of striate cortex: A spatial mapping approach to perceptual coding , 1980, Vision Research.

[3]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[4]  Kazumasa Ozawa,et al.  Simulation studies on optical illusions based on a position-dependent point spread function , 1990, Pattern Recognit..

[5]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[6]  S. Grossberg.  How does a brain build a cognitive code , 1980 .

[7]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  Michael A. Arbib,et al.  Complex temporal sequence learning based on short-term memory , 1990 .

[9]  D. Noton,et al.  Eye movements and visual perception. , 1971, Scientific American.

[10]  Geoffrey E. Hinton,et al.  Shape Recognition and Illusory Conjunctions , 1985, IJCAI.

[11]  R. Shepard,et al.  Mental Images and Their Transformations , 1982 .

[12]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[13]  Stephen Grossberg,et al.  Stereo boundary fusion by cortical complex cells: A system of maps, filters, and feedback networks for multiplexing distributed data , 1989, Neural Networks.

[14]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[15]  Terry Caelli,et al.  Fast edge-only matching techniques for robot pattern recognition , 1987 .

[16]  Stephen Grossberg,et al.  Neural dynamics of surface perception: Boundary webs, illuminants, and shape-from-shading , 1987, Comput. Vis. Graph. Image Process..

[17]  Kunihiko Fukushima,et al.  Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position , 1982, Pattern Recognit..

[18]  Dana H. Ballard,et al.  Cortical connections and parallel processing: Structure and function , 1986, Behavioral and Brain Sciences.

[19]  John H. R. Maunsell,et al.  Hierarchical organization and functional streams in the visual cortex , 1983, Trends in Neurosciences.

[20]  Jonathan A. Marshall,et al.  Representation of Uncertainty in Self-Organizing Neural Networks , 1990 .

[21]  M. Farah,et al.  Mental rotation and orientation-invariant object recognition: Dissociable processes , 1988, Cognition.

[22]  W. Thomas Miller,et al.  Sensor-based control of robotic manipulators using a general learning algorithm , 1987, IEEE J. Robotics Autom..

[23]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[24]  P. Foldiak,et al.  Adaptive network for optimal linear feature extraction , 1989, International 1989 Joint Conference on Neural Networks.

[25]  Harry Wechsler,et al.  2-D Invariant Object Recognition Using Distributed Associative Memory , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Richard A. Messner,et al.  An image processing architecture for real time generation of scale and rotation invariant patterns , 1985, Comput. Vis. Graph. Image Process..

[27]  Jacob Beck,et al.  Perception of transparency in man and machine , 1985, Comput. Vis. Graph. Image Process..

[28]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[29]  Elie Bienenstock,et al.  A neural network for invariant pattern recognition. , 1987 .

[30]  David E. Rumelhart,et al.  Product Units: A Computationally Powerful and Biologically Plausible Extension to Backpropagation Networks , 1989, Neural Computation.

[31]  R. Almond.  The therapeutic community. , 1971, Scientific American.

[32]  S. Grossberg,et al.  Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading. , 1985 .

[33]  R. Andersen.  Visual and eye movement functions of the posterior parietal cortex. , 1989, Annual review of neuroscience.

[34]  D C Van Essen,et al.  Shifter circuits: a computational strategy for dynamic aspects of visual processing. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Luciano da Fontoura Costa,et al.  Neural networks and Hough transform for pattern recognition , 1989 .

[36]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[37]  John G. Daugman,et al.  Complete discrete 2-D Gabor transforms by neural networks for image analysis and compression , 1988, IEEE Trans. Acoust. Speech Signal Process..

[38]  Bernard Widrow,et al.  Layered neural nets for pattern recognition , 1988, IEEE Trans. Acoust. Speech Signal Process..

[39]  Kunihiko Fukushima,et al.  A neural network for visual pattern recognition , 1988, Computer.

[40]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[41]  W. Thomas Miller,et al.  Pattern Recognition Using A CMAC Based Learning System , 1989, Other Conferences.

[42]  Olaf Sporns,et al.  Synthetic neural modeling: the 'Darwin' series of recognition automata , 1990, Proc. IEEE.

[43]  Ennio Mingolla,et al.  Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations , 1985 .

[44]  A. Treisman.  Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[45]  S. Shipp,et al.  The functional logic of cortical connections , 1988, Nature.

[46]  James A. Anderson,et al.  Cognitive and psychological computation with neural models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[47]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[48]  S. J. Thorpe,et al.  Traitement d'images chez l'homme , 1988 .

[49]  J. A. Thompson,et al.  Position independent recognition with a neural network , 1989 .

[50]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[51]  Allen M. Waxman,et al.  Spreading activation layers, visual saccades, and invariant representations for neural pattern recognition systems , 1989, Neural Networks.

[52]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[53]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[54]  R. Watt,et al.  The recognition and representation of edge blur: Evidence for spatial primitives in human vision , 1983, Vision Research.

[55]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[56]  Robert J. Baron,et al.  Visual Memories and Mental Images , 1985, Int. J. Man Mach. Stud..

[57]  T. A. Grogan,et al.  Neural Network Controlled Visual Saccades , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[58]  Jerome A. Feldman,et al.  Connectionist models and parallelism in high level vision , 1985, Comput. Vis. Graph. Image Process..

[59]  J. A. Marshall,et al.  Self-organizing neural network architectures for computing visual depth from motion parallax , 1989, International 1989 Joint Conference on Neural Networks.

[60]  G. Sperling.  Three stages and two systems of visual processing. , 1989, Spatial vision.