Identification of complex shapes using a self organizing neural system

We present a multilayer hierarchical neural system for automatic classification of complex contour patterns. The system consists of a neocognitron-like network structure combined with self-organizing maps to automatically determine feature classes. We present results showing that multilayer hierarchical networks are able to tolerate pattern distortion considerably better than standard neural network implementations.

[1]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[2]  David Hubel,et al.  A big step along the visual pathway , 1996, Nature.

[3]  Masato Okada,et al.  Neocognitron with dual C-cell layers , 1994, Neural Networks.

[4]  David Lovell,et al.  The neocognitron as a system for handwritten character recognition : limitations and improvements , 1994 .

[5]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[6]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[7]  Ah Chung Tsoi,et al.  An evaluation of the neocognitron , 1997, IEEE Trans. Neural Networks.

[8]  D. Hubel,et al.  Receptive fields of single neurones in the cat's striate cortex , 1959, The Journal of physiology.

[9]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[10]  Kunihiko Fukushima,et al.  A neural network for visual pattern recognition , 1988, Computer.

[11]  Kwanghee Nam,et al.  Object recognition of one-DOF tools by a back-propagation neural net , 1995, IEEE Trans. Neural Networks.

[12]  T. H. Hildebrandt,et al.  Optimal training of thresholded linear correlation classifiers , 1991, IEEE Trans. Neural Networks.

[13]  Krzysztof J. Cios,et al.  Image Recognition Neural Network: IRNN , 1995, Neurocomputing.

[14]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[15]  D H Hubel,et al.  Brain mechanisms of vision. , 1979, Scientific American.

[16]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[17]  Kunihiko Fukushima,et al.  Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position , 1982, Pattern Recognit..

[18]  Takayuki Ito,et al.  Neocognitron: A neural network model for a mechanism of visual pattern recognition , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[19]  David Zipser,et al.  Feature Discovery by Competive Learning , 1986, Cogn. Sci..

[20]  Wen-Tsuen Chen,et al.  A neural network model which combines unsupervised and supervised learning , 1993, IEEE Trans. Neural Networks.

[21]  D. Lowe,et al.  Adaptive radial basis function nonlinearities, and the problem of generalisation , 1989 .

[22]  Ferdinand Hergert,et al.  Improving model selection by nonconvergent methods , 1993, Neural Networks.

[23]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[24]  Isabelle Guyon,et al.  Handwritten Digit Recognition: Applications of Neural Net Chips and Automatic Learning , 1989, NATO Neurocomputing.

[25]  C.-H. Sung,et al.  Percognitron: Neocognitron coupled with perceptron , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[26]  K Tanaka,et al.  Neuronal mechanisms of object recognition. , 1993, Science.

[27]  Etienne Barnard,et al.  Invariance and neural nets , 1991, IEEE Trans. Neural Networks.

[28]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[29]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[30]  James D. Keeler,et al.  Layered Neural Networks with Gaussian Hidden Units as Universal Approximations , 1990, Neural Computation.

[31]  Ah Chung Tsoi,et al.  Comments on 'Optimal training of thresholded linear correlation classifiers' [with reply] , 1993, IEEE Trans. Neural Networks.

[32]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[33]  K Fukushima,et al.  Handwritten alphanumeric character recognition by the neocognitron , 1991, IEEE Trans. Neural Networks.