Recent Studies Around the Neocognitron

Neocognitron, which was proposed by Fukushima, is recently studied in several styles. In this paper, we introduce these studies from the both engineering and biological sides. From the engineering side, we discussed about the ability of the pattern classifier of the Neocognitron and relationship to the "convolutional net", which is recently well studied in the field of pattern recognition. From the biological side, we tried to explain the recent result of a biological experiment with the Neocognitron, and compare it with another model.

[1]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[2]  Hayaru Shouno,et al.  Connected character recognition in cursive handwriting using selective attention model with bend processing , 1994, Systems and Computers in Japan.

[3]  K. Fukushima Neural network model for selective attention in visual pattern recognition and associative recall. , 1987, Applied optics.

[4]  Yann LeCun,et al.  Large-scale Learning with SVM and Convolutional for Generic Object Categorization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[6]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[7]  Kunihiko Fukushima,et al.  Interpolating vectors for robust pattern recognition , 2007, Neural Networks.

[8]  Masashi Tanigawa,et al.  Use of different thresholds in learning and recognition , 1996, Neurocomputing.

[9]  Ah Chung Tsoi,et al.  An evaluation of the neocognitron , 1997, IEEE Trans. Neural Networks.

[10]  Yann LeCun,et al.  Tangent Prop - A Formalism for Specifying Selected Invariances in an Adaptive Network , 1991, NIPS.

[11]  Tomaso A. Poggio,et al.  3D Object Recognition: A Model of View-Tuned Neurons , 1996, NIPS.

[12]  David L. Sheinberg,et al.  Visual object recognition. , 1996, Annual review of neuroscience.

[13]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[14]  E. Rolls Brain mechanisms for invariant visual recognition and learning , 1994, Behavioural Processes.

[15]  Yeuvo Jphonen,et al.  Self-Organizing Maps , 1995 .

[16]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[17]  K Fukushima,et al.  Handwritten alphanumeric character recognition by the neocognitron , 1991, IEEE Trans. Neural Networks.

[18]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[19]  Shunji Satoh,et al.  A rotation‐invariant neocognitron , 1999 .

[20]  Nikos K. Logothetis,et al.  Spatial Reference Frames for Object Recognition Tuning for Rotations in Depth , 1995 .

[21]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[22]  Kunihiko Fukushima,et al.  Neocognitron: A hierarchical neural network capable of visual pattern recognition , 1988, Neural Networks.

[23]  Kunihiko Fukushima,et al.  Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position , 1982, Pattern Recognit..