Neurobiological Inspiration for the Architecture and Functioning of Cooperating Neural Networks

In order to emulate more complex and more realistic human-like functions, it is now well admitted that a single monolithic neural network is not sufficient. Biological data show that the cortex is a set of interconnected neural networks. Beyond the classical view of one way feedforward neural network guiding an information flow from an input to an output layer, we now have to imagine architectures and functioning rules that permit cooperation and information exchange between such neural networks. Inspired with biological data, we propose here such a scheme bringing into play of complex units like the cortical column, a functional micro-circuit repeated throughout the cortex. This basic unit of treatment gathers the classical weighted sum for feedforward information flow and sigma-pi operations for cooperation between different axis of treatment. We illustrate this model with an application of cooperation between character recognition and localization.

[1]  Paul B. Johnson,et al.  Visuomotor transformations underlying arm movements toward visual targets: a neural network model of cerebral cortical operations , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  F. Alexandre,et al.  Integration of context in process models used for neuro-control , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[3]  Frédéric Alexandre,et al.  Principles and applications of the cortical column symbolic neural model , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[4]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[5]  Yves Burnod,et al.  An adaptive neural network - the cerebral cortex , 1991 .

[6]  Emmanuel Guigon Modélisation des propriétés du cortex cérébral : comparaison entre aires visuelles, motrices et préfrontales , 1993 .

[7]  Jean-Paul Haton,et al.  The cortical column as a model for speech recognition: principles and first experiments , 1992 .

[8]  Frédéric Alexandre,et al.  The cortical column: A new processing unit for multilayered networks , 1991, Neural Networks.

[9]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[10]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .