Application of neural processing paradigm in visual landmark recognition and autonomous robot navigation

This article addresses the issue of visual landmark recognition in autonomous robot navigation along known routes, by intuitively exploiting the functions of the human visual system and its navigational ability. A feedforward–feedbackward architecture has been developed for recognising visual landmarks in real time. It integrates the theoretical concepts from the pre-attentive and attentive stages in the human visual system, the selective attention adaptive resonance theory neural network and its derivatives, and computational approaches towards object recognition in computer vision. The architecture mimics the pre-attentive and attentive stages in the context of object recognition, embedding neural network processing paradigm into a computational template-matching approach in computer vision. The real-time landmark recognition capability is achieved by mimicking the pre-attentive stage, where it models a selective attention mechanism for optimal computational resource allocation, focusing only on the regions of interest to address the computational restrictive nature of current computer processing power. Similarly, the recognition of visual landmarks in both clean and cluttered backgrounds is implemented in the attentive stage by developing a memory feedback modulation (MFM) mechanism that enables knowledge from the memory to interact and enhance the efficiency of earlier stages in the architecture. Furthermore, it also incorporates both top-down and bottom-up facilitatory and inhibition pathways between the memory and the earlier stages to enable the architecture to recognise a 2D landmark, which is partially occluded by adjacent features in the surroundings. The results show that the architecture is able to recognise objects in cluttered backgrounds using real-images in both indoor and outdoor scenes. Furthermore, the architecture application in autonomous robot navigation has been demonstrated through a number of real-time trials in both indoor and outdoor environments.

[1]  Stephen Grossberg,et al.  Neural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes , 2004, Kybernetik.

[2]  Lakhmi C. Jain,et al.  A Fast Visual Search and Recognition Mechanism for Real-Time Robotics Applications , 2004, Australian Conference on Artificial Intelligence.

[3]  Marimuthu Palaniswami,et al.  An object recognition system using self-organising neural networks , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[4]  Wei Wu,et al.  A method of vehicle classification using models and neural networks , 2001, IEEE VTS 53rd Vehicular Technology Conference, Spring 2001. Proceedings (Cat. No.01CH37202).

[5]  Stephen Grossberg,et al.  Art 2: Self-Organization Of Stable Category Recognition Codes For Analog Input Patterns , 1988, Other Conferences.

[6]  E. Rolls.  High-level vision: Object recognition and visual cognition, Shimon Ullman. MIT Press, Bradford (1996), ISBN 0 262 21013 4 , 1997 .

[7]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[8]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Stephen Grossberg,et al.  ART 2-A: an adaptive resonance algorithm for rapid category learning and recognition , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[10]  S. Grossberg.  How does a brain build a cognitive code , 1980 .

[11]  M. J. Healy.  A logical architecture for supervised learning , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[12]  Stephen Grossberg,et al.  Invariant recognition of cluttered scenes by a self-organizing ART architecture: figure-ground separation , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[13]  Pietro Perona,et al.  A neural framework for visual attention , 2010 .

[14]  Wenjing Li,et al.  Hopfield network for affine invariant object recognition , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[15]  Wen-Jing Li,et al.  Invariant feature matching by Hopfield-type neural network , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[16]  E.W. Chong,et al.  Design of a 2-D neural motion detection filter , 1997, TENCON '97 Brisbane - Australia. Proceedings of IEEE TENCON '97. IEEE Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications (Cat. No.97CH36162).

[17]  Ben J. A. Kröse,et al.  Navigation of a mobile robot on the temporal development of the optic flow , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[18]  Stephen Grossberg,et al.  ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network , 1991, [1991 Proceedings] IEEE Conference on Neural Networks for Ocean Engineering.

[19]  R. Desimone,et al.  Neural mechanisms for visual memory and their role in attention. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[20]  Lior Wolf,et al.  Combining variable selection with dimensionality reduction , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[21]  Peter L. Bartlett,et al.  Neural Network Learning - Theoretical Foundations , 1999 .

[22]  Katsunari Shibata,et al.  Unsupervised learning method to extract object locations from local visual signals , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[23]  Peter Lozo,et al.  Neural circuit for object recognition in complex and cluttered visual images , 1996, 1996 Australian New Zealand Conference on Intelligent Information Systems. Proceedings. ANZIIS 96.

[24]  Peter Lozo.  Neural theory and model of selective visual attention and 2D shape recognition in visual clutter / by Peter Lozo. , 1996 .

[25]  Lakhmi C. Jain,et al.  Selective Attention Adaptive Resonance Theory and Object Recognition , 2004 .

[26]  M. Mignard,et al.  Paths of information flow through visual cortex. , 1991, Science.

[27]  Lakhmi C. Jain,et al.  Distortion invariant selective attention adaptive resonance theory neural network , 1999, 1999 Third International Conference on Knowledge-Based Intelligent Information Engineering Systems. Proceedings (Cat. No.99TH8410).

[28]  L. Sherwood.  Human Physiology : From Cells to Systems , 1989 .

[29]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[30]  V. Bruce,et al.  Visual Perception: Physiology, Psychology and Ecology , 1985 .

[31]  Xuegong Zhang,et al.  A PCA classifier and its application in vehicle detection , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[32]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[33]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[34]  S. Grossberg,et al.  Search mechanisms for adaptive resonance theory (ART) architectures , 1989, International 1989 Joint Conference on Neural Networks.

[35]  R. Desimone,et al.  Attentional control of visual perception: cortical and subcortical mechanisms. , 1990, Cold Spring Harbor symposia on quantitative biology.

[36]  M. Tarr,et al.  When does Human Object Recognition use a Viewer-Centered Reference Frame? , 1990 .

[37]  George L. Gerstein,et al.  Feature-linked synchronization of thalamic relay cell firing induced by feedback from the visual cortex , 1994, Nature.

[38]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[39]  Yutaka Maeda,et al.  Unsupervised learning of neural networks for separation of unknown data , 1995, Proceedings of IECON '95 - 21st Annual Conference on IEEE Industrial Electronics.

[40]  Peter Lozo,et al.  Neural model of visual selective attention for automatic translation invariant object recognition in cluttered images , 1999, 1999 Third International Conference on Knowledge-Based Intelligent Information Engineering Systems. Proceedings (Cat. No.99TH8410).

[41]  Peter Lozo,et al.  Neural Circuit For Self-regulated Attentional Learning In Selective Attention Adaptive Resonance Theory (saart) Neural Networks , 1996, Fourth International Symposium on Signal Processing and Its Applications.

[42]  Zixiang Xiong,et al.  On optimal subspaces for appearance-based object recognition , 2002, Proceedings. International Conference on Image Processing.

[43]  Peter Lozo.  Neural Circuit For Matchhnismatch, Familiarity/novelty And Synchronization Detection In Saart Neural Networks , 1996, Fourth International Symposium on Signal Processing and Its Applications.

[44]  A. Zelinsky,et al.  Accurate vision based position tracking between places in a topological map , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[45]  Shi Bai,et al.  A new feedback neural network with supervised learning , 1991, IEEE Trans. Neural Networks.

[46]  S. Grossberg,et al.  Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors , 1976, Biological Cybernetics.

[47]  G. Sperling,et al.  Dynamics of automatic and controlled visual attention. , 1987, Science.

[48]  Kunihiko Fukushima,et al.  Cognitron: A self-organizing multilayered neural network , 1975, Biological Cybernetics.

[49]  Richard F. Thompson,et al.  The Brain: A Neuroscience Primer , 1993 .

[50]  Panos E. Trahanias,et al.  Landmark identification based on projective and permutation invariant vectors , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[51]  Arthur R. Pope.  Model-Based Object Recognition - A Survey of Recent Research , 1994 .

[52]  Mohd Rizal Arshad,et al.  3D object recognition using 2D moments and HMLP network , 2004 .

[53]  P. Lozo,et al.  Selective attention adaptive resonance theory (SAART) neural network for neuro-engineering of robust ATR systems , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[54]  Shi Bai,et al.  A feedback neural network with supervised learning , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[55]  Gordon Cheng,et al.  Goal-oriented behaviour-based visual navigation , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[56]  S. Luck,et al.  Attention-Related Modulation of Sensory-Evoked Brain Activity in a Visual Search Task , 1993, Journal of Cognitive Neuroscience.

[57]  Stephen Grossberg,et al.  ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures , 1990, Neural Networks.

[58]  Peter Lozo,et al.  Selective transfer of spatial patterns by presynaptic facilitation in a shunting competitive neural layer , 1996, 1996 Australian New Zealand Conference on Intelligent Information Systems. Proceedings. ANZIIS 96.

[59]  Isaac Weiss,et al.  Model-Based Recognition of 3D Objects from Single Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.