A novel mapping strategy based on neocortex model: Pre-liminary results by hierarchical temporal memory

Bio-inspired mapping methods have started a new trend in the robotics navigation area. In this paper, we propose a new map building framework based on the neocortex model: Hierarchical Temporary Memory (HTM). HTM has tree-shaped hierarchical structure and demonstrates structural and algorithmic properties of the human brain neocortex. We first treat the mapping problem as the object recognition problem, and design HTM network hierarchical structure. Secondly, the Speed Up Robust Features (SURF) descriptors were extracted from the grabbed images. These descriptors were further projected into visual words. The presence or absence of visual words consists of input data of HTM in the form of binary sequences. With the binary visual words sequences, HTM network stored or recognized the scene information which were reflected in the visual words, and the output of HTM was the related environment map. After training the HTM network, we evaluated it by two sets of environment data. The results show that the HTM based mapping strategy can build the environment map successfully and handle the loop closing problem with high performance.

[1]  C. W. Lim,et al.  Omnidirectional Image Matching for Vision-Based Robot Localization , 2006, 2006 IEEE International Conference on Mechatronics.

[2]  Lingfu Kong,et al.  Holography map for home robot: an object-oriented approach , 2012, Intell. Serv. Robotics.

[3]  Gordon Wyeth,et al.  Spatial cognition for robots , 2009, IEEE Robotics & Automation Magazine.

[4]  Dileep George,et al.  Sequence memory for prediction, inference and behaviour , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  Philippe Gaussier,et al.  Autonomous vision-based navigation: Goal-oriented action planning by transient states prediction, cognitive map building, and sensory-motor learning , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[7]  Joaquim Salvi,et al.  Appearance-Based SLAM for Mobile Robots , 2009, CCIA.

[8]  Roland Siegwart,et al.  Cognitive maps for mobile robots - an object based approach , 2007, Robotics Auton. Syst..

[9]  Gordon Wyeth,et al.  Mapping a Suburb With a Single Camera Using a Biologically Inspired SLAM System , 2008, IEEE Transactions on Robotics.

[10]  Alejandra Barrera,et al.  Biologically-inspired robot spatial cognition based on rat neurophysiological studies , 2008, Auton. Robots.

[11]  Paul Newman,et al.  Appearance-only SLAM at large scale with FAB-MAP 2.0 , 2011, Int. J. Robotics Res..

[12]  Shuji Hashimoto,et al.  Object Identification in Dynamic Images Based on the Memory-Prediction Theory of Brain Function , 2010, J. Intell. Learn. Syst. Appl..

[13]  Janet Wiles,et al.  Learning spatial concepts from RatSLAM representations , 2006, Robotics Auton. Syst..

[14]  Laurent Itti,et al.  Biologically Inspired Mobile Robot Vision Localization , 2009, IEEE Transactions on Robotics.

[15]  Dileep George,et al.  How the brain might work: a hierarchical and temporal model for learning and recognition , 2008 .

[16]  J. Hawkins,et al.  On Intelligence , 2004 .

[17]  Benjamin Kuipers,et al.  Factoring the Mapping Problem: Mobile Robot Map-building in the Hybrid Spatial Semantic Hierarchy , 2010, Int. J. Robotics Res..