Learning indoor robot navigation using visual and sensorimotor map information

As a fundamental research topic, autonomous indoor robot navigation continues to be a challenge in unconstrained real-world indoor environments. Although many models for map-building and planning exist, it is difficult to integrate them due to the high amount of noise, dynamics, and complexity. Addressing this challenge, this paper describes a neural model for environment mapping and robot navigation based on learning spatial knowledge. Considering that a person typically moves within a room without colliding with objects, this model learns the spatial knowledge by observing the person's movement using a ceiling-mounted camera. A robot can plan and navigate to any given position in the room based on the acquired map, and adapt it based on having identified possible obstacles. In addition, salient visual features are learned and stored in the map during navigation. This anchoring of visual features in the map enables the robot to find and navigate to a target object by showing an image of it. We implement this model on a humanoid robot and tests are conducted in a home-like environment. Results of our experiments show that the learned sensorimotor map masters complex navigation tasks.

[1]  Stefan Wermter,et al.  A self-organizing map of sigma-pi units , 2007, Neurocomputing.

[2]  K. Schill,et al.  Representation of space: image-like or sensorimotor? , 2009, Spatial vision.

[3]  Angelo Arleo,et al.  Spatial Learning and Action Planning in a Prefrontal Cortical Network Model , 2011, PLoS Comput. Biol..

[4]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[5]  T. Collett,et al.  Local and global vectors in desert ant navigation , 1998, Nature.

[6]  Philippe Gaussier,et al.  Neurobiologically Inspired Mobile Robot Navigation and Planning , 2007, Frontiers in neurorobotics.

[7]  R. Rajesh Neurons as Monte Carlo Samplers: Sequential Bayesian Inference in Spiking Neural Populations , 2009 .

[8]  R. Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. II. Effects of environmental manipulations , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[10]  H. T. Blair,et al.  Anticipatory head direction signals in anterior thalamus: evidence for a thalamocortical circuit that integrates angular head motion to compute head direction , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[11]  Philippe Gaussier,et al.  Transition Cells and Neural Fields for Navigation and Planning , 2005, IWINAC.

[12]  Leif H. Finkel,et al.  A Neural Implementation of the Kalman Filter , 2009, NIPS.

[13]  S. Mizumori,et al.  Directionally selective mnemonic properties of neurons in the lateral dorsal nucleus of the thalamus of rats , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  J. B. Seery,et al.  Numerical evaluation of the modified Bessel functions I and K , 1981 .

[15]  R U Muller,et al.  Comparisons of head direction cell activity in the postsubiculum and anterior thalamus of freely moving rats , 1998, Hippocampus.

[16]  Stephen R. Marsland,et al.  A self-organising network that grows when required , 2002, Neural Networks.

[17]  Gordon Wyeth,et al.  Persistent Navigation and Mapping using a Biologically Inspired SLAM System , 2010, Int. J. Robotics Res..

[18]  F. Gage,et al.  Neurogenesis in the adult human hippocampus , 1998, Nature Medicine.

[19]  Stefan Wermter,et al.  A neural approach for robot navigation based on cognitive map learning , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[20]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[21]  Martin V. Butz,et al.  The SURE_REACH Model for Motor Learning and Control of a Redundant Arm: From Modeling Human Behavior to Applications in Robotics , 2010, From Motor Learning to Interaction Learning in Robots.

[22]  Jose Garcia-Rodriguez,et al.  Robotic Vision: Technologies for Machine Learning and Vision Applications , 2013 .

[23]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[24]  Wilfried Brauer,et al.  Spatial Cognition III , 2003, Lecture Notes in Computer Science.

[25]  A. Lavoie,et al.  Spatial, movement- and reward-sensitive discharge by medial ventral striatum neurons of rats , 1994, Brain Research.

[26]  S. Mizumori,et al.  Neural systems analysis of decision making during goal-directed navigation , 2012, Progress in Neurobiology.

[27]  M. Giese Dynamic neural field theory for motion perception , 1998 .

[28]  G. Ascoli,et al.  A simple neural network model of the hippocampus suggesting its pathfinding role in episodic memory retrieval. , 2005, Learning & memory.

[29]  Sophie Denève,et al.  Bayesian Inference with Spiking Neurons , 2004, Encyclopedia of Computational Neuroscience.

[30]  Estela Bicho,et al.  The dynamic neural field approach to cognitive robotics , 2006, Journal of neural engineering.

[31]  Patricia E. Sharp,et al.  Head Direction, Place, and Movement Correlates for Cells in the Rat Retrosplenial Cortex , 2001 .

[32]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[33]  H. T. Blair,et al.  Role of the Lateral Mammillary Nucleus in the Rat Head Direction Circuit A Combined Single Unit Recording and Lesion Study , 1998, Neuron.

[34]  Jordi Borja Local and global , 1997 .

[35]  Andreas K. Engel,et al.  Unsupervised Learning of Reflexive and Action-Based Affordances to Model Adaptive Navigational Behavior , 2009, Front. Neurorobot..

[36]  R. Joyce,et al.  1 Mesoamerica : A Working Model for Archaeology , 2003 .

[37]  Elena Torta,et al.  A model of the user's proximity for Bayesian inference , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[38]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[39]  E. J. Green,et al.  Head-direction cells in the rat posterior cortex , 1994, Experimental Brain Research.

[40]  P. König,et al.  A Model of the Ventral Visual System Based on Temporal Stability and Local Memory , 2006, PLoS biology.

[41]  Stephen Grossberg,et al.  Space, time and learning in the hippocampus: How fine spatial and temporal scales are expanded into population codes for behavioral control , 2007, Neural Networks.

[42]  Matthijs A. A. van der Meer,et al.  Expectancies in Decision Making, Reinforcement Learning, and Ventral Striatum , 2009, Frontiers in neuroscience.

[43]  Bob Fisher,et al.  Visual Control of an Autonomous Indoor Robotic Blimp , 2013 .

[44]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  Mark Witkowski,et al.  An Action-Selection Calculus , 2007, Adapt. Behav..

[46]  T. Robbins,et al.  The hippocampal–striatal axis in learning, prediction and goal-directed behavior , 2011, Trends in Neurosciences.

[47]  Robin R. Murphy,et al.  Introduction to AI Robotics , 2000 .

[48]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[49]  Thomas Yarrow,et al.  Local and Global , 2011 .

[50]  Stefan Wermter,et al.  A hybrid probabilistic neural model for person tracking based on a ceiling-mounted camera , 2011, J. Ambient Intell. Smart Environ..

[51]  Gordon Wyeth,et al.  RatSLAM: a hippocampal model for simultaneous localization and mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[52]  D. Wolpert,et al.  Principles of sensorimotor learning , 2011, Nature Reviews Neuroscience.

[53]  Marc Toussaint,et al.  A Sensorimotor Map: Modulating Lateral Interactions for Anticipation and Planning , 2006, Neural Computation.

[54]  Yong Jeong,et al.  Spatial cognition , 2004, Neurology.

[55]  J. Taube Head direction cells recorded in the anterior thalamic nuclei of freely moving rats , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[56]  Stefan Wermter,et al.  Appearance-based localization for mobile robots using digital zoom and visual compass , 2008, Robotics Auton. Syst..

[57]  P. E. Sharp,et al.  Head direction, place, and movement correlates for cells in the rat retrosplenial cortex. , 2001, Behavioral neuroscience.

[58]  Olivier Sigaud,et al.  From Motor Learning to Interaction Learning in Robots , 2010, From Motor Learning to Interaction Learning in Robots.

[59]  Cornelius Weber,et al.  From Exploration to Planning , 2008, ICANN.