ViTa-SLAM: A Bio-inspired Visuo-Tactile SLAM for Navigation while Interacting with Aliased Environments

RatSLAM is a rat hippocampus-inspired visual Simultaneous Localization and Mapping (SLAM) framework capable of generating semi-metric topological representations of indoor and outdoor environments. Whisker-RatSLAM is a 6D extension of the RatSLAM and primarily focuses on object recognition by generating point clouds of objects based on tactile information from an array of biomimetic whiskers. This paper introduces a novel extension to both former works that is referred to as ViTa-SLAM that harnesses both vision and tactile information for performing SLAM. This not only allows the robot to perform natural interactions with the environment whilst navigating, as is normally seen in nature, but also provides a mechanism to fuse non-unique tactile and unique visual data. Compared to the former works, our approach can handle ambiguous scenes in which one sensor alone is not capable of identifying false-positive loop-closures.

[1]  James M. Rehg,et al.  Combining tactile sensing and vision for rapid haptic mapping , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[3]  Gordon Wyeth,et al.  Experience mapping: Producing spatially continuous environment representations using RatSLAM , 2005 .

[4]  Eckehard Steinbach,et al.  Haptic Exploration for Navigation Tasks using a Visuo-Haptic Sensor , 2013 .

[5]  Anthony G. Pipe,et al.  Whisking with robots , 2009, IEEE Robotics & Automation Magazine.

[6]  Cyrill Stachniss,et al.  On measuring the accuracy of SLAM algorithms , 2009, Auton. Robots.

[7]  Jan Steckel,et al.  BatSLAM: Simultaneous Localization and Mapping Using Biomimetic Sonar , 2013, PloS one.

[8]  DaeEun Kim,et al.  Biomimetic whiskers for shape recognition , 2007, Robotics Auton. Syst..

[9]  Michael Milford.  Robot Navigation from Nature - Simultaneous Localisation, Mapping, and Path Planning based on Hippocampal Models , 2008, Springer Tracts in Advanced Robotics.

[10]  Michael Milford,et al.  Biologically inspired SLAM using Wi-Fi , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  David Ball,et al.  Maintaining a Cognitive Map in Darkness: The Need to Fuse Boundary Knowledge with Path Integration , 2012, PLoS Comput. Biol..

[12]  Eckehard G. Steinbach,et al.  Navigation and Manipulation Planning Using a Visuo-Haptic Sensor on a Mobile Platform , 2014, IEEE Transactions on Instrumentation and Measurement.

[13]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[14]  Ben Mitchinson,et al.  Feedback control in active sensing: rat exploratory whisking is modulated by environmental contact , 2007, Proceedings of the Royal Society B: Biological Sciences.

[15]  Jitendra Malik,et al.  More Than a Feeling: Learning to Grasp and Regrasp Using Vision and Touch , 2018, IEEE Robotics and Automation Letters.

[16]  Anthony G. Pipe,et al.  Simultaneous localisation and mapping on a multi-degree of freedom biomimetic whiskered robot , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Martin J. Pearson,et al.  Whisker-RatSLAM Applied to 6D Object Identification and Spatial Localisation , 2018, Living Machines.

[18]  Martin J. Pearson,et al.  Advancing whisker based navigation through the implementation of Bio-Inspired whisking strategies , 2016, 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[19]  Nico Blodow,et al.  Learning informative point classes for the acquisition of object model maps , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[20]  Mathew H. Evans,et al.  Tactile Discrimination Using Active Whisker Sensors , 2012, IEEE Sensors Journal.

[21]  Janet Wiles,et al.  OpenRatSLAM: an open source brain-based SLAM system , 2013, Autonomous Robots.

[22]  Kshitij Tiwari,et al.  ViTa-SLAM: Biologically-Inspired Visuo-Tactile SLAM , 2019, ArXiv.

[23]  T. Prescott,et al.  Active touch sensing in the rat: anticipatory and regulatory control of whisker movements during surface exploration. , 2009, Journal of neurophysiology.

[24]  Anthony G. Pipe,et al.  Whiskered robots , 2015, Scholarpedia.

[25]  Tony J. Prescott,et al.  Whisker Movements Reveal Spatial Attention: A Unified Computational Model of Active Sensing Control in the Rat , 2013, PLoS Comput. Biol..

[26]  Abhinav Gupta,et al.  The Curious Robot: Learning Visual Representations via Physical Interactions , 2016, ECCV.

[27]  Gordon Wyeth,et al.  Mapping a Suburb With a Single Camera Using a Biologically Inspired SLAM System , 2008, IEEE Transactions on Robotics.

[28]  Michael Milford,et al.  Brain-inspired sensor fusion for navigating robots , 2013, 2013 IEEE International Conference on Robotics and Automation.