Vision-Based Kidnap Recovery with SLAM for Home Cleaning Robots

Emerged as salient in the recent home appliance consumer market is a new generation of home cleaning robot featuring the capability of Simultaneous Localization and Mapping (SLAM). SLAM allows a cleaning robot not only to self-optimize its work paths for efficiency but also to self-recover from kidnappings for user convenience. By kidnapping, we mean that a robot is displaced, in the middle of cleaning, without its SLAM aware of where it moves to. This paper presents a vision-based kidnap recovery with SLAM for home cleaning robots, the first of its kind, using a wheel drop switch and an upward-looking camera for low-cost applications. In particular, a camera with a wide-angle lens is adopted for a kidnapped robot to be able to recover its pose on a global map with only a single image. First, the kidnapping situation is effectively detected based on a wheel drop switch. Then, for an efficient kidnap recovery, a coarse-to-fine approach to matching the image features detected with those associated with a large number of robot poses or nodes, built as a map in graph representation, is adopted. The pose ambiguity, e.g., due to symmetry is taken care of, if any. The final robot pose is obtained with high accuracy from the fine level of the coarse-to-fine hierarchy by fusing poses estimated from a chosen set of matching nodes. The proposed method was implemented as an embedded system with an ARM11 processor on a real commercial home cleaning robot and tested extensively. Experimental results show that the proposed method works well even in the situation in which the cleaning robot is suddenly kidnapped during the map building process.

[1]  Kurt Konolige,et al.  Incremental mapping of large cyclic environments , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[2]  Kyoung Mu Lee,et al.  CV-SLAM: a new ceiling vision-based SLAM technique , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[4]  Sebastian Thrun,et al.  Bayesian Landmark Learning for Mobile Robot Localization , 1998, Machine Learning.

[5]  Jelle Veraart,et al.  Mobile Camera Localization Using Apollonius Circles and Virtual Landmarks , 2010, J. Intell. Robotic Syst..

[6]  H. Sorenson,et al.  NONLINEAR FILTERING BY APPROXIMATION OF THE A POSTERIORI DENSITY , 1968 .

[7]  Roland Siegwart,et al.  A relative map approach to SLAM based on shift and rotation invariants , 2007, Robotics Auton. Syst..

[8]  Wolfram Burgard,et al.  MINERVA: a second-generation museum tour-guide robot , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[9]  Zhengyou Zhang,et al.  Determining the Epipolar Geometry and its Uncertainty: A Review , 1998, International Journal of Computer Vision.

[10]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[11]  Gordon Wyeth,et al.  Robust outdoor visual localization using a three‐dimensional‐edge map , 2009, J. Field Robotics.

[12]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[13]  Evangelos E. Milios,et al.  Globally Consistent Range Scan Alignment for Environment Mapping , 1997, Auton. Robots.

[14]  Wolfram Burgard,et al.  A Tree Parameterization for Efficiently Computing Maximum Likelihood Maps using Gradient Descent , 2007, Robotics: Science and Systems.

[15]  Henrik I. Christensen,et al.  Vision SLAM in the Measurement Subspace , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[16]  Panos E. Trahanias,et al.  Hybrid mobile robot localization using switching state-space models , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[17]  Ana Cristina Murillo,et al.  SURF features for efficient robot localization with omnidirectional images , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[18]  James J. Little,et al.  Vision-based global localization and mapping for mobile robots , 2005, IEEE Transactions on Robotics.

[19]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[20]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[21]  Andrea Gasparri,et al.  Monte Carlo Filter in Mobile Robotics Localization: A Clustered Evolutionary Point of View , 2006, J. Intell. Robotic Syst..

[22]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[23]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[24]  Michael Bosse,et al.  Vision-based localization using an edge map extracted from 3D laser range data , 2010, 2010 IEEE International Conference on Robotics and Automation.

[25]  Sukhan Lee,et al.  3D object recognition using multiple features for robotic manipulation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[26]  Wolfram Burgard,et al.  Robust vision-based localization by combining an image-retrieval system with Monte Carlo localization , 2005, IEEE Transactions on Robotics.

[27]  Masahiro Iwahashi,et al.  Visual compensation in localization of a robot on a ceiling map , 2011 .

[28]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[29]  James L. Crowley,et al.  Mathematical Foundations of Navigation and Perception for an Autonomous Mobile Robot , 1995, Reasoning with Uncertainty in Robotics.

[30]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[31]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[32]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[33]  Luis Moreno,et al.  Evolutionary filter for robust mobile robot global localization , 2006, Robotics Auton. Syst..

[34]  Kurt Konolige,et al.  SLAM via Variable Reduction from Constraint Maps , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[35]  Wolfram Burgard,et al.  Visual SLAM for Flying Vehicles , 2008, IEEE Transactions on Robotics.