Place Recognition Based on Planar Surfaces Using Multiple RGB-D Images Taken From the same Position

This paper considers indoor place recognition based on matching of planar surfaces and straight edges extracted from depth images obtained by an RGB-D camera. The idea of using planar surfaces as landmarks for robot localization has already been investigated. In this paper, the advantage of using multiple RGB-D images acquired from the same viewpoint by a camera mounted on a pan-tilt head is addressed. This simple straightforward method of expanding the field of view of a standard RGB-D camera allows 3D models of the observed place to be built, which contain information about relative positions of geometric features that are not contained within a single camera FoV. A high recognition rate is achieved indicating the practical applicability of the investigated approach. A publicly available dataset for the evaluation of place recognition methods is created. Using this dataset, the ability of recognizing places from viewpoints that differ from those from which the model is built can be tested as well as robustness to scene and lighting changes.

[1]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[2]  Jiasheng Hao,et al.  Visual Search Based Indoor Localization in Low Light via RGB-D Camera , 2017 .

[3]  Michael Milford,et al.  Vision-based place recognition: how low can you go? , 2013, Int. J. Robotics Res..

[4]  Libor Preucil,et al.  Comparison of shape matching techniques for place recognition , 2013, 2013 European Conference on Mobile Robots.

[5]  Damir Filko,et al.  Place recognition based on matching of planar surfaces and line segments , 2015, Int. J. Robotics Res..

[6]  Paul Newman,et al.  Highly scalable appearance-only SLAM - FAB-MAP 2.0 , 2009, Robotics: Science and Systems.

[7]  Jörg Stückler,et al.  Distinctive 3D surface entropy features for place recognition , 2013, 2013 European Conference on Mobile Robots.

[8]  Rüdiger Dillmann,et al.  Using Orthogonal Surface Directions for Autonomous 3D-Exploration of Indoor Environments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Ren C. Luo,et al.  3D point cloud based indoor mobile robot in 6-DoF pose localization using Fast Scene Recognition and Alignment approach , 2016, 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[10]  Damir Filko,et al.  Global Localization Based on 3D Planar Surface Segments , 2013, ArXiv.

[11]  Javier González,et al.  Scene structure registration for localization and mapping , 2016, Robotics Auton. Syst..

[12]  Michael Garland,et al.  Hierarchical face clustering on polygonal surfaces , 2001, I3D '01.

[13]  Roland Siegwart,et al.  3D SLAM using planar segments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  John J. Leonard,et al.  Efficient scene simulation for robust monte carlo localization using an RGB-D camera , 2012, 2012 IEEE International Conference on Robotics and Automation.

[15]  Atsushi Yamashita,et al.  Detecting and solving the kidnapped robot problem using laser range finder and wifi signal , 2017, 2017 IEEE International Conference on Real-time Computing and Robotics (RCAR).

[16]  Dorian Gálvez-López,et al.  Bags of Binary Words for Fast Place Recognition in Image Sequences , 2012, IEEE Transactions on Robotics.

[17]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[18]  Adrian Hilton,et al.  A Statistical Geometric Framework for Reconstruction of Scene Models , 2000, BMVC.

[19]  Andreas Zell,et al.  Loop closure detection using depth images , 2013, 2013 European Conference on Mobile Robots.

[20]  Patrick Rives,et al.  A dense map building approach from spherical RGBD images , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[21]  Xin Chen,et al.  Fast segmentation of range images into planar regions , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[23]  Il Hong Suh,et al.  Place recognition using straight lines for vision-based SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[24]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[25]  Mark Whitty,et al.  Metric-based detection of robot kidnapping with an SVM classifier , 2015, Robotics Auton. Syst..