Evaluation of color and texture descriptors for matching of planar surfaces in global localization scheme

This paper presents a systematic study about the applicability of color/texture descriptors in a global localization system based on planar surface segments. Two comprehensive experiments regarding matching of planar surface segments and robot pose hypothesis evaluation were conducted. The experiments show that using color/texture descriptors to prune potential surface pairs in the initial correspondence phase and to provide additional information in the hypothesis evaluation phase of a feature-based localization scheme can result in considerable speedup of the localization process and help distinguish between geometrically similar places. An experimental benchmark which enables researchers to evaluate the performance of color and texture descriptors in the context of mobile robot localization based on planar surface segments is presented. Indoor global localization system based on planar segments with visual descriptors.Applicability of 6 color and 3 texture descriptors is systematically analyzed.Performance increase in initial correspondence and pose hypothesis evaluation phases.Evaluation benchmark for visual descriptors in global localization is proposed.

[1]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  Barbara Caputo,et al.  A realistic benchmark for visual indoor place recognition , 2010, Robotics Auton. Syst..

[5]  Xin Chen,et al.  Fast segmentation of range images into planar regions , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Roland Siegwart,et al.  3D SLAM using planar segments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Esra Ataer Cansizoglu,et al.  Tracking an RGB-D Camera Using Points and Planes , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[9]  Damir Filko,et al.  Fast Pose Tracking Based on Ranked 3D Planar Patch Correspondences , 2012, SyRoCo.

[10]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[11]  Xianghua Xie,et al.  A Galaxy of Texture Features , 2008 .

[12]  Ramin Zabih,et al.  Comparing images using joint histograms , 1999, Multimedia Systems.

[13]  Donald A. Adjeroh,et al.  Comparison of Texture Analysis Schemes Under Nonideal Conditions , 2011, IEEE Transactions on Image Processing.

[14]  Javier González,et al.  Fast place recognition with plane-based maps , 2013, 2013 IEEE International Conference on Robotics and Automation.

[15]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[17]  Jörg Stückler,et al.  Multi-resolution surfel maps for efficient dense 3D modeling and tracking , 2014, J. Vis. Commun. Image Represent..

[18]  Joost van de Weijer,et al.  Color in Computer Vision: Fundamentals and Applications , 2012 .

[19]  Il Hong Suh,et al.  Place recognition using straight lines for vision-based SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[20]  Damir Filko,et al.  Place recognition based on matching of planar surfaces and line segments , 2015, Int. J. Robotics Res..

[21]  Paul Newman,et al.  Highly scalable appearance-only SLAM - FAB-MAP 2.0 , 2009, Robotics: Science and Systems.

[22]  Guang-Zhong Yang,et al.  Feature Co-occurrence Maps: Appearance-based localisation throughout the day , 2013, 2013 IEEE International Conference on Robotics and Automation.

[23]  Michael Milford,et al.  Vision-based place recognition: how low can you go? , 2013, Int. J. Robotics Res..

[24]  Andreas Birk,et al.  Fast Registration Based on Noisy Planes With Unknown Correspondences for 3-D Mapping , 2010, IEEE Transactions on Robotics.

[25]  Michael Garland,et al.  Hierarchical face clustering on polygonal surfaces , 2001, I3D '01.

[26]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[27]  Vicente Arévalo,et al.  A compact planar-patch descriptor based on color , 2014, 2014 11th International Conference on Informatics in Control, Automation and Robotics (ICINCO).

[28]  Rüdiger Dillmann,et al.  Sequential 3D-SLAM for mobile action planning , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[29]  Rüdiger Dillmann,et al.  Using Orthogonal Surface Directions for Autonomous 3D-Exploration of Indoor Environments , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Andreas Birk,et al.  Utilizing color information in 3D scan-registration using planar-patches matching , 2012, 2012 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI).

[31]  Damir Filko,et al.  Global Localization Based on 3D Planar Surface Segments , 2013, ArXiv.

[32]  Paul Newman,et al.  Appearance-only SLAM at large scale with FAB-MAP 2.0 , 2011, Int. J. Robotics Res..

[33]  John J. Leonard,et al.  Deformation-based loop closure for large scale dense RGB-D SLAM , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.