Study on indoor robot of self-localization based on RGB-D sensor

In order to solve the localization problem of the simultaneous localization and mapping (SLAM), a method of indoor robot's self-localization algorithm based on RGB-D sensor was proposed. Firstly, the feature points set were extracted from the environment pictures by SURF (Speed Up Robust Features) method and the corresponding matching points were found using nearest neighbor method. Secondly, the matching points' 3D data were reconstructed by using a combination of vision data and depth data. Thirdly, the robot's movement parameters which are consisted of rotation matrix and transport vector are estimated by SVD and optimized by ICP algorithm. Finally, experimental results indicated the validation of the proposed method.

[1]  Tomohiro Umetani,et al.  Localization System using Microsoft Kinect for Indoor Structures , 2012 .

[2]  Ian D. Reid,et al.  Mapping Large Loops with a Single Hand-Held Camera , 2007, Robotics: Science and Systems.

[3]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[4]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Kourosh Khoshelham,et al.  Accuracy analysis of kinect depth data , 2012 .

[6]  Huei-Yung Lin,et al.  Mobile robot localization using ceiling landmarks and images captured from an RGB-D camera , 2012, 2012 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  Olivier Stasse,et al.  Online object search with a humanoid robot , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[10]  Joachim Hertzberg,et al.  Three‐dimensional mapping with time‐of‐flight cameras , 2009, J. Field Robotics.

[11]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[12]  Paul Newman,et al.  Navigating, Recognizing and Describing Urban Spaces With Vision and Lasers , 2009, Int. J. Robotics Res..

[13]  He Bingwei,et al.  Determination of the Common View Field in Hybrid Vision System and 3D Reconstruction Method , 2011 .

[14]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[15]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[16]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .