Point cloud registration with 2D and 3D fusion information on mobile robot integrated vision system

Multi-view point clouds registration method based on the 2D and 3D fusion information is proposed. First the joint calibration of the CCD camera and 3D laser radar system is conducted to fuse the image information and range information. Then, matching feature points in the images are obtained with the SIFT algorithm. Based on the joint calibration results and the images feature matching points, the point clouds feature matching points are determined. After that, the initial value of the different view point cloud space transform is calculated with the RANSAC, and ICP algorithm is adopted to optimize the results. Finally, the proposed method was implemented on a mobile robot and verified effective in the experiment.

[1]  Xu Zhang,et al.  Projector calibration from the camera image point of view , 2009 .

[2]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  T Rabbani Shah,et al.  Automatic point cloud registration using constrained search for corresponding objects , 2005 .

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Hans-Hellmut Nagel,et al.  Analytical Results on Error Sensitivity of Motion Estimation from Two Views , 1990, ECCV.

[9]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[10]  P. Schönemann,et al.  A generalized solution of the orthogonal procrustes problem , 1966 .

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  George Vosselman,et al.  Experimental comparison of filter algorithms for bare-Earth extraction from airborne laser scanning point clouds , 2004 .

[13]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.