A Coarse-to-Fine Algorithm for Registration in 3D Street-View Cross-Source Point Clouds

With the development of numerous 3D sensing technologies, object registration on cross-source point cloud has aroused researchers' interests. When the point clouds are captured from different kinds of sensors, there are large and different kinds of variations. In this study, we address an even more challenging case in which the differently-source point clouds are acquired from a real street view. One is produced directly by the LiDAR system and the other is generated by using VSFM software on image sequence captured from RGB cameras. When it confronts to large scale point clouds, previous methods mostly focus on point-to-point level registration, and the methods have many limitations.The reason is that the least mean error strategy shows poor ability in registering large variable cross-source point clouds. In this paper, different from previous ICP-based methods, and from a statistic view, we propose a effective coarse-to-fine algorithm to detect and register a small scale SFM point cloud in a large scale Lidar point cloud. Seen from the experimental results, the model can successfully run on LiDAR and SFM point clouds, hence it can make a contribution to many applications, such as robotics and smart city development.

[1]  JianBing,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011 .

[2]  Qiang Wu,et al.  Real Time Complete Dense Depth Reconstruction for a Monocular Camera , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Sang Wook Lee,et al.  ICP Registration Using Invariant Features , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Hidekata Hontani,et al.  Point-based non-rigid surface registration with accuracy estimation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Baba C. Vemuri,et al.  Robust Point Set Registration Using Gaussian Mixture Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Kiyoharu Aizawa,et al.  Advances in Multimedia Information Processing - PCM 2004, 5th Pacific Rim Conference on Multimedia, Tokyo, Japan, November 30 - December 3, 2004, Proceedings, Part I , 2005, Pacific Rim Conference on Multimedia.

[7]  David J. Fleet,et al.  Computer Vision – ECCV 2014 , 2014, Lecture Notes in Computer Science.

[8]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Markus Vincze,et al.  Ensemble of shape functions for 3D object classification , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[10]  Radu Horaud,et al.  A Generative Model for the Joint Registration of Multiple Point Sets , 2014, ECCV.

[11]  Jian Zhang,et al.  Graph Cuts Stereo Matching Based on Patch-Match and Ground Control Points Constraint , 2015, PCM.

[12]  Qiang Wu,et al.  Dense Correspondence Using Non-Local DAISY Forest , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[13]  Qiang Wu,et al.  Street view cross-sourced point cloud matching and registration , 2014, 2014 IEEE International Conference on Image Processing (ICIP).