An Automatic 3D Textured Model Building Method Using Stripe Structured Light System

This paper presents a novel textured model building method using stripe structured light system. It is implemented by automatic registration of multiple point clouds obtained by the structured light system. Firstly, point clouds captured from different viewpoints are pairwise coarsely registered by feature matching of their corresponding RGB images. Secondly, we use an appropriate function to evaluate the quality of every pairwise coarse registration, and construct a pairwise coarse registration graph which uses point clouds as nodes and the evaluation function between them to weight their corresponding edges. Thirdly, an optimal registration tree will be generated by finding the maximum weight spanning tree of the graph and selecting a node as the root to minimize the depth of the tree. Finally, global fine registration is performed by applying ICP algorithm along the optimal registration tree. Median filtering in luminance space is also applied in the color of the integrated point model to adjust the RGB values. Experiment shows that this approach can automatically build full models which are well-registered and compatible in color for textured objects even when those objects are not rich in geometrical information.

[1]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[2]  Luc Van Gool,et al.  Hough Transform and 3D SURF for Robust Three Dimensional Classification , 2010, ECCV.

[3]  Sam Van der Jeught,et al.  Real-time structured light profilometry: a review , 2016 .

[4]  Wolfgang Straßer,et al.  Registration of colored 3D point clouds with a Kernel-based extension to the normal distributions transform , 2008, 2008 IEEE International Conference on Robotics and Automation.

[5]  Hao Men,et al.  Color point cloud registration with 4D ICP algorithm , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Ko Nishino,et al.  Scale-Dependent/Invariant Local 3D Shape Descriptors for Fully Automatic Registration of Multiple Sets of Range Images , 2008, ECCV.

[8]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[9]  Nico Blodow,et al.  Fast Point Feature Histograms (FPFH) for 3D registration , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  George Vosselman,et al.  Mapping Indoor Spaces by Adaptive Coarse-to-Fine Registration of RGB-D Data , 2016, IEEE Geoscience and Remote Sensing Letters.

[11]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[13]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[14]  David K. Wehe,et al.  Multiview registration of 3D scenes by minimizing error between coordinate frames , 2004 .

[15]  Nico Blodow,et al.  Aligning point cloud views using persistent feature histograms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Zhan Song,et al.  An accurate 3D point cloud registration approach for the turntable-based 3D scanning system , 2015, 2015 IEEE International Conference on Information and Automation.

[17]  Joaquim Salvi,et al.  A state of the art in structured light patterns for surface profilometry , 2010, Pattern Recognit..

[18]  Christoph Heindl,et al.  Capturing Photorealistic and Printable 3D Models Using Low-Cost Hardware , 2016, ISVC.

[19]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[20]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[21]  Wang Jun,et al.  LiDAR point cloud registration based on improved ICP method and SIFT feature , 2015, 2015 IEEE International Conference on Progress in Informatics and Computing (PIC).