Iterative closest point based 3D object reconstruction using RGB-D acquisition devices

This paper introduces, and verifies the applicability of, a practical algorithm for creating 3D points clouds resembling objects, based on multiple RGB-D frames having been taken from different viewpoints, by the Kinect 2 camera. The experimental set-up is described, along with a certain variant of the process referred to as iterative closest point, being utilized for the latter purpose. Moreover, in order to achieve reliable and realistic representations of the objects, the noise involved in the initial result of the reconstruction procedure is removed through employing a high-pass filter mask, being aimed at detecting and excluding the outliers. The proposed method, based on the experiments whose results are reported in the paper, is computationally less costly than the relevant alternatives suggested in the literature heretofore, which is one of its fundamental contributions when dealing with real-time scenarios. The strengths and weaknesses of the proposed algorithm are discussed according to the results, where objects of various sorts, i.e. with different colors and types of materials and surface, are taken into account and investigated as case-studies.

[1]  Andrew Owens,et al.  SUN3D: A Database of Big Spaces Reconstructed Using SfM and Object Labels , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[3]  Kok-Lim Low Linear Least-Squares Optimization for Point-to-Plane ICP Surface Registration , 2004 .

[4]  Paul J. Besl,et al.  Method for registration of 3-D shapes , 1992, Other Conferences.

[5]  Didier Stricker,et al.  KinectAvatar: Fully Automatic Body Capture Using a Single Kinect , 2012, ACCV Workshops.

[6]  艾而帝,et al.  Microsoft Kinect 虛擬復健系統設計 , 2013 .

[7]  Kris Thielemans,et al.  STIR: Software for Tomographic Image Reconstruction Release 2 , 2006 .

[8]  Jianxiong Xiao,et al.  SUN RGB-D: A RGB-D scene understanding benchmark suite , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[10]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[11]  Tomás Pajdla,et al.  3D with Kinect , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[12]  Ian D. Reid,et al.  Dense Reconstruction Using 3D Object Shape Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Graham M. Gibson,et al.  A fast 3D reconstruction system with a low-cost camera accessory , 2015, Scientific Reports.

[14]  Gholamreza Anbarjafari,et al.  Real-time, automatic shape-changing robot adjustment and gender classification , 2016, Signal Image Video Process..

[15]  Gang Wang,et al.  Registration and Integration of Multiple Object Views for 3D Model Construction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Andrea Fossati,et al.  Consumer Depth Cameras for Computer Vision , 2013, Advances in Computer Vision and Pattern Recognition.

[17]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Wai-Man Pang,et al.  Enabling 3D online shopping with affordable depth scanned models , 2014, 2014 International Conference on Smart Computing.