Handheld scanning with 3D cameras

Novel real-time depth acquisition devices, like Microsoft Kinect, allow a very fast and simple acquisition of 3D views. These sensors have been used in many applications but their employment for 3D scanning purposes is a very challenging task due to the limited accuracy and reliability of their data. In this paper we present a 3D reconstruction pipeline explicitly targeted to the Kinect. The proposed scheme aims at obtaining a reliable reconstruction that is not affected by the limiting issues of these cameras and is at the same time simple and fast in order to allow to use the Kinect sensor as an handheld scanner. In order to achieve these targets a novel algorithm for the extraction of salient points exploiting both depth and color data is firstly used. The extracted points are then used within a modified version of the ICP algorithm that exploits both geometry and color distances to precisely align the views produced by the Kinect even when the geometry information is not sufficient to constrain the registration. Experimental results show how the proposed approach is able to produce reliable 3D reconstructions from the Kinect data.

[1]  John J. Leonard,et al.  Robust Tracking for Real-Time Dense RGB-D Mapping with Kintinuous , 2012 .

[2]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Guido M. Cortelazzo,et al.  Time-of-Flight Cameras and Microsoft Kinect™ , 2012, Springer Briefs in Electrical and Computer Engineering.

[4]  Nassir Navab,et al.  Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[6]  Dieter Fritsch,et al.  CO-REGISTRATION OF KINECT POINT CLOUDS BASED ON IMAGE AND OBJECT SPACE OBSERVATIONS , 2013 .

[7]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Andrea Torsello,et al.  Sampling Relevant Points for Surface Registration , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[9]  Kourosh Khoshelham,et al.  Accuracy analysis of kinect depth data , 2012 .

[10]  Ligang Liu,et al.  Scanning 3D Full Human Bodies Using Kinects , 2012, IEEE Transactions on Visualization and Computer Graphics.

[11]  Dieter Fox,et al.  RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments , 2012, Int. J. Robotics Res..

[12]  Joachim Hertzberg,et al.  An Explicit Loop Closing Technique for 6D SLAM , 2009, ECMR.

[13]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.