Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications

Consumer-grade range cameras such as the Kinect sensor have the potential to be used in mapping applications where accuracy requirements are less strict. To realize this potential insight into the geometric quality of the data acquired by the sensor is essential. In this paper we discuss the calibration of the Kinect sensor, and provide an analysis of the accuracy and resolution of its depth data. Based on a mathematical model of depth measurement from disparity a theoretical error analysis is presented, which provides an insight into the factors influencing the accuracy of the data. Experimental results show that the random error of depth measurement increases with increasing distance to the sensor, and ranges from a few millimeters up to about 4 cm at the maximum range of the sensor. The quality of the data is also found to be influenced by the low resolution of the depth measurements.

[1]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Clive S. Fraser,et al.  Digital camera self-calibration , 1997 .

[5]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[6]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[7]  Zhilin Li,et al.  A Split-and-Merge Technique for Automated Reconstruction of Roof Planes , 2005 .

[8]  Timo Kahlmann,et al.  CALIBRATION FOR INCREASED ACCURACY OF THE RANGE IMAGING CAMERA SWISSRANGER , 2006 .

[9]  Stefan Müller,et al.  Hand Gesture Recognition with a Novel IR Time-of-Flight Range Camera-A Pilot Study , 2007, MIRAGE.

[10]  T. Kahlmann,et al.  Calibration and development for increased accuracy of 3D range imaging cameras , 2008 .

[11]  Andrew D. Wilson.  Using a depth camera as a touch sensor , 2010, ITS '10.

[12]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[13]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[14]  Kourosh Khoshelham,et al.  Automated localization of a laser scanner in indoor environments using planar objects , 2010, 2010 International Conference on Indoor Positioning and Indoor Navigation.

[15]  Alon Lerner,et al.  Enhanced interactive gaming by blending full-body tracking and gesture animation , 2010, SA '10.

[16]  Kourosh Khoshelham,et al.  Assessment of Relative Accuracy of AHN-2 Laser Scanning Data Using Planar Features , 2010, Sensors.

[17]  Yao-Jen Chang,et al.  A Kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. , 2011, Research in developmental disabilities.

[18]  Mozhdeh Shahbazi,et al.  Range Camera Self-Calibration Based on Integrated Bundle Adjustment via Joint Setup with a 2D Digital Camera , 2011, Sensors.

[19]  Fabio Menna,et al.  Geometric investigation of a gaming active device , 2011, Optical Metrology.

[20]  Nicolas Riche,et al.  3D Saliency for Abnormal Motion Selection: The Role of the Depth Map , 2011, ICVS.

[21]  Michael Hayes,et al.  Altitude control of a quadrotor helicopter using depth map from Microsoft Kinect sensor , 2011, 2011 IEEE International Conference on Mechatronics.

[22]  Patrick Benavidez,et al.  Mobile robot navigation and target tracking system , 2011, 2011 6th International Conference on System of Systems Engineering.

[23]  Dieter Fox,et al.  Toward object discovery and modeling via 3-D scene comparison , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Günther Greiner,et al.  Automatic reconstruction of personalized avatars from 3D face scans , 2011, Comput. Animat. Virtual Worlds.

[25]  Janis Fehr,et al.  Computing Range Flow from Multi-modal Kinect Data , 2011, ISVC.

[26]  William D. Smart,et al.  Using depth information to improve face detection , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Darko Kirovski,et al.  Real-time classification of dance gestures from skeleton animation , 2011, SCA '11.

[28]  M. Menenti,et al.  Influence of range measurement noise on roughness characterization of rock surfaces using terrestrial laser scanning , 2011 .

[29]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.