Statistical Analysis-Based Error Models for the Microsoft Kinect™ Depth Sensor

The stochastic error characteristics of the Kinect sensing device are presented for each axis direction. Depth (z) directional error is measured using a flat surface, and horizontal (x) and vertical (y) errors are measured using a novel 3D checkerboard. Results show that the stochastic nature of the Kinect measurement error is affected mostly by the depth at which the object being sensed is located, though radial factors must be considered, as well. Measurement and statistics-based models are presented for the stochastic error in each axis direction, which are based on the location and depth value of empirical data measured for each pixel across the entire field of view. The resulting models are compared against existing Kinect error models, and through these comparisons, the proposed model is shown to be a more sophisticated and precise characterization of the Kinect error distributions.

[1]  Mau-Tsuen Yang,et al.  Fall Risk Assessment and Early-Warning for Toddler Behaviors at Home , 2013, Sensors.

[2]  Peter A. Beling,et al.  A probability of error-constrained sequential decision algorithm for data-rich automatic target recognition , 2010, Defense + Commercial Sensing.

[3]  Peter A. Beling,et al.  Efficacy of statistical model-based pose estimation of rigid objects with corresponding CAD models using commodity depth sensors , 2014, IECON 2014 - 40th Annual Conference of the IEEE Industrial Electronics Society.

[4]  Keum-Bae Cho,et al.  Intelligent Lead: A Novel HRI Sensor for Guide Robots , 2012, Sensors.

[5]  Christian Messier,et al.  Assessing the Potential of Low-Cost 3D Cameras for the Rapid Measurement of Plant Woody Structure , 2013, Sensors.

[6]  Juho Kannala,et al.  Joint Depth and Color Camera Calibration with Distortion Correction , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Fabio Menna,et al.  Geometric investigation of a gaming active device , 2011, Optical Metrology.

[8]  Modesto Castrillón Santana,et al.  On the Use of a Low-Cost Thermal Sensor to Improve Kinect People Detection in a Mobile Robot , 2013, Sensors.

[9]  Sebastian Thrun,et al.  Unsupervised extrinsic calibration of depth sensors in dynamic scenes , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  George Azzari,et al.  Rapid Characterization of Vegetation Structure with a Microsoft Kinect Sensor , 2013, Sensors.

[11]  Zhengyou Zhang,et al.  Calibration between depth and color sensors for commodity depth cameras , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[12]  Erkan Besdok,et al.  3D Vision by Using Calibration Pattern with Inertial Sensor and RBF Neural Networks , 2009, Sensors.

[13]  Henry Fuchs,et al.  Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[14]  Xin Zhou,et al.  Statistical models for target detection in infrared imagery , 2007, SPIE Defense + Commercial Sensing.

[15]  Derek D. Lichti,et al.  Photogrammetric Bundle Adjustment With Self-Calibration of the PrimeSense 3D Camera Technology: Microsoft Kinect , 2013, IEEE Access.

[16]  Carlos Sagüés,et al.  Human-Computer Interaction Based on Hand Gestures Using RGB-D Sensors , 2013, Sensors.

[17]  Shahram Izadi,et al.  Modeling Kinect Sensor Noise for Improved 3D Reconstruction and Tracking , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[18]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.