Multi-Kinect scene reconstruction: Calibration and depth inconsistencies

We investigated calibration procedures of multiple Kinect sensors simultaneously. Through standard calibration algorithms our multi-Kinect system is accurately registered. We propose and implemented a multi-Kinect system to seamlessly render a scene from a wide range of angles. Such a system is capable of real-time operation. We also investigated the problem of inconsistent depth measurement between different Kinect units, and arrived at the same conclusion as the state-of-the-art regarding the characteristics of depth measurement errors in the Kinect sensor. In order to compensate these errors for live acquisition and display of multi-Kinect systems, we introduced an offline ICP calibration of multiple Kinect data. Our experimental results provide a robust way to properly align multiple Kinect data.

[1]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[2]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Wei Sun,et al.  Requirements for Camera Calibration: Must Accuracy Come with a High Price? , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[4]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  Andreas Geiger,et al.  Automatic camera and range sensor calibration using a single shot , 2012, 2012 IEEE International Conference on Robotics and Automation.

[7]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[9]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Daniel Herrera C,et al.  Joint depth and color camera calibration with distortion correction. , 2012, IEEE transactions on pattern analysis and machine intelligence.

[11]  알렉산더 쉬푼트,et al.  Depth-varying light fields for three dimensional sensing , 2007 .

[12]  Zhengyou Zhang,et al.  Calibration between depth and color sensors for commodity depth cameras , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[13]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[14]  A. Verri,et al.  A compact algorithm for rectification of stereo pairs , 2000 .