Calibration of multiple kinects with little overlap regions

When using multiple Kinects, there must be enough distances among neighboring Kinects to avoid spoiled range data caused by the interference of their infrared speckle patterns. In the arrangement, their overlapped regions are too small to apply existing calibration methods using correspondences between their observations straightforwardly. Therefore, we propose a method to calibrate Kinects without large overlapped regions. In our method, first, we add extra RGB cameras in an environment to compensate overlapped regions. Thanks to them, we can estimate their camera parameters by obtaining correspondences between color images. Next, for accurate calibration, which considers range data as well as color images of Kinects, we optimize the estimated parameters by minimizing both the errors of correspondences between color images and those of range data of planar regions, which exist in a general environment such as walls and floors. Although our method consists of conventional techniques, its combination is optimized to achieve the calibration. © 2015 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.

[1]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time dynamic 3D surface reconstruction and interaction , 2011, SIGGRAPH '11.

[2]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[4]  Marcus A. Magnor,et al.  Markerless Motion Capture using multiple Color-Depth Sensors , 2011, VMV.

[5]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  P. Payeur,et al.  Calibration of a network of Kinect sensors for robotic inspection over a large workspace , 2013, 2013 IEEE Workshop on Robot Vision (WORV).

[7]  Michel Dhome,et al.  Flexible extrinsic calibration of non-overlapping cameras using a planar mirror: Application to vision-based robotics , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Jake K. Aggarwal,et al.  Estimation of motion from a pair of range images: A review , 1991, CVGIP Image Underst..

[9]  Yasushi Yagi,et al.  Depth-based Gait Feature Representation , 2013, IPSJ Trans. Comput. Vis. Appl..

[10]  Franck Multon,et al.  Multiple depth cameras calibration and body volume reconstruction for gait analysis , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[11]  Hicham Hadj-Abdelkader,et al.  Fully automatic extrinsic calibration of RGB-D system using two views of natural scene , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[12]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[13]  Michael J. Black,et al.  Home 3D body scans from noisy image and range data , 2011, 2011 International Conference on Computer Vision.

[14]  Yasushi Makihara,et al.  Point cloud transport , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[15]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[16]  Jan-Michael Frahm,et al.  Simple calibration of non-overlapping cameras with a mirror , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Kai Oliver Arras,et al.  People detection in RGB-D data , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.