Detailed modeling and calibration of a Time-of-Flight camera

In this paper we propose a physically motivated sensor model of Time-of-Flight cameras. We provide methods to calibrate our proposed model and compensate all modeled effects. This enables us to reliably detect and filter out inconsistent measurements and to record high dynamic range (HDR) images. We believe that HDR images have a significant benefit especially for mapping narrow-spaced environments as in urban search and rescue. We provide methods to invert our model in real-time and gain significantly higher precision than using the vendor-provided sensor driver. In contrast to previously published purely phenomenological calibration methods our model is physically motivated and thus better captures the structure of the different effects involved.

[1]  Gerd Hirzinger,et al.  Extrinsic and depth calibration of ToF-cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Manuel Mazo,et al.  Modelling and correction of multipath interference in time of flight cameras , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .

[4]  Timo Kahlmann,et al.  CALIBRATION FOR INCREASED ACCURACY OF THE RANGE IMAGING CAMERA SWISSRANGER , 2006 .

[5]  Andreas Nüchter,et al.  Robust 3D-mapping with time-of-flight cameras , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[7]  Andreas Kolb,et al.  Lateral and Depth Calibration of PMD-Distance Sensors , 2006, ISVC.

[8]  Jörg Krüger,et al.  Identification and correction of flying pixels in range camera data , 2008, SCCG.

[9]  Jochen Frey,et al.  Robust 3 D Measurement with PMD Sensors , 2005 .

[10]  Stefan May,et al.  Calibration and registration for precise surface reconstruction with Time-Of-Flight cameras , 2008, Int. J. Intell. Syst. Technol. Appl..

[11]  Heinz Hügli,et al.  Optimized scattering compensation for time-of-flight camera , 2007, SPIE Optics East.

[12]  Nassir Navab,et al.  SLAM combining ToF and high-resolution cameras , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[13]  Udo Frese,et al.  Integrating generic sensor fusion algorithms with sound state representations through encapsulation of manifolds , 2011, Inf. Fusion.

[14]  Roland Siegwart,et al.  A state-of-the-art 3D sensor for robot navigation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).