INTEGRATED RANGE CAMERA CALIBRATION USING IMAGE SEQUENCES FROM HAND-HELD OPERATION

This article concentrates on the integrated self-calibration of both the interior orientation and the distance measurement system of a time-of-flight range camera that employs amplitude-modulated, continuous-wave, near-infrared light (photonic mixer device PMD). In contrast to other approaches that conduct specialized experiments for the investigation of individual, potential distortion factors, in the presented approach all calculations are based on the same data set being captured under near-real-world conditions, guided by hand and without auxiliary devices serving as high-order reference. Flat, circular targets stuck on a planar whiteboard and with known positions are automatically tracked throughout the amplitude layer of long image sequences. These image observations are introduced into a bundle block adjustment, which on the one hand results in the determination of the camera’s interior orientation and its temporal variation. On the other hand, the reconstructed exterior orientations and the known planarity of the imaged board allow for the derivation of reference values of the actual distance observations. These deviations are checked on relations with the reference distance itself, the observed signal amplitude, the integration time, the angle of incidence, and with both the position in the field of view and in object space. Eased by the automatic reconstruction of the camera’s trajectory and attitude, several thousand frames are processed, leading to comprehensive statistics.

[1]  Peter Seitz,et al.  The multitap lock-in CCD with offset subtraction , 1997 .

[2]  Alice Biber,et al.  Time-of-flight range imaging with a custom solid state image sensor , 1999, Industrial Lasers and Inspection.

[3]  Andrew M. Wallace,et al.  3D imaging and ranging by time-correlated single photon counting , 2001 .

[4]  Ludwig Listl,et al.  Fast range imaging by CMOS sensor array through multiple double short time integration (MDSI) , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  Clive S. Fraser,et al.  Precision Target Mensuration in Vision Metrology , 2004 .

[6]  Richard D. Richmond,et al.  Eye-safe laser radar 3D imaging , 2001, SPIE Defense + Commercial Sensing.

[7]  Thierry Oggier,et al.  CCD / CMOS Lock-In Pixel for Range Imaging : Challenges , Limitations and State-ofthe-Art , 2005 .

[8]  Timo Kahlmann,et al.  CALIBRATION FOR INCREASED ACCURACY OF THE RANGE IMAGING CAMERA SWISSRANGER , 2006 .

[9]  Andreas Kolb,et al.  Lateral and Depth Calibration of PMD-Distance Sensors , 2006, ISVC.

[10]  Andreas Kolb,et al.  Calibration of the intensity-related distance error of the PMD TOF-camera , 2007, SPIE Optics East.

[11]  David Stoppa,et al.  A CMOS Range Camera based on Single Photon Avalanche Diodes (CMOS-Range-Kamera mit Single-Photon-Avalanche-Photodioden) , 2007 .

[12]  Edoardo Charbon,et al.  3D Imaging based on Single Photon Detectors , 2007 .

[13]  Heinz Hügli,et al.  Real-time scattering compensation for time-of-flight camera , 2007, ICVS 2007.

[14]  Wilfried KAREL,et al.  IN SITU DETERMINATION OF RANGE CAMERA QUALITY PARAMETERS BY SEGMENTATION , 2007 .

[15]  Timo Kahlmann,et al.  Range imaging metrology: Investigation, calibration and development , 2008 .

[16]  W. Cao,et al.  The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXVIII-4/C7 CLASSIFICATION OF HIGH RESOLUTION OPTICAL AND SAR FUSION IMAGE USING FUZZY KNOWLEDGE AND OBJECT-ORIENTED PARADIGM , 2010 .