Calibration of Time-of-Flight Cameras

This chapter describes the metric calibration of a time-of-flight camera including the internal parameters, and lens distortion. Once the camera has been calibrated, the 2D depth image can be transformed into a range map, which encodes the distance to the scene along each optical ray. It is convenient to use established calibration methods, which are based on images of a chequerboard pattern. The low resolution of the amplitude image, however, makes it difficult to detect the board reliably. Heuristic detection methods, based on connected image components, perform very poorly on this data. An alternative, geometrically principled method is introduced here, based on the Hough transform. The Hough method is compared to the standard OpenCV board-detection routine, by application to several hundred time-of-flight images. It is shown that the new method detects significantly more calibration boards, over a greater variety of poses, without any significant loss of accuracy.

[1]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[2]  Wei Wu,et al.  Recognition and location of the internal corners of planar checkerboard calibration pattern image , 2007, Appl. Math. Comput..

[3]  G. Granlund In search of a general picture processing operator , 1978 .

[4]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[5]  Radu Horaud,et al.  Projective alignment of range and parallax data , 2011, CVPR 2011.

[6]  Ruigang Yang,et al.  Fusion of time-of-flight depth and stereo for high accuracy depth maps , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Reinhard Koch,et al.  MixIn3D: 3D Mixed Reality with ToF-Camera , 2009, Dyn3D.

[8]  D Gonzalez-Aguilera,et al.  An Automatic Approach for Radial Lens Distortion Correction From a Single Image , 2011, IEEE Sensors Journal.

[9]  Heinz Hügli,et al.  Fusion of Time of Flight Camera Point Clouds , 2008 .

[10]  Fridtjof Stein,et al.  In-factory calibration of multiocular camera systems , 2004, SPIE Photonics Europe.

[11]  Luc Van Gool,et al.  The Cascaded Hough Transform as Support for Grouping and Finding Vanishing Points and Lines , 1997, AFPAC.

[12]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Reinhard Koch,et al.  Time‐of‐Flight Cameras in Computer Graphics , 2010, Comput. Graph. Forum.

[14]  Takeo Kanade,et al.  Accurate camera calibration using iterative refinement of control points , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[15]  Marc Alexa,et al.  Depth Imaging by Combining Time-of-Flight and On-Demand Stereo , 2009, Dyn3D.

[16]  Arturo de la Escalera,et al.  Automatic Chessboard Detection for Intrinsic and Extrinsic Camera Parameter Calibration , 2010, Sensors.