A Mask-Based Approach for the Geometric Calibration of Thermal-Infrared Cameras

Accurate and efficient thermal-infrared (IR) camera calibration is important for advancing computer vision research within the thermal modality. This paper presents an approach for geometrically calibrating individual and multiple cameras in both the thermal and visible modalities. The proposed technique can be used to correct for lens distortion and to simultaneously reference both visible and thermal-IR cameras to a single coordinate frame. The most popular existing approach for the geometric calibration of thermal cameras uses a printed chessboard heated by a flood lamp and is comparatively inaccurate and difficult to execute. Additionally, software toolkits provided for calibration either are unsuitable for this task or require substantial manual intervention. A new geometric mask with high thermal contrast and not requiring a flood lamp is presented as an alternative calibration pattern. Calibration points on the pattern are then accurately located using a clustering-based algorithm which utilizes the maximally stable extremal region detector. This algorithm is integrated into an automatic end-to-end system for calibrating single or multiple cameras. The evaluation shows that using the proposed mask achieves a mean reprojection error up to 78% lower than that using a heated chessboard. The effectiveness of the approach is further demonstrated by using it to calibrate two multiple-camera multiple-modality setups. Source code and binaries for the developed software are provided on the project Web site.

[1]  Pavan Sikka,et al.  DDX : A distributed software architecture for robotic systems , 2004 .

[2]  Kurt Beier,et al.  Simulation of infrared detection range at fog conditions for Enhanced Vision Systems in civil aviation , 2004 .

[3]  Sridha Sridharan,et al.  Dense Correspondence Extraction in Difficult Uncalibrated Scenarios , 2009, 2009 Digital Image Computing: Techniques and Applications.

[4]  Terry Caelli,et al.  Robust thermal camera calibration and 3D mapping of object surface temperatures , 2006, SPIE Defense + Commercial Sensing.

[5]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[6]  Mohan M. Trivedi,et al.  Multiperspective Thermal IR and Video Arrays for 3D Body Tracking and Driver Activity Analysis , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[7]  Fabio Bozzoli,et al.  Characterization of an uncooled infrared thermographic system suitable for the solution of the 2-D inverse heat conduction problem , 2008 .

[8]  Tomás Svoboda,et al.  A Convenient Multicamera Self-Calibration for Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[9]  Stephan Rupp,et al.  Robust Camera Calibration using Discrete Optimization , 2008 .

[10]  Ruan Lakemond Multiple camera management using wide baseline matching , 2010 .

[11]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Volker Hilsenstein Surface Reconstruction of Water Waves using Thermographic Stereo Imaging , 2005 .

[13]  Andrew W. Fitzgibbon,et al.  A rational function lens distortion model for general cameras , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  R. Du,et al.  Acquisition of 3D surface temperature distribution of a car body , 2005, 2005 IEEE International Conference on Information Acquisition.

[15]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[16]  Dean Brown,et al.  Decentering distortion of lenses , 1966 .

[17]  Jean-Nicolas Ouellet,et al.  Developing assistant tools for geometric camera calibration: assessing the quality of input images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  Peter Bajcsy,et al.  Integration of thermal and visible imagery for robust foreground detection in tele-immersive spaces , 2008, 2008 11th International Conference on Information Fusion.

[20]  Peter Bajcsy,et al.  Integration of Data Across Disparate Sensing Systems Over Both Time and Space to Design Smart Environments , 2010 .

[21]  G. Pagliarini,et al.  Data processing technique applied to the calibration of a high performance FPA infrared camera , 2002 .

[22]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..