3D Thermal Imaging: Fusion of Thermography and Depth Cameras

This work presents an approach to automatically create 3D thermal models using multi-perspective measurements with a multimodal camera system consisting of a thermal camera and a depth camera. Additional attributes such as color can also be added to the model. The paper centers its attention on the geometrical calibration of the cameras and the validation of the results. The design of an adequate calibration target is discussed and different options are evaluated. To expose the applicability of the approach two inspection tasks are used as examples.

[1]  Herbert Kaplan,et al.  Practical Applications of Infrared Thermal Sensing and Imaging Equipment , 1993 .

[2]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[3]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Jean-Christophe Nebel,et al.  3 D THERMOGRAPHY FOR QUANTIFICATION OF HEAT GENERATION RESULTING FROM INFLAMMATION THERMOGRAPHIE , 2003 .

[5]  Surya Prakash,et al.  3D Mapping of Surface Temperature Using Thermal Stereo , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[6]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[7]  Takeo Kanade,et al.  Accurate camera calibration using iterative refinement of control points , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[8]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[9]  Yazhu Chen,et al.  Geometric Calibration of IR Camera Using Trinocular Vision , 2011, Journal of Lightwave Technology.

[10]  Uwe Stilla,et al.  Matching of 3D building models with IR images for texture extraction , 2011, 2011 Joint Urban Remote Sensing Event.

[11]  Tomás Pajdla,et al.  3D with Kinect , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[12]  J. Armesto,et al.  Energy efficiency studies through 3D laser scanning and thermographic technologies , 2011 .

[13]  I. Grubisic,et al.  4D thermal imaging system for medical applications , 2011 .

[14]  Diego González-Aguilera,et al.  Novel approach to 3D thermography and energy efficiency evaluation , 2012 .

[15]  Mani Golparvar-Fard,et al.  Rapid 3D Energy Performance Modeling of Existing Buildings Using Thermal and Digital Imagery , 2012 .

[16]  Pedro Arias,et al.  Thermographic 3D models as the foundation for Building Information Models , 2012 .

[17]  Kazuya Yoshida,et al.  Three-Dimensional Thermography Mapping for Mobile Rescue Robots , 2012, FSR.

[18]  B. Więcek,et al.  An integrated thermal and visual camera system for 3D reconstruction , 2012 .

[19]  Andreas Nüchter,et al.  Mutual Calibration for 3D Thermal Mapping , 2012, SyRoCo.

[20]  A. Ianiro,et al.  Temperature maps measurements on 3D surfaces with infrared thermography , 2012 .

[21]  T. Luhmann,et al.  GEOMETRIC CALIBRATION OF THERMOGRAPHIC CAMERAS , 2013 .

[22]  Michael Bosse,et al.  3D thermal mapping of building interiors using an RGB-D and thermal camera , 2013, 2013 IEEE International Conference on Robotics and Automation.