3D Thermal Imaging System with Decoupled Acquisition for Industrial and Cultural Heritage Applications

Three-dimensional thermography is a recent technique—with various fields of application—that consists of combining thermography with 3D spatial data in order to obtain 3D thermograms, high information objects that allow one to overcome some limitations of 2D thermograms, to enhance the thermal monitoring and the detection of abnormalities. In this paper we present an integration methodology that can be applied to merge data acquired from a generic thermal camera and a generic laser scanner, and has the peculiarity of keeping the two devices completely decoupled and independent, so that thermal and geometrical data can be acquired at different times and no rigid link is needed between the two devices. In this way, the stand-alone capability of each device is not affected, and the data fusion is applied only when necessary. In the second part, the real effectiveness of our approach is tested on a 3D-printed object properly designed. Furthermore, one example of an application of our methodology in the cultural heritage field is presented, with an eye to preservation and restoration: the integration is applied to a marble statue called Madonna with the Child, a fine work of the Florentine sculptor Agostino di Duccio (1418–1481). The results suggest that the method can be successfully applicable to a large set of scenarios. However, additional tests are needed to improve the robustness.

[1]  Alessandro Rizzi,et al.  DIGITAL PRESERVATION, DOCUMENTATION AND ANALYSIS OF PAINTINGS, MONUMENTS AND LARGE CULTURAL HERITAGE WITH INFRARED TECHNOLOGY, DIGITAL CAMERAS AND RANGE SENSORS , 2007 .

[2]  Sridha Sridharan,et al.  A Mask-Based Approach for the Geometric Calibration of Thermal-Infrared Cameras , 2012, IEEE Transactions on Instrumentation and Measurement.

[3]  Kikuhito Kawasue,et al.  Black cattle body shape and temperature measurement using thermography and KINECT sensor , 2017, Artificial Life and Robotics.

[4]  Jafar Amiri Parian,et al.  3D thermography for improving temperature measurements in thermal vacuum testing , 2017 .

[5]  Ming-Der Yang,et al.  Fusion of Infrared Thermal Image and Visible Image for 3D Thermal Model Reconstruction Using Smartphone Sensors , 2018, Sensors.

[6]  Sridha Sridharan,et al.  Real-Time Mobile 3D Temperature Mapping , 2015, IEEE Sensors Journal.

[7]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Sebastian Thrun,et al.  Automatic calibration of RGBD and thermal cameras , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Xin Li,et al.  Depth and thermal sensor fusion to enhance 3D thermographic reconstruction. , 2018, Optics express.

[11]  Michael Bosse,et al.  Line-based extrinsic calibration of range and image sensors , 2013, 2013 IEEE International Conference on Robotics and Automation.

[12]  Valery Chernov,et al.  3D Dynamic Thermography System for Biomedical Applications , 2016 .

[13]  Marco Scaioni,et al.  INTEGRATION OF INFRARED THERMOGRAPHY AND PHOTOGRAMMETRIC SURVEYING OF BUILT LANDSCAPE , 2017 .

[14]  Bernd Jähne,et al.  Practical handbook on image processing for scientific applications , 1997 .

[15]  Silvio Savarese,et al.  Automatic Targetless Extrinsic Calibration of a 3D Lidar and Camera by Maximizing Mutual Information , 2012, AAAI.

[16]  Amit Sharma,et al.  Infrared Thermal Imaging , 2015 .

[17]  Jean-Christophe Nebel,et al.  3D thermography imaging standardization technique for inflammation diagnosis , 2005, SPIE/COS Photonics Asia.

[18]  I. Grubisic,et al.  Dynamic Thermal Models for Human Body Dissipation , 2015 .

[19]  Nassir Navab,et al.  When 2.5D is not enough: Simultaneous reconstruction, segmentation and recognition on dense SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Roland Siegwart,et al.  Extrinsic self calibration of a camera and a 3D laser range finder from natural scenes , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Andreas Nüchter,et al.  A mobile robot based system for fully automated thermal 3D mapping , 2014, Adv. Eng. Informatics.

[22]  Edmond Boyer On Using Silhouettes for Camera Calibration , 2006, ACCV.

[23]  Peyman Moghadam,et al.  HeatWave : a handheld 3D thermography system for energy auditing , 2013 .

[24]  Jean Dumoulin,et al.  Infrared Thermography: From Sensing Principle to Nondestructive Testing Considerations , 2017 .

[25]  A. Ianiro,et al.  Temperature maps measurements on 3D surfaces with infrared thermography , 2012 .

[26]  Marco Gianinetto,et al.  INTEGRATION OF MULTI-SOURCE CLOSE-RANGE DATA , 2005 .

[27]  Horst Bischof,et al.  Pose Estimation of Known Objects by Efficient Silhouette Matching , 2010, 2010 20th International Conference on Pattern Recognition.

[28]  Humberto R. Gamba,et al.  A method for generating 3D thermal models with decoupled acquisition , 2017, Comput. Methods Programs Biomed..

[29]  Andreas Kroll,et al.  Generating High Fidelity 3-D Thermograms With a Handheld Real-Time Thermal Imaging System , 2017, IEEE Sensors Journal.

[30]  F. Stanco,et al.  Digital Imaging for Cultural Heritage Preservation: Analysis, Restoration, and Reconstruction of Ancient Artworks , 2011 .

[31]  Samuel Soldan,et al.  3D Thermal Imaging: Fusion of Thermography and Depth Cameras , 2014 .