A Spatiotemporal Deep Neural Network Useful for Defect Identification and Reconstruction of Artworks Using Infrared Thermography

Assessment of cultural heritage assets is now extremely important all around the world. Non-destructive inspection is essential for preserving the integrity of artworks while avoiding the loss of any precious materials that make them up. The use of Infrared Thermography is an interesting concept since surface and subsurface faults can be discovered by utilizing the 3D diffusion inside the object caused by external heat. The primary goal of this research is to detect defects in artworks, which is one of the most important tasks in the restoration of mural paintings. To this end, machine learning and deep learning techniques are effective tools that should be employed properly in accordance with the experiment’s nature and the collected data. Considering both the temporal and spatial perspectives of step-heating thermography, a spatiotemporal deep neural network is developed for defect identification in a mock-up reproducing an artwork. The results are then compared with those of other conventional algorithms, demonstrating that the proposed approach outperforms the others.

[1]  A. Tsourdos,et al.  Development of a thermal excitation source used in an active thermographic UAV platform , 2022, Quantitative InfraRed Thermography Journal.

[2]  S. Lagüela,et al.  Introduction of the combination of thermal fundamentals and Deep Learning for the automatic thermographic inspection of thermal bridges and water-related problems in infrastructures , 2022, Quantitative InfraRed Thermography Journal.

[3]  Changmin Kim,et al.  Automated classification of thermal defects in the building envelope using thermal and visible images , 2022, Quantitative InfraRed Thermography Journal.

[4]  S. Sfarra,et al.  Factor analysis thermography for defect detection of panel paintings , 2021, Quantitative InfraRed Thermography Journal.

[5]  B. Oswald-Tranta Detection and characterisation of short fatigue cracks by inductive thermography , 2021, Quantitative InfraRed Thermography Journal.

[6]  Jorge L. Flores,et al.  Deep convolutional neural networks for classifying breast cancer using infrared thermography , 2021, Quantitative InfraRed Thermography Journal.

[7]  Yunze He,et al.  Infrared machine vision and infrared thermography with deep learning: A review , 2021 .

[8]  Stefano Sfarra,et al.  Rectifying the emissivity variations problem caused by pigments in artworks inspected by infrared thermography: A simple, useful, effective, and optimized approach for the cultural heritage field , 2021 .

[9]  Pedro Arias,et al.  Introduction of Deep Learning in Thermographic Monitoring of Cultural Heritage and Improvement by Automatic Thermogram Pre-Processing Algorithms , 2021, Sensors.

[10]  Henrique C. Fernandes,et al.  A Deep Learning Method for the Impact Damage Segmentation of Curve-Shaped CFRP Specimens Inspected by Infrared Thermography , 2021, Sensors.

[11]  Ming Ren,et al.  Infrared thermography‐based diagnostics on power equipment: State‐of‐the‐art , 2020, High Voltage.

[12]  Cunlin Zhang,et al.  Quantitative measurement of cast metal relics by pulsed thermal imaging , 2020, Quantitative InfraRed Thermography Journal.

[13]  X. Maldague,et al.  Evaluating quality of marquetries by applying active IR thermography and advanced signal processing , 2020, Journal of Thermal Analysis and Calorimetry.

[14]  Stefano Sfarra,et al.  Measuring the Water Content in Wood Using Step-Heating Thermography and Speckle Patterns-Preliminary Results , 2020, Sensors.

[15]  Wai Lok Woo,et al.  Temporal and spatial deep learning network for infrared thermal defect detection , 2019, NDT & E International.

[16]  Stefano Sfarra,et al.  Development of integrated innovative techniques for paintings examination: The case studies of The Resurrection of Christ attributed to Andrea Mantegna and the Crucifixion of Viterbo attributed to Michelangelo's workshop , 2019, Journal of Cultural Heritage.

[17]  M. Safizadeh,et al.  Detection of edge debonding in composite patch using novel post processing method of thermography , 2019, NDT & E International.

[18]  Stefano Sfarra,et al.  Looking Through Paintings by Combining Hyper-Spectral Imaging and Pulse-Compression Thermography , 2019, Sensors.

[19]  M. Safizadeh,et al.  Edge disbond detection of carbon/epoxy repair patch on aluminum using thermography , 2019, Composites Science and Technology.

[20]  J. Sun,et al.  Evaluation of an ancient cast-iron Buddha head by step-heating infrared thermography , 2019, Infrared Physics & Technology.

[21]  M. Safizadeh,et al.  Numerical and experimental study for assessing stress in carbon epoxy composites using thermography , 2019, Infrared Physics & Technology.

[22]  M. Ferretti,et al.  The Boxer at Rest and the Hellenistic Prince: A comparative thermographic study , 2019, Journal of Archaeological Science: Reports.

[23]  Stefano Sfarra,et al.  Thermography data fusion and nonnegative matrix factorization for the evaluation of cultural heritage objects and buildings , 2018, Journal of Thermal Analysis and Calorimetry.

[24]  Xavier Maldague,et al.  How to Retrieve Information Inherent to Old Restorations Made on Frescoes of Particular Artistic Value Using Infrared Vision? , 2015 .

[25]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[26]  Stefano Sfarra,et al.  Thermographic, ultrasonic and optical methods: A new dimension in veneered wood diagnostics , 2013, Russian Journal of Nondestructive Testing.

[27]  Xavier Maldague,et al.  Diagnostics of panel paintings using holographic interferometry and pulsed thermography , 2010 .

[28]  X. Maldague Nondestructive Evaluation of Materials by Infrared Thermography , 1993 .

[29]  M. F. Møller A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning , 1990 .

[30]  Tangbin Xia,et al.  Spatiotemporal denoising wavelet network for infrared thermography-based machine prognostics integrating ensemble uncertainty , 2022, Mechanical Systems and Signal Processing.

[31]  Neil Roberts,et al.  Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015 , 2015, Lecture Notes in Computer Science.

[32]  Antonia Moropoulou,et al.  Applications of infrared thermography for the investigation of historic structures , 2004 .

[33]  D. Watmough,et al.  The thermal scanning of a curved isothermal surface: implications for clinical thermography. , 1970, Physics in medicine and biology.