Hot or Not? Robust and Accurate Continuous Thermal Imaging on FLIR cameras

Wearable thermal imaging is emerging as a powerful and increasingly affordable sensing technology. Current thermal imaging solutions are mostly based on uncooled forward looking infrared (FLIR), which is susceptible to errors resulting from warming of the camera and the device casing it. To mitigate these errors, a blackbody calibration technique where a shutter whose thermal parameters are known is periodically used to calibrate the measurements. This technique, however, is only accurate when the shutter’s temperature remains constant over time, which rarely is the case. In this paper, we contribute by developing a novel deep learning based calibration technique that uses battery temperature measurements to learn a model that allows adapting to changes in the internal thermal calibration parameters. Our method is particularly effective in continuous sensing where the device casing the camera is prone to heating. We demonstrate the effectiveness of our technique through controlled benchmark experiments which show significant improvements in thermal monitoring accuracy and robustness.

[1]  M.M. Khan,et al.  Infrared Thermal Sensing of Positive and Negative Affective States , 2006, 2006 IEEE Conference on Robotics, Automation and Mechatronics.

[2]  Peter Christiansen,et al.  Automated Detection and Recognition of Wildlife Using Thermal Cameras , 2014, Sensors.

[3]  Jari Viik,et al.  Improving nursing methods by using thermal imaging: Observations by CAT S60 mobile phone , 2017 .

[4]  Gerhard P. Hancke,et al.  A Zigbee-Based Animal Health Monitoring System , 2015, IEEE Sensors Journal.

[5]  Eemil Lagerspetz,et al.  Evaluating Energy-Efficiency using Thermal Imaging , 2019, HotMobile.

[6]  S. Gurrum,et al.  Generic thermal analysis for phone and tablet systems , 2012, 2012 IEEE 62nd Electronic Components and Technology Conference.

[7]  F. Vetere,et al.  Cognitive Heat , 2017 .

[8]  John B. Goodell,et al.  The Fundamentals of Thermal Imaging Systems. , 1979 .

[9]  Jun Luo,et al.  Counting via LED sensing: Inferring occupancy using lighting infrastructure , 2018, Pervasive Mob. Comput..

[10]  P. V. van Zuijlen,et al.  The FLIR ONE thermal imager for the assessment of burn wounds: Reliability and validity study. , 2017, Burns : journal of the International Society for Burn Injuries.

[11]  Patrick Westfeld,et al.  SHUTTER-LESS TEMPERATURE-DEPENDENT CORRECTION FOR UNCOOLED THERMAL CAMERA UNDER FAST CHANGING FPA TEMPERATURE , 2017 .

[12]  Mariusz Kastek,et al.  Method of detectors offset correction in thermovision camera with uncooled microbolometric focal plane array , 2009, Security + Defence.

[13]  Anish Arora,et al.  A regression-based radar-mote system for people counting , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[14]  Przemyslaw Krystian Matkowski Comparative thermal analysis of commercial and novel hybrid thermal greases , 2014, Proceedings of the 2014 37th International Spring Seminar on Electronics Technology.

[15]  P. Sivakumar,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES , 2016 .

[16]  Sasu Tarkoma,et al.  Low-cost support for search and rescue operations using off-the-shelf sensor technologies , 2017 .

[17]  Yanpeng Cao,et al.  Shutterless solution for simultaneous focal plane array temperature estimation and nonuniformity correction in uncooled long-wave infrared camera. , 2013, Applied optics.

[18]  Massoud Pedram,et al.  Therminator: A thermal simulator for smartphones producing accurate chip and skin temperature maps , 2014, 2014 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[19]  Naehyuck Chang,et al.  Dynamic thermal management in mobile devices considering the thermal coupling between battery and application processor , 2013, 2013 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[20]  Oliver Faust,et al.  Application of infrared thermography in computer aided diagnosis , 2014, Infrared Physics & Technology.

[21]  Matthew Louis Mauriello,et al.  Understanding the Role of Thermography in Energy Auditing: Current Practices and the Potential for Automated Solutions , 2015, CHI.

[22]  Joseph A. Shaw,et al.  Radiometric calibration of infrared imagers using an internal shutter as an equivalent external blackbody , 2014 .

[23]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[24]  James W. Davis,et al.  Background-subtraction using contour-based fusion of thermal and visible imagery , 2007, Comput. Vis. Image Underst..

[25]  Matthew Louis Mauriello,et al.  Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study , 2017, CHI.