ThermalWrist: Smartphone Thermal Camera Correction Using a Wristband Sensor †

Thermal images are widely used for various healthcare applications and advanced research. However, thermal images captured by smartphone thermal cameras are not accurate for monitoring human body temperature due to the small body that is vulnerable to temperature change. In this paper, we propose ThermalWrist, a dynamic offset correction method for thermal images captured by smartphone thermal cameras. We fully utilize the characteristic that is specific to thermal cameras: the relative temperatures in a single thermal image are highly reliable, although the absolute temperatures fluctuate frequently. To correct the offset error, ThermalWrist combines thermal images with a reliable absolute temperature obtained by a wristband sensor based on the above characteristic. The evaluation results in an indoor air-conditioned environment shows that the mean absolute error and the standard deviation of face temperature measurement error decrease by 49.4% and 64.9%, respectively. In addition, Pearson’s correlation coefficient increases by 112%, highlighting the effectiveness of ThermalWrist. We also investigate the limitation with respect to the ambient temperature where ThermalWrist works effectively. The result shows ThermalWrist works well in the normal office environment, which is 22.91 °C and above.

[1]  P. Warriss,et al.  Estimating the body temperature of groups of pigs by thermal imaging , 2006, Veterinary Record.

[2]  Vincent G. Duffy,et al.  Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement , 2007 .

[3]  Ioannis T. Pavlidis,et al.  StressCam: non-contact measurement of users' emotional states through thermal imaging , 2005, CHI Extended Abstracts.

[4]  Matthew Louis Mauriello,et al.  Exploring Novice Approaches to Smartphone-based Thermographic Energy Auditing: A Field Study , 2017, CHI.

[5]  Chee Seng Chan,et al.  A Fusion Approach for Efficient Human Skin Detection , 2012, IEEE Transactions on Industrial Informatics.

[6]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[7]  Verónica Pérez-Rosas,et al.  Using Infrared Thermography and Biosensors to Detect Thermal Discomfort in a Building’s Inhabitants , 2014 .

[8]  Tom Chau,et al.  Thermal Imaging of the Periorbital Regions during the Presentation of an Auditory Startle Stimulus , 2011, PloS one.

[9]  Dvijesh Shastri,et al.  Perinasal Imaging of Physiological Stress and Its Affective Potential , 2012, IEEE Transactions on Affective Computing.

[10]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[11]  I. Pavlidis,et al.  Thermal image analysis for polygraph testing. , 2002, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[12]  Aurobinda Routray,et al.  Human emotion recognition from facial thermal image based on fused statistical feature and multi-class SVM , 2015, 2015 Annual IEEE India Conference (INDICON).

[13]  E. Salazar-López,et al.  The mental and subjective skin: Emotion, empathy, feelings and thermography , 2015, Consciousness and Cognition.

[14]  J.R. Martinez-De Dios,et al.  Automatic Detection of Windows Thermal Heat Losses in Buildings Using UAVs , 2006, 2006 World Automation Congress.

[15]  A. Merla,et al.  Mom feels what her child feels: thermal signatures of vicarious autonomic response while watching children in a stressful situation , 2013, Front. Hum. Neurosci..

[16]  Amanda C. Hahn,et al.  Hot or not? Thermal reactions to social contact , 2012, Biology Letters.

[17]  Norito Kawakami,et al.  The Stress Check Program: a new national policy for monitoring and screening psychosocial stress in the workplace in Japan , 2016, Journal of occupational health.

[18]  F. Vetere,et al.  Cognitive Heat , 2017 .

[19]  E. Brunner,et al.  The Nonparametric Behrens‐Fisher Problem: Asymptotic Theory and a Small‐Sample Approximation , 2000 .

[20]  V. Chelladurai,et al.  Thermal imaging for detecting fungal infection in stored wheat. , 2010 .

[21]  Michael Vollmer,et al.  Infrared Thermal Imaging: Fundamentals, Research and Applications , 2010 .

[22]  Yoshihisa Fujiwara,et al.  Using facial skin temperature to objectively evaluate sensations , 1997 .

[23]  Michael G. Baker,et al.  Thermal Image Scanning for Influenza Border Screening: Results of an Airport Screening Study , 2011, PloS one.

[24]  Ioannis Pavlidis,et al.  Seeing through the face of deception , 2002, Nature.

[25]  Annamalai Manickavasagan,et al.  Thermal Infrared Imaging , 2014 .

[26]  A. Merla,et al.  Mother and child in synchrony: Thermal facial imprints of autonomic contagion , 2012, Biological Psychology.

[27]  C H Wyndham,et al.  Emissivity and transmittance of excised human skin in its thermal emission wave band. , 1967, Journal of applied physiology.

[28]  Thomas B. Moeslund,et al.  Thermal cameras and applications: a survey , 2013, Machine Vision and Applications.

[29]  Y. Aragane,et al.  The “Enseki” sandbath: A novel, safe and effective far‐infrared bathing procedure for health , 2018, Photodermatology, photoimmunology & photomedicine.

[30]  A R Smith,et al.  Color Gamut Transformation Pairs , 1978 .

[31]  Robert S. Allison,et al.  Thermal Imaging as a Way to Classify Cognitive Workload , 2010, 2010 Canadian Conference on Computer and Robot Vision.

[32]  P. V. van Zuijlen,et al.  The FLIR ONE thermal imager for the assessment of burn wounds: Reliability and validity study. , 2017, Burns : journal of the International Society for Burn Injuries.

[33]  Vivian Loftness,et al.  Investigation of human body skin temperatures as a bio-signal to indicate overall thermal sensations , 2012 .

[34]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Paul H. C. Eilers,et al.  Enhancing scatterplots with smoothed densities , 2004, Bioinform..

[36]  Joseph A. Shaw,et al.  Radiometric calibration of infrared imagers using an internal shutter as an equivalent external blackbody , 2014 .

[37]  N. Diakides,et al.  Thermal infrared imaging in early breast cancer detection-a survey of recent research , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[38]  V. Gallese,et al.  Thermal infrared imaging in psychophysiology: Potentialities and limits , 2014, Psychophysiology.

[39]  Juhi Ranjan,et al.  ThermalSense: determining dynamic thermal comfort preferences using thermographic imaging , 2016, UbiComp.

[40]  Kari Babski-Reeves,et al.  DETERMINING LEARNING LEVEL AND EFFECTIVE TRAINING TIMES USING THERMOGRAPHY , 2006 .

[41]  Kai Kunze,et al.  Facial temperature sensing on smart eyewear for affective computing , 2017, UbiComp/ISWC Adjunct.

[42]  Eemil Lagerspetz,et al.  Hot or Not? Robust and Accurate Continuous Thermal Imaging on FLIR cameras , 2019, 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom.

[43]  Sasu Tarkoma,et al.  Low-cost support for search and rescue operations using off-the-shelf sensor technologies , 2017 .