A Fully Automatic Method to Extract the Heart Rate from Thermal Video

This work deals with non-invasive and non-intrusive measurements of the human facial vasculature from thermal IR to measure cardiovascular vital signs. A robust, fully automatic measurement system is developed to study infrared videos of 32 under three imaging scenarios. Vascular mapping, blood perfusion modeling, and wavelet analysis are used to calculate heart rate from 512 video frames in near real time. Multiple measurement locations are considered to analyze accuracy and sensitivity in a novel approach, revealing that the 60% of vessel segments in the forehead region are capable of producing 85% accuracy of measurement or better.

[1]  Pradeep Buddharaju,et al.  Physiology-based face recognition , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[2]  C A Evans,et al.  Facial skeletal changes following hypertelorbitism correction. , 1986, Plastic and reconstructive surgery.

[3]  Y. Pinar,et al.  Anatomy of the superficial temporal artery and its branches: its importance for surgery , 2006, Surgical and Radiologic Anatomy.

[4]  Robert D. Acland,et al.  Surgical Anatomy and Blood Supply of the Fascial Layers of the Temporal Region , 1986, Plastic and reconstructive surgery.

[5]  Aly A. Farag,et al.  Extraction of the superficial facial vasculature, vital signs waveforms and rates using thermal imaging , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Weisi Lin,et al.  Skin heat transfer model of facial thermograms and its application in face recognition , 2008, Pattern Recognit..

[8]  Marc Garbey,et al.  Imaging the cardiovascular pulse , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[10]  Aly A. Farag,et al.  Multiresolution Approach for Non-Contact Measurements of Arterial Pulse using Thermal Imaging , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[11]  Shenglin Yang,et al.  A secure fingerprint matching technique , 2003, WBMA '03.

[12]  Aly A. Farag,et al.  Computationally light forehead segmentation from thermal images , 2012, 2012 19th IEEE International Conference on Image Processing.

[13]  Mohamed A. Deriche,et al.  Scale-Space Properties of the Multiscale Morphological Dilation-Erosion , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  J. Steketee.  Spectral emissivity of skin and pericardium. , 1973, Physics in medicine and biology.

[15]  Pradeep Buddharaju,et al.  Physiology-Based Face Recognition in the Thermal Infrared Spectrum , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Ioannis T. Pavlidis,et al.  The Segmentation of the Supraorbital Vessels in Thermal Imagery , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[17]  A. G. Ramakrishnan,et al.  ECG coding by wavelet-based linear prediction , 1997, IEEE Transactions on Biomedical Engineering.

[18]  Aly A. Farag,et al.  Thermal Imaging of the Superficial Temporal Artery: An Arterial Pulse Recovery Model , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ioannis T. Pavlidis,et al.  Counting Heartbeats at a Distance , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..