Vital sign monitoring utilizing Eulerian video magnification and thermography

In this paper we present a proof of concept for non-contact extraction of vital signs using RGB and thermal images obtained from a smart phone. Using our method, heart rate, respiratory rate and forehead temperature can be measured concurrently. Face detection and tracking is leveraged in order to allow natural motion of patients. Heart rate is estimated via processing of visible band RGB video using Eulerian Video Magnification technique. Respiratory rate and the temperature is measured using thermal video. Experiments conducted with 11 healthy subjects indicate that heart rate and respiration rate can be measured with 92 and 94 percent accuracy, respectively.

[1]  Ann Hendrich,et al.  A 36-hospital time and motion study: how do medical-surgical nurses spend their time? , 2008, The Permanente journal.

[2]  Aly A. Farag,et al.  A Fully Automatic Method to Extract the Heart Rate from Thermal Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[3]  Kwang Suk Park,et al.  Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Rich Fletcher,et al.  Low-cost differential front-end for Doppler radar vital sign monitoring , 2009, 2009 IEEE MTT-S International Microwave Symposium Digest.

[5]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[6]  V. Ranganathan,et al.  United States Registered Nurse Workforce Report Card and Shortage Forecast , 2012, American journal of medical quality : the official journal of the American College of Medical Quality.

[7]  O. Boric-Lubecke,et al.  Signal-to-Noise Ratio in Doppler Radar System for Heart and Respiratory Rate Measurements , 2009, IEEE Transactions on Microwave Theory and Techniques.

[8]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[9]  Sabine Van Huffel,et al.  Automated Respiration Detection from Neonatal Video Data , 2015, ICPRAM.

[10]  Rafik A. Goubran,et al.  The detection of breathing behavior using Eulerian-enhanced thermal video , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  A. Farag,et al.  Non-contact , Wavelet-based Measurement of Vital Signs using Thermal Imaging , 2005 .

[12]  Marcelline R. Harris,et al.  Nurse staffing and inpatient hospital mortality. , 2011, The New England journal of medicine.

[13]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.