Accurate region of interest selection for video based heart rate monitoring for a person driving a car

In this paper, a video based heart rate monitoring system for a person driving a car has been proposed using the face of the driver as region of interest. Challenges such as illumination and motion artifacts are present when the car is moving in real life. We have proposed methods for tackling insufficient illumination and face tracking. The video for heart rate measurement is acquired at a rate of 30 fps with a resolution of 640×480 pixels for different illumination and car speeds. The video is recorded using dash cam. We apply insufficient and irregular illumination compensation algorithm in the preprocessing stage. The forehead is tracked by using black pixel tracking algorithm. The forehead is divided into many smaller blocks for correct region of interest selection based on heart rate measurements. The photoplethysmography (PPG) signal is extracted by separating the video frames into three RGB traces, and considering G channel only for further processing. Fast Fourier Transform is applied to the G channel traces, followed by band pass filtering. The peak frequency of the resultant signal determines the heart rate (converted to beats per minute (bpm)). The average error in the heart rate measurement for our proposed system is 2.734 bpm.

[1]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[2]  Eirini Christinaki,et al.  Comparison of blind source separation algorithms for optical heart rate monitoring , 2014, 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH).

[3]  Yoshinori Kuno,et al.  Robust Heart Rate Measurement from Video Using Select Random Patches , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Geevarghese Titus,et al.  ICA based System with WPT for Removal of Motion Artifacts in Photoplethysmogram (PPG) Signal. , 2014 .

[5]  Matti Pietikäinen,et al.  Remote Heart Rate Measurement from Face Videos under Realistic Situations , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Janko Drnovsek,et al.  Non-contact heart rate and heart rate variability measurements: A review , 2014, Biomed. Signal Process. Control..

[7]  Humaira Nisar,et al.  Contactless heart rate monitor for multiple persons in a video , 2016, 2016 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW).

[8]  Marc Garbey,et al.  Contact-Free Measurement of Cardiac Pulse Based on the Analysis of Thermal Imagery , 2007, IEEE Transactions on Biomedical Engineering.

[9]  Vitomir Struc,et al.  Photometric Normalization Techniques for Illumination Invariance , 2011 .

[10]  Humaira Nisar,et al.  A Simple Non-Invasive Automated Heart Rate Monitoring System Using Facial Images , 2016 .

[11]  Noa García Docampo,et al.  Heart rate estimation using facial video information , 2012 .

[12]  Humaira Nisar,et al.  A Non Invasive Heart Rate Measurement System for Multiple People in the Presence of Motion and Varying Illumination , 2016 .