Assessment of psychophysiological characteristics using heart rate from naturalistic face video data

Heart rate is a strong indicator of a person's psychophysiological state. For this reason, many applications would benefit from noncontact measurement of heart rate. The paper describes a new procedure for estimating blood volume pulse from a video of a person's face, with an emphasis on real-life scenarios. The approach builds on the algorithm known as Eulerian video magnification, which has shown promise under laboratory conditions, but exhibits problems when attempted in naturalistic situations. In particular, problems arise due to movement by the subject, changing illumination conditions, and low-frame-rate video. This paper describes the procedure that we have developed to address some of these problems, including video rates down to 10 frames per second. The procedure has been tested using videos of indoor subjects, as well as drivers of automobiles in naturalistic situations. The paper also shows analysis and comparison of different stress levels using the extracted heart rate information for a driver on the road.

[1]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[2]  Fernando De la Torre,et al.  Supervised Descent Method and Its Applications to Face Alignment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Rosalind W. Picard,et al.  Motion-tolerant magnetic earring sensor and wireless earpiece for wearable photoplethysmography , 2010, IEEE Transactions on Information Technology in Biomedicine.

[4]  John M. Irvine,et al.  Heartbeat biometrics: a sensing system perspective , 2012 .

[5]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[6]  U. Rajendra Acharya,et al.  Heart rate variability: a review , 2006, Medical and Biological Engineering and Computing.

[7]  John Allen Photoplethysmography and its application in clinical physiological measurement , 2007, Physiological measurement.

[8]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Y. Lin,et al.  An Intelligent Noninvasive Sensor for Driver Pulse Wave Measurement , 2007, IEEE Sensors Journal.

[10]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[11]  Mika P. Tarvainen,et al.  Kubios HRV — A Software for Advanced Heart Rate Variability Analysis , 2009 .

[12]  Deva Ramanan,et al.  Face detection, pose estimation, and landmark localization in the wild , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[14]  Mireya Fernández Chimeno,et al.  Changes in heart rate variability indexes due to drowsiness in professional drivers measured in a real environment , 2012 .