Detecting Pulse from Head Motions in Video

We extract heart rate and beat lengths from videos by measuring subtle head motion caused by the Newtonian reaction to the influx of blood at each beat. Our method tracks features on the head and performs principal component analysis (PCA) to decompose their trajectories into a set of component motions. It then chooses the component that best corresponds to heartbeats based on its temporal frequency spectrum. Finally, we analyze the motion projected to this component and identify peaks of the trajectories, which correspond to heartbeats. When evaluated on 18 subjects, our approach reported heart rates nearly identical to an electrocardiogram device. Additionally we were able to capture clinically relevant information about heart rate variability.

[1]  Choi Jin-Wook,et al.  A New Method for Unconstrained Pulse Arrival Time (PAT) Measurement on a Chair , 2006 .

[2]  A. Jensenius,et al.  Early prediction of cerebral palsy by computer‐based video analysis of general movements: a feasibility study , 2010, Developmental medicine and child neurology.

[3]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[4]  Amr Ahmed,et al.  Vision Analysis in Detecting Abnormal Breathing Activity in application to Diagnosis of Obstructive Sleep Apnoea , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  F. Mastik,et al.  Contactless Multiple Wavelength Photoplethysmographic Imaging: A First Step Toward “SpO2 Camera” Technology , 2005, Annals of Biomedical Engineering.

[6]  I. Starr,et al.  STUDIES ON THE ESTIMATION OF CARDIAC OUPTUT IN MAN, AND OF ABNORMALITIES IN CARDIAC FUNCTION, FROM THE HEART'S RECOIL AND THE BLOOD'S IMPACTS; THE BALLISTOCARDIOGRAM , 1939 .

[7]  Marc Garbey,et al.  Contact-Free Measurement of Cardiac Pulse Based on the Analysis of Thermal Imagery , 2007, IEEE Transactions on Biomedical Engineering.

[8]  Collin M. Stultz,et al.  Computationally Generated Cardiac Biomarkers for Risk Stratification After Acute Coronary Syndrome , 2011, Science Translational Medicine.

[9]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[10]  Richard M. Wiard,et al.  Robust ballistocardiogram acquisition for home monitoring , 2009, Physiological measurement.

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Frédo Durand,et al.  Motion magnification , 2005, ACM Trans. Graph..

[13]  M. Tsiknakis,et al.  Vision-based human motion analysis in epilepsy - Methods and challenges , 2010, Proceedings of the 10th IEEE International Conference on Information Technology and Applications in Biomedicine.

[14]  Charles Sodini,et al.  A long-term wearable electrocardiogram measurement system , 2013, 2013 IEEE International Conference on Body Sensor Networks.

[15]  Reza Saatchi,et al.  Real-time vision based respiration monitoring system , 2010, 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010).

[16]  Jyh-Yeong Chang,et al.  Quantification and recognition of parkinsonian gait from monocular video imaging using kernel-based principal component analysis , 2011, Biomedical engineering online.

[17]  Charles Sodini,et al.  A continuous, wearable, and wireless heart monitor using head ballistocardiogram (BCG) and head electrocardiogram (ECG) , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Emery N. Brown,et al.  Motion and Ballistocardiogram Artifact Removal for Interleaved Recording of EEG and EPs during MRI , 2002, NeuroImage.

[19]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..