Automatic Webcam-Based Human Heart Rate Measurements Using Laplacian Eigenmap

Non-contact, long-term monitoring human heart rate is of great importance to home health care. Recent studies show that Photoplethysmography (PPG) can provide a means of heart rate measurement by detecting blood volume pulse (BVP) in human face. However, most of existing methods use linear analysis method to uncover the underlying BVP, which may be not quite adequate for physiological signals. They also lack rigorous mathematical and physiological models for the subsequent heart rate calculation. In this paper, we present a novel webcam-based heart rate measurement method using Laplacian Eigenmap (LE). Usually, the webcam captures the PPG signal mixed with other sources of fluctuations in light. Thus exactly separating the PPG signal from the collected data is crucial for heart rate measurement. In our method, more accurate BVP can be extracted by applying LE to efficiently discover the embedding ties of PPG with the nonlinear mixed data. We also operate effective data filtering on BVP and get heart rate based on the calculation of interbeat intervals (IBIs). Experimental results show that LE obtains higher degrees of agreement with measurements using finger blood oximetry than Independent Component Analysis (ICA), Principal Component Analysis (PCA) and other five alternative methods. Moreover, filtering and processing on IBIs are proved to increase the measuring accuracy in experiments.

[1]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[2]  Sijung Hu,et al.  Remote simultaneous dual wavelength imaging photoplethysmography: a further step towards 3-D mapping of skin blood microcirculation , 2008, SPIE BiOS.

[3]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[4]  Marc Garbey,et al.  Interacting with human physiology , 2007, Comput. Vis. Image Underst..

[5]  Professor P. Å. Öberg,et al.  Estimation of respiratory volumes from the photoplethysmographic signal. Part 2: a model study , 2006, Medical & Biological Engineering & Computing.

[6]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[7]  Jonathon Shlens,et al.  A Tutorial on Principal Component Analysis , 2014, ArXiv.

[8]  Katsuyuki Miyasaka,et al.  Pulse oximetry: its invention, contribution to medicine, and future tasks. , 2002, Anesthesia and analgesia.

[9]  K. Nakajima,et al.  Monitoring of heart and respiratory rates by photoplethysmography using a digital filtering technique. , 1996, Medical engineering & physics.

[10]  Kilian Q. Weinberger,et al.  Unsupervised Learning of Image Manifolds by Semidefinite Programming , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  J. Naschitz,et al.  Pulse Transit Time by R-Wave-Gated Infrared Photoplethysmography: Review of the Literature and Personal Experience , 2004, Journal of Clinical Monitoring and Computing.

[13]  H. Zha,et al.  Principal manifolds and nonlinear dimensionality reduction via tangent space alignment , 2004, SIAM J. Sci. Comput..

[14]  Marc Garbey,et al.  Estimation of blood flow speed and vessel location from thermal video , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[15]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[16]  Tomasz Kocejko,et al.  Proceedings of the Federated Conference on Computer Science and Information Systems pp. 405–410 ISBN 978-83-60810-22-4 Measuring Pulse Rate with a Webcam – a Non-contact Method for Evaluating Cardiac Activity , 2022 .

[17]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[18]  P C W Beatty,et al.  Design of Pulse Oximeters (Medical Science Series) , 1998 .

[19]  A. Johansson,et al.  Estimation of respiratory volumes from the photoplethysmographic signal. Part I: experimental results , 2006, Medical & Biological Engineering & Computing.

[20]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[21]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[22]  Ioannis T. Pavlidis,et al.  Thermistor at a Distance: Unobtrusive Measurement of Breathing , 2010, IEEE Transactions on Biomedical Engineering.

[23]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[24]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[25]  Marc Garbey,et al.  Imaging the cardiovascular pulse , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[27]  John G. Webster,et al.  Design of Pulse Oximeters , 1997 .

[28]  Jianchu Yao,et al.  A Short Study to Assess the Potential of Independent Component Analysis for Motion Artifact Separation in Wearable Pulse Oximeter Signals , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.