Noncontact Heart Activity Measurement System Based on Video Imaging Analysis

Vital parameter monitoring systems based on video camera imagery is a growing interest field in clinical and biomedical applications. Heart rate (HR) is one of the most important vital parameters of interest in a clinical diagnostic and monitoring system. This study proposed a noncontact HR and beat length measurement system based on both motion magnification and motion detection at four different regions of interest (ROIs) (wrist, arm, neck and leg). A motion magnification based on a Chebyshev filter was utilized in order to magnify heart pulses in different ROIs that are difficult to see with the naked eye. A new measuring system based on motion detection was used to measure HR and beat length by detecting rapid motion areas in the video frame sequences that represent the heart pulses and converting video frames into a corresponding logical matrix. Video quality metrics were also used to compare our magnification system with standard Eulerian video magnification to select which one has better magnification results and gives better results for the heart pulse. The 99.3% limits of agreement between the proposed system and reference measurement fall within∓1 beats/min based on Bland and Altman test. The proposed system is expected to produce new options for further noncontact information extraction.

[1]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[2]  L. O. Svaasand,et al.  Remote plethysmographic imaging using ambient light. , 2008, Optics express.

[3]  Lorenzo Scalise,et al.  Heart rate measurement in neonatal patients using a webcamera , 2012, 2012 IEEE International Symposium on Medical Measurements and Applications Proceedings.

[4]  J. Tsien,et al.  Remote Measurements of Heart and Respiration Rates for Telemedicine , 2013, PloS one.

[5]  Doru-Petru Munteanu,et al.  Non-contact cardiopulmonary monitoring algorithm for a 24 GHz Doppler radar , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Georgia D. Koutsouri,et al.  A computer-aided automated methodology for the detection and classification of occlusal caries from photographic color images , 2015, Comput. Biol. Medicine.

[7]  W. Verkruysse,et al.  Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit - a pilot study. , 2013, Early human development.

[8]  Frédo Durand,et al.  Eulerian video magnification for revealing subtle changes in the world , 2012, ACM Trans. Graph..

[9]  Angel P. del Pobil,et al.  Motion Detection in Static Backgrounds , 2012 .

[10]  T. Brabetz,et al.  Detection of cardiac activity using a 5.8 GHz radio frequency sensor , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[11]  T Tamura,et al.  Development of real-time image sequence analysis for evaluating posture change and respiratory rate of a subject in bed , 2001, Physiological measurement.

[12]  He Tan,et al.  Non-contact heart rate tracking using Doppler radar , 2012, 2012 International Conference on Systems and Informatics (ICSAI2012).

[13]  Jos B. T. M. Roerdink,et al.  Group-Invariant Frames for Colour Morphology , 2013, ISMM.

[14]  Marc Garbey,et al.  Imaging the cardiovascular pulse , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Douglas G. Altman,et al.  Measurement in Medicine: The Analysis of Method Comparison Studies , 1983 .

[16]  Rosalind W. Picard,et al.  Non-contact, automated cardiac pulse measurements using video imaging and blind source separation , 2022 .

[17]  Frédo Durand,et al.  Detecting Pulse from Head Motions in Video , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Yu Sun,et al.  Use of ambient light in remote photoplethysmographic systems: comparison between a high-performance camera and a low-cost webcam. , 2012, Journal of biomedical optics.

[19]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[20]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[21]  Joseph A. O'Sullivan,et al.  Hidden State Models for Noncontact Measurements of the Carotid Pulse Using a Laser Doppler Vibrometer , 2012, IEEE Transactions on Biomedical Engineering.

[22]  Aly A. Farag,et al.  Multiresolution Approach for Noncontact Measurements of Arterial Pulse Using Thermal Imaging , 2009 .

[23]  W. Walas,et al.  Iatrogenic skin injury in the neonatal intensive care unit , 2011, The journal of maternal-fetal & neonatal medicine : the official journal of the European Association of Perinatal Medicine, the Federation of Asia and Oceania Perinatal Societies, the International Society of Perinatal Obstetricians.

[24]  Ming Yang,et al.  Vital sign estimation from passive thermal video , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[26]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[27]  Alexei A. Kamshilin,et al.  Photoplethysmographic imaging of high spatial resolution , 2011, Biomedical optics express.

[28]  Albert van der Veen,et al.  Development of a baby friendly non-contact method for measuring vital signs: First results of clinical measurements in an open incubator at a neonatal intensive care unit , 2014, Photonics West - Biomedical Optics.

[29]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .