Evaluating the accuracy of heart rate sensors based on photoplethysmography for in-the-wild analysis

Continuous measurement of physiological functions, like heart rate (HR) and heart rate variability (HRV), using commercially available wearable sensors provides the prospects of improving the healthcare of individuals with a positive impact on society, bringing pervasiveness, lower cost, and broader access. However, common wearable devices use photoplethysmography (PPG) to derive data on HR and HRV, and it is yet unclear to which extent PPG signals can be used as a proxy for data collected using medical-grade devices. To address this challenge, we consider five consumer devices to assess the signal quality of HR and two devices measuring HRV and compare them with a standard electrocardiography (ECG) Holter monitor. We collect data from fourteen participants who followed a 55 minutes protocol for at least two sessions. Using this data set, which we make publicly available to the research community, we show that PPG is a valid proxy for both HR and standard time- and frequency-domain measurements of HRV. Further, we demonstrate that wearable devices are suitable for monitoring both HR and HRV in daily life but might be limited during strenuous exercise. The study indicates that armband-based devices are more reliable than wrist-based wearables for HRV assessment.

[1]  David Nunan,et al.  Levels of agreement for RR intervals and short-term heart rate variability obtained from the Polar S810 and an alternative system , 2008, European Journal of Applied Physiology.

[2]  J. Vagedes,et al.  How accurate is pulse rate variability as an estimate of heart rate variability? A review on studies comparing photoplethysmographic technology with an electrocardiogram. , 2013, International journal of cardiology.

[3]  Liliana Barrios,et al.  Recognizing Digital Biomarkers for Fatigue Assessment in Patients with Multiple Sclerosis , 2018 .

[4]  Jakub Parák,et al.  Evaluation of wearable consumer heart rate monitors based on photopletysmography , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  D. Bonaduce,et al.  Independent and incremental prognostic value of heart rate variability in patients with chronic heart failure. , 1999, American heart journal.

[6]  F. Shaffer,et al.  An Overview of Heart Rate Variability Metrics and Norms , 2017, Front. Public Health.

[7]  B Maisch,et al.  Report of the 1995 World Health Organization/International Society and Federation of Cardiology Task Force on the Definition and Classification of cardiomyopathies. , 1996, Circulation.

[8]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[9]  Andreas V Larentzakis,et al.  Can Wearable Devices Accurately Measure Heart Rate Variability? A Systematic Review , 2018, Folia medica.

[10]  Meena Kumari,et al.  Work stress and coronary heart disease: what are the mechanisms? , 2008, European heart journal.

[11]  Andy Adler,et al.  Validation of the Empatica E4 wristband , 2016, 2016 IEEE EMBS International Student Conference (ISC).

[12]  Patrick E. McSharry,et al.  A dynamical model for generating synthetic electrocardiogram signals , 2003, IEEE Transactions on Biomedical Engineering.

[13]  C. Ramsay,et al.  A photoelectric plethysmograph for the measurement of cutaneous blood flow. , 1974, Physics in medicine and biology.

[14]  Julian F. Thayer,et al.  The role of vagal function in the risk for cardiovascular disease and mortality , 2007, Biological Psychology.

[15]  K. Felmingham,et al.  Impact of Depression and Antidepressant Treatment on Heart Rate Variability: A Review and Meta-Analysis , 2010, Biological Psychiatry.

[16]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[17]  Raquel Bailón,et al.  Validation of Heart Rate Monitor Polar RS800 for Heart Rate Variability Analysis During Exercise , 2016, Journal of strength and conditioning research.

[18]  Aldo Quattrone,et al.  Comparison between Electrocardiographic and Earlobe Pulse Photoplethysmographic Detection for Evaluating Heart Rate Variability in Healthy Subjects in Short- and Long-Term Recordings , 2018, Sensors.

[19]  Merrill D. Funk,et al.  Validity of wrist-worn consumer products to measure heart rate and energy expenditure , 2018, Digital health.

[20]  Kyung-Sup Kwak,et al.  The Internet of Things for Health Care: A Comprehensive Survey , 2015, IEEE Access.

[21]  Glen M. Davis,et al.  Cardiac Autonomic Responses during Exercise and Post-exercise Recovery Using Heart Rate Variability and Systolic Time Intervals—A Review , 2017, Front. Physiol..

[22]  Pablo Laguna,et al.  Influence of Running Stride Frequency in Heart Rate Variability Analysis During Treadmill Exercise Testing , 2013, IEEE Transactions on Biomedical Engineering.

[23]  Hye Rim Cho,et al.  A graphene-based electrochemical device with thermoresponsive microneedles for diabetes monitoring and therapy. , 2016, Nature nanotechnology.

[24]  U. Wisløff,et al.  Accuracy of Heart Rate Watches: Implications for Weight Management , 2016, PloS one.

[25]  Sinziana Mazilu,et al.  GaitAssist: a daily-life support and training system for parkinson's disease patients with freezing of gait , 2014, CHI.

[26]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[27]  David Giles,et al.  Validity of the Polar V800 heart rate monitor to measure RR intervals at rest , 2015, European Journal of Applied Physiology.

[28]  B. Dolezal,et al.  Validation of Biofeedback Wearables for Photoplethysmographic Heart Rate Tracking. , 2016, Journal of sports science & medicine.

[29]  R. Edelberg,et al.  Comparison of finger plethysmograph to ECG in the measurement of heart rate variability. , 2002, Psychophysiology.