Validation of the Apple Watch for Heart Rate Variability Measurements during Relax and Mental Stress in Healthy Subjects

Heart rate variability (HRV) analysis is a noninvasive tool widely used to assess autonomic nervous system state. The market for wearable devices that measure the heart rate has grown exponentially, as well as their potential use for healthcare and wellbeing applications. Still, there is a lack of validation of these devices. In particular, this work aims to validate the Apple Watch in terms of HRV derived from the RR interval series provided by the device, both in temporal (HRM (mean heart rate), SDNN, RMSSD and pNN50) and frequency (low and high frequency powers, LF and HF) domain. For this purpose, a database of 20 healthy volunteers subjected to relax and a mild cognitive stress was used. First, RR interval series provided by Apple Watch were validated using as reference the RR interval series provided by a Polar H7 using Bland-Altman plots and reliability and agreement coefficients. Then, HRV parameters derived from both RR interval series were compared and their ability to identify autonomic nervous system (ANS) response to mild cognitive stress was studied. Apple Watch measurements presented very good reliability and agreement (>0.9). RR interval series provided by Apple Watch contain gaps due to missing RR interval values (on average, 5 gaps per recording, lasting 6.5 s per gap). Temporal HRV indices were not significantly affected by the gaps. However, they produced a significant decrease in the LF and HF power. Despite these differences, HRV indices derived from the Apple Watch RR interval series were able to reflect changes induced by a mild mental stress, showing a significant decrease of HF power as well as RMSSD in stress with respect to relax, suggesting the potential use of HRV measurements derived from Apple Watch for stress monitoring.

[1]  M. Buchheit Monitoring training status with HR measures: do all roads lead to Rome? , 2014, Front. Physiol..

[2]  Misha Pavel,et al.  Evaluation of the accuracy and reliability for photoplethysmography based heart rate and beat-to-beat detection during daily activities , 2017 .

[3]  Luca Citi,et al.  Nonlinear digital signal processing in mental health: characterization of major depression using instantaneous entropy measures of heartbeat dynamics , 2015, Front. Physiol..

[4]  Andrew E. Kilding,et al.  Training Adaptation and Heart Rate Variability in Elite Endurance Athletes: Opening the Door to Effective Monitoring , 2013, Sports Medicine.

[5]  G. Billman Heart Rate Variability – A Historical Perspective , 2011, Front. Physio..

[6]  Jesús Lázaro,et al.  Inclusion of Respiratory Frequency Information in Heart Rate Variability Analysis for Stress Assessment , 2016, IEEE Journal of Biomedical and Health Informatics.

[7]  Matthias Weippert,et al.  Heart Rate Variability and Blood Pressure during Dynamic and Static Exercise at Similar Heart Rate Levels , 2013, PloS one.

[8]  André Souto,et al.  Assessment of disagreement: a new information-based approach. , 2010, Annals of epidemiology.

[9]  M. Kendall Statistical Methods for Research Workers , 1937, Nature.

[10]  Pablo Laguna,et al.  Drowsiness detection using heart rate variability , 2016, Medical & Biological Engineering & Computing.

[11]  D. Bai,et al.  Stress and Heart Rate Variability: A Meta-Analysis and Review of the Literature , 2018, Psychiatry investigation.

[12]  Paul Hibbing,et al.  Comparative evaluation of heart rate-based monitors: Apple Watch vs Fitbit Charge HR , 2018, Journal of sports sciences.

[13]  F. Gamelin,et al.  Validity of the Polar S810 to Measure R-R Intervals in Children , 2007, International journal of sports medicine.

[14]  David Nunan,et al.  Levels of agreement for RR intervals and short-term heart rate variability obtained from the Polar S810 and an alternative system , 2008, European Journal of Applied Physiology.

[15]  T. Hastie,et al.  Accuracy in Wrist-Worn, Sensor-Based Measurements of Heart Rate and Energy Expenditure in a Diverse Cohort , 2016, bioRxiv.

[16]  Grant Abt,et al.  The validity and inter-device variability of the Apple Watch™ for measuring maximal heart rate , 2018, Journal of sports sciences.

[17]  C. Earnest,et al.  Heart Rate Variability Threshold Values for Early-Warning Nonfunctional Overreaching in Elite Female Wrestlers , 2013, Journal of strength and conditioning research.

[18]  J. Thayer,et al.  eview meta-analysis of heart rate variability and neuroimaging studies : Implications or heart rate variability as a marker of stress and health , 2012 .

[19]  S. Porges Cardiac vagal tone: A physiological index of stress , 1995, Neuroscience & Biobehavioral Reviews.

[20]  Hannu Kinnunen,et al.  Endurance training guided individually by daily heart rate variability measurements , 2007, European Journal of Applied Physiology.

[21]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[22]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[23]  J. Sacha,et al.  Interplay between heart rate and its variability: a prognostic game , 2014, Front. Physiol..

[24]  M. Kaess,et al.  Depression and resting state heart rate variability in children and adolescents - A systematic review and meta-analysis. , 2016, Clinical psychology review.

[25]  Pablo Laguna,et al.  The Integral Pulse Frequency Modulation Model With Time-Varying Threshold: Application to Heart Rate Variability Analysis During Exercise Stress Testing , 2011, IEEE Transactions on Biomedical Engineering.

[26]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[27]  Pablo Laguna,et al.  Improved heart rate variability signal analysis from the beat occurrence times according to the IPFM model , 2000, IEEE Transactions on Biomedical Engineering.

[28]  Raquel Bailón,et al.  Validation of Heart Rate Monitor Polar RS800 for Heart Rate Variability Analysis During Exercise , 2016, Journal of strength and conditioning research.

[29]  Dermot Phelan,et al.  Accuracy of Wrist-Worn Heart Rate Monitors , 2017, JAMA cardiology.

[30]  J. Thayer,et al.  Heart rate variability as a transdiagnostic biomarker of psychopathology. , 2015, International Journal of Psychophysiology.

[31]  Pablo Laguna,et al.  Human emotion recognition using heart rate variability analysis with spectral bands based on respiration , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  C. M. Pastre,et al.  Comparison of Polar® RS800G3™ heart rate monitor with Polar® S810i™ and electrocardiogram to obtain the series of RR intervals and analysis of heart rate variability at rest , 2016, Clinical physiology and functional imaging.

[33]  Grant Abt,et al.  Validity and Reliability of the Apple Watch for Measuring Heart Rate During Exercise , 2017, Sports Medicine International Open.

[34]  L. Lin,et al.  A concordance correlation coefficient to evaluate reproducibility. , 1989, Biometrics.

[35]  Pedro Gomis,et al.  Validity of the Polar V800 monitor for measuring heart rate variability in mountain running route conditions , 2018, European Journal of Applied Physiology.

[36]  David Giles,et al.  Validity of the Polar V800 heart rate monitor to measure RR intervals at rest , 2015, European Journal of Applied Physiology.

[37]  Lino Nobili,et al.  Heart rate variability in normal and pathological sleep , 2013, Front. Physiol..

[38]  P. Laguna,et al.  Photoplethysmography pulse rate variability as a surrogate measurement of heart rate variability during non-stationary conditions , 2010, Physiological measurement.

[39]  U. Wisløff,et al.  Accuracy of Heart Rate Watches: Implications for Weight Management , 2016, PloS one.