Accuracy in Wrist-Worn, Sensor-Based Measurements of Heart Rate and Energy Expenditure in a Diverse Cohort

The ability to measure physical activity through wrist-worn devices provides an opportunity for cardiovascular medicine. However, the accuracy of commercial devices is largely unknown. The aim of this work is to assess the accuracy of seven commercially available wrist-worn devices in estimating heart rate (HR) and energy expenditure (EE) and to propose a wearable sensor evaluation framework. We evaluated the Apple Watch, Basis Peak, Fitbit Surge, Microsoft Band, Mio Alpha 2, PulseOn, and Samsung Gear S2. Participants wore devices while being simultaneously assessed with continuous telemetry and indirect calorimetry while sitting, walking, running, and cycling. Sixty volunteers (29 male, 31 female, age 38 ± 11 years) of diverse age, height, weight, skin tone, and fitness level were selected. Error in HR and EE was computed for each subject/device/activity combination. Devices reported the lowest error for cycling and the highest for walking. Device error was higher for males, greater body mass index, darker skin tone, and walking. Six of the devices achieved a median error for HR below 5% during cycling. No device achieved an error in EE below 20 percent. The Apple Watch achieved the lowest overall error in both HR and EE, while the Samsung Gear S2 reported the highest. In conclusion, most wrist-worn devices adequately measure HR in laboratory-based activities, but poorly estimate EE, suggesting caution in the use of EE measurements as part of health improvement programs. We propose reference standards for the validation of consumer health devices (http://precision.stanford.edu/).

[1]  I. Åstrand Aerobic work capacity in men and women with special reference to age. , 1960, Acta physiologica Scandinavica. Supplementum.

[2]  T. Fitzpatrick The validity and practicality of sun-reactive skin types I through VI. , 1988, Archives of dermatology.

[3]  E. Heath Borg's Perceived Exertion and Pain Scales , 1998 .

[4]  S. Glass,et al.  ACSM's metabolic Calculations Handbook , 2006 .

[5]  Stephen Glass,et al.  ACSM'S metabolic calculations handbook /American College of Sports Medicine ; editors Stephen Glass, Gregory B. Dwyer , 2007 .

[6]  C. Champagne,et al.  Weight loss during the intensive intervention phase of the weight-loss maintenance trial. , 2008, American journal of preventive medicine.

[7]  L B Sardinha,et al.  Accuracy of a combined heart rate and motion sensor for assessing energy expenditure in free-living adults during a double-blind crossover caffeine trial using doubly labeled water as the reference method , 2014, European Journal of Clinical Nutrition.

[8]  Generalized Estimating Equations: Introduction , 2014 .

[9]  Ciprian M. Crainiceanu,et al.  Estimating Energy Expenditure from Heart Rate in Older Adults: A Case for Calibration , 2014, PloS one.

[10]  Andriy Temko,et al.  Estimation of heart rate from photoplethysmography during physical exercise using Wiener filtering and the phase vocoder , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  P. Krebs,et al.  Health App Use Among US Mobile Phone Owners: A National Survey , 2015, JMIR mHealth and uHealth.

[12]  Roozbeh Jafari,et al.  Robust heart rate estimation using wrist-based PPG signals in the presence of intense physical activities , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  Paul W. Franks,et al.  Estimation of Free-Living Energy Expenditure by Heart Rate and Movement Sensing: A Doubly-Labelled Water Study , 2015, PloS one.

[14]  24-hour Measurement Of Sleep, Sedentary, And Physical Activity Behaviors With Wearable Monitors: 431 Board #282 May 27, 9 , 2015 .

[15]  Zhilin Zhang,et al.  TROIKA: A General Framework for Heart Rate Monitoring Using Wrist-Type Photoplethysmographic Signals During Intensive Physical Exercise , 2014, IEEE Transactions on Biomedical Engineering.

[16]  Mark H. Wright,et al.  The Next Generation Precision Medical Record - A Framework for Integrating Genomes and Wearable Sensors with Medical Records , 2016, bioRxiv.

[17]  Mohanasankar Sivaprakasam,et al.  Design, development and clinical validation of a wrist-based optical heart rate monitor , 2016, 2016 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[18]  Patty S Freedson,et al.  Utility of Consumer Physical Activity Trackers as an Intervention Tool in Cardiovascular Disease Prevention and Treatment. , 2016, Progress in cardiovascular diseases.

[19]  Matthew P Buman,et al.  Twenty-four Hours of Sleep, Sedentary Behavior, and Physical Activity with Nine Wearable Devices. , 2016, Medicine and science in sports and exercise.

[20]  L. Leininger,et al.  Validation And Accuracy Of Fitbit Charge: A Pilot Study In A University Worksite Walking Program: 362 Board #199 June 1, 11: 00 AM - 12: 30 PM. , 2016, Medicine and science in sports and exercise.

[21]  U. Wisløff,et al.  Accuracy of Heart Rate Watches: Implications for Weight Management , 2016, PloS one.

[22]  Wolfgang Schramm,et al.  Team , 2018, Spaces of Intensity.