Evaluation of Earbud and Wristwatch Heart Rate Monitors during Aerobic and Resistance Training

Assessment of biometrics during exercise is evolving to create devices that are “all-inclusive”, in an effort to decrease the number of devices required during exercise while providing comprehensive and accurate biometric measures. The purpose of this study was to determine the accuracy of two optical heart rate monitors, the Jabra earbud and the Mio Alpha wristwatch, during aerobic and anaerobic exercise. Twenty-two recreationally active participants (25.4 ± 6.9 years, 171 ± 11 cm, 73.9 ± 3.1 kg, and 25.2 ± 9.2% body fat) completed this study. Participants completed 30 minutes of treadmill activity, 25 minutes of high-intensity interval exercise (HIT), and 40 minutes of continuous outdoor activity of their choice, walking or running. Three heart rate (HR) monitors, (Polar chest strap, Mio Alpha, Jabra earbud) were worn during all exercises, with the Polar chest strap serving as the benchmark. HR was assessed in one-second intervals. Analyses included mean bias, mean absolute percent error (MAPE), and Lin’s concordance coefficient. Overall, the Mio Alpha had a MAPE of 5.73 ± 10.19% and a moderate correlation with the benchmark, r(c) = 0.771, performing better in the treadmill and outdoor conditions. The Jabra earbud had a MAPE of 3.14 ± 6.13%, and a high correlation with the benchmark, r(c) = 0.939, performing well in all three conditions. Placing a HR monitor in an earbud is a viable option for obtaining an accurate HR assessment during different types of exercise. The accuracy of the Mio Alpha was likely affected by wrist movements during the HIT training.

[1]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2004, Journal international de bioethique = International journal of bioethics.

[2]  D. Hollander,et al.  Validity of Wearable Activity Monitors during Cycling and Resistance Exercise , 2017, Medicine and science in sports and exercise.

[3]  G. Welk,et al.  How valid are wearable physical activity trackers for measuring steps? , 2017, European journal of sport science.

[4]  Zohn Rosen,et al.  Validation of photoplethysmography as a method to detect heart rate during rest and exercise , 2015, Journal of medical engineering & technology.

[5]  Miao-Ju Hsu,et al.  Accuracy of Wristband Activity Monitors during Ambulation and Activities. , 2016, Medicine and science in sports and exercise.

[6]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[7]  B. A. Dolezal,et al.  Validation of Heart Rate Derived from a Physiological Status Monitor-Embedded Compression Shirt Against Criterion ECG , 2014, Journal of occupational and environmental hygiene.

[8]  J. W. Lewis,et al.  A note on concordance correlation coefficient. , 2000, PDA journal of pharmaceutical science and technology.

[9]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[10]  I. Mcalister,et al.  Wrist-Worn Physical Activity Trackers Tend To Underestimate Steps During Walking , 2017 .

[11]  Rosalind W. Picard,et al.  Cardiovascular Monitoring Using Earphones and a Mobile Device , 2012, IEEE Pervasive Computing.

[12]  Leo R. Quinlan,et al.  These Shoes Are Made for Walking: Sensitivity Performance Evaluation of Commercial Activity Monitors under the Expected Conditions and Circumstances Required to Achieve the International Daily Step Goal of 10,000 Steps , 2016, PloS one.

[13]  Tibert Verhagen,et al.  Health empowerment through activity trackers: An empirical smart wristband study , 2016, Comput. Hum. Behav..

[14]  R. Laukkanen,et al.  Heart rate monitors: state of the art. , 1998, Journal of sports sciences.

[15]  Jakub Parák,et al.  Evaluation of wearable consumer heart rate monitors based on photopletysmography , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  Junkai Xu,et al.  Validity of FitBit, Jawbone UP, Nike+ and other wearable devices for level and stair walking. , 2016, Gait & posture.

[17]  Thierry Troosters,et al.  Validity of activity monitors in health and chronic disease: a systematic review , 2012, International Journal of Behavioral Nutrition and Physical Activity.

[18]  Catrine Tudor-Locke,et al.  Evaluation of Quality of Commercial Pedometers , 2006, Canadian Journal of Public Health.

[19]  B. Dolezal,et al.  Validation of Biofeedback Wearables for Photoplethysmographic Heart Rate Tracking. , 2016, Journal of sports science & medicine.

[20]  Scott E Crouter,et al.  Accuracy of Consumer Monitors for Estimating Energy Expenditure and Activity Type , 2017, Medicine and science in sports and exercise.

[21]  Hyun-Sung An,et al.  How accurate are the wrist-based heart rate monitors during walking and running activities? Are they accurate enough? , 2016, BMJ Open Sport & Exercise Medicine.

[22]  Jennifer A Bunn,et al.  Assessment of step accuracy using the Consumer Technology Association standard , 2018, Journal of sports sciences.

[23]  Elizabeth J Lyons,et al.  Behavior Change Techniques Implemented in Electronic Lifestyle Activity Monitors: A Systematic Content Analysis , 2014, Journal of medical Internet research.

[24]  Hoda Javadikasgari,et al.  Variable Accuracy of Wearable Heart Rate Monitors during Aerobic Exercise , 2017, Medicine and science in sports and exercise.

[25]  Thea J. M. Kooiman,et al.  Reliability and Validity of Ten Consumer Activity Trackers Depend on Walking Speed , 2017, Medicine and science in sports and exercise.

[26]  M Benjamin Nelson,et al.  Validity of Consumer-Based Physical Activity Monitors for Specific Activity Types. , 2016, Medicine and science in sports and exercise.

[27]  B. Dolezal,et al.  Validity of Seven Commercially Available Heart Rate Monitors , 2002 .

[28]  Dermot Phelan,et al.  Accuracy of Wrist-Worn Heart Rate Monitors , 2017, JAMA cardiology.

[29]  U. Wisløff,et al.  Accuracy of Heart Rate Watches: Implications for Weight Management , 2016, PloS one.

[30]  Steven Francis Leboeuf,et al.  Earbud-based sensor for the assessment of energy expenditure, HR, and VO2max. , 2014, Medicine and science in sports and exercise.