Criterion-Validity of Commercially Available Physical Activity Tracker to Estimate Step Count, Covered Distance and Energy Expenditure during Sports Conditions

Background: In the past years, there was an increasing development of physical activity tracker (Wearables). For recreational people, testing of these devices under walking or light jogging conditions might be sufficient. For (elite) athletes, however, scientific trustworthiness needs to be given for a broad spectrum of velocities or even fast changes in velocities reflecting the demands of the sport. Therefore, the aim was to evaluate the validity of eleven Wearables for monitoring step count, covered distance and energy expenditure (EE) under laboratory conditions with different constant and varying velocities. Methods: Twenty healthy sport students (10 men, 10 women) performed a running protocol consisting of four 5 min stages of different constant velocities (4.3; 7.2; 10.1; 13.0 km·h−1), a 5 min period of intermittent velocity, and a 2.4 km outdoor run (10.1 km·h−1) while wearing eleven different Wearables (Bodymedia Sensewear, Beurer AS 80, Polar Loop, Garmin Vivofit, Garmin Vivosmart, Garmin Vivoactive, Garmin Forerunner 920XT, Fitbit Charge, Fitbit Charge HR, Xaomi MiBand, Withings Pulse Ox). Step count, covered distance, and EE were evaluated by comparing each Wearable with a criterion method (Optogait system and manual counting for step count, treadmill for covered distance and indirect calorimetry for EE). Results: All Wearables, except Bodymedia Sensewear, Polar Loop, and Beurer AS80, revealed good validity (small MAPE, good ICC) for all constant and varying velocities for monitoring step count. For covered distance, all Wearables showed a very low ICC (<0.1) and high MAPE (up to 50%), revealing no good validity. The measurement of EE was acceptable for the Garmin, Fitbit and Withings Wearables (small to moderate MAPE), while Bodymedia Sensewear, Polar Loop, and Beurer AS80 showed a high MAPE up to 56% for all test conditions. Conclusion: In our study, most Wearables provide an acceptable level of validity for step counts at different constant and intermittent running velocities reflecting sports conditions. However, the covered distance, as well as the EE could not be assessed validly with the investigated Wearables. Consequently, covered distance and EE should not be monitored with the presented Wearables, in sport specific conditions.

[1]  D. Bassett,et al.  Calibration and validation of wearable monitors. , 2012, Medicine and science in sports and exercise.

[2]  D. Macfarlane,et al.  Validity, reliability and stability of the portable Cortex Metamax 3B gas analysis system , 2011, European Journal of Applied Physiology.

[3]  Linda E Rohr,et al.  Accuracy of the vivofit activity tracker , 2016, Journal of medical engineering & technology.

[4]  Catrine Tudor-Locke,et al.  Evaluation of Quality of Commercial Pedometers , 2006, Canadian Journal of Public Health.

[5]  Walter R. Thompson,et al.  WORLDWIDE SURVEY OF FITNESS TRENDS FOR 2017 , 2010, ACSM'S Health & Fitness Journal.

[6]  Mohamed Ismail Nounou,et al.  Are Currently Available Wearable Devices for Activity Tracking and Heart Rate Monitoring Accurate, Precise, and Medically Beneficial? , 2015, Healthcare informatics research.

[7]  John R. B. Lighton Measuring metabolic rates , 2008 .

[8]  Billy Sperlich,et al.  Instant Biofeedback Provided by Wearable Sensor Technology Can Help to Optimize Exercise and Prevent Injury and Overuse , 2017, Front. Physiol..

[9]  Cloe Cummins,et al.  Global Positioning Systems (GPS) and Microtechnology Sensors in Team Sports: A Systematic Review , 2013, Sports Medicine.

[10]  Catrine Tudor-Locke,et al.  Évaluation de la qualité des podomètres commerciaux , 2006 .

[11]  C. Gore,et al.  Validity and reliability of the Cortex MetaMax3B portable metabolic system , 2010, Journal of sports sciences.

[12]  K. Price,et al.  Validation of the Fitbit One, Garmin Vivofit and Jawbone UP activity tracker in estimation of energy expenditure during treadmill walking and running , 2017, Journal of medical engineering & technology.

[13]  J. Takács,et al.  Validation of the Fitbit One activity monitor device during treadmill walking. , 2014, Journal of science and medicine in sport.

[14]  Yoav Meckel,et al.  Preferred transition speed between walking and running: effects of training status. , 2005, Medicine and science in sports and exercise.

[15]  Franz Konstantin Fuss,et al.  Comparison of Non-Invasive Individual Monitoring of the Training and Health of Athletes with Commercially Available Wearable Technologies , 2016, Front. Physiol..

[16]  Billy Sperlich,et al.  Wearable, yes, but able…?: it is time for evidence-based marketing claims! , 2016, British Journal of Sports Medicine.

[17]  Nuala M. Byrne,et al.  Assessment of Physical Activity and Energy Expenditure: An Overview of Objective Measures , 2014, Front. Nutr..

[18]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[19]  W. D. McArdle,et al.  Essentials of Exercise Physiology , 1981 .

[20]  Gregory J Welk,et al.  Comparison of Consumer and Research Monitors under Semistructured Settings. , 2016, Medicine and science in sports and exercise.

[21]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[22]  Changho Song,et al.  Agreement between the spatio-temporal gait parameters from treadmill-based photoelectric cell and the instrumented treadmill system in healthy young adults and stroke patients , 2014, Medical science monitor : international medical journal of experimental and clinical research.

[23]  John R. B. Lighton,et al.  Measuring Metabolic Rates , 2008 .

[24]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[25]  J. Schwartz,et al.  Abstract MP11: Fitbit: An Accurate and Reliable Device for Wireless Physical Activity Tracking , 2015 .

[26]  G. Welk,et al.  How valid are wearable physical activity trackers for measuring steps? , 2017, European journal of sport science.

[27]  Walter R. Thompson,et al.  WORLDWIDE SURVEY OF FITNESS TRENDS FOR 2016: 10th Anniversary Edition , 2015 .