Criterion validity of wearable monitors and smartphone applications to measure physical activity energy expenditure in adolescents

Purpose This study examined the criterion validity of one research-based, one GPS and two consumer-based monitors, as well as six freeware Android apps (three pedometer- and three GPS-based apps) in a sample of healthy adolescents, during self-paced outdoor walking and running. Methods Twenty-one adolescents (15.9 ± 2.0 years) participated in this cross-sectional study. They walked and ran a distance of 1.2 km for each trial. They were fitted with SenseWear Armband Pro 3, Garmin Forerunner 310XT, Garmin Vivofit, Medisana Vifit, and smartphones running the Runkeeper, Runtastic, Sports Tracker, Pedometer, Accupedo, Pedometer and Pedometer 2.0 apps. Estimation of PAEE was compared to measurement from indirect calorimetry. Repeated measures ANOVA, mean absolute percentage errors and Bland–Altman plots assessed accuracy and proportional bias. Results PAEE estimates from all monitors and apps showed large individual errors, ranging from 13.16% for walking (Runtastic) to 37.46% for running (Vifit). For group-level differences, Forerunner, Runkeeper, Runtastic and Accupedo significantly underestimated PAEE for walking, and SenseWear, Forerunner, Runkeeper, Vifit and Pedometer significantly underestimated PAEE for running. Conclusion Based on individual errors, none of the monitors and apps tested was accurate for estimating PAEE in adolescents. The only app that had an acceptable error was Runtastic during running. These monitors and apps are not suitable as research measurement tools for recording precise and accurate PAEE estimates.

[1]  Manolis Adamakis Physical activity in the era of mHealth big data: considerations on accuracy and bias , 2019 .

[2]  An Energy Expenditure Estimation Method Based on Heart Rate Measurement , 2007 .

[3]  M A Brodie,et al.  Big data vs accurate data in health research: Large-scale physical activity monitoring, smartphones, wearable devices and risk of unconscious bias. , 2018, Medical hypotheses.

[4]  Monique Simons,et al.  The Effect of Physical Activity Interventions Comprising Wearables and Smartphone Applications on Physical Activity: a Systematic Review and Meta-analysis , 2018, Sports Medicine - Open.

[5]  Antonio Monroy Antón,et al.  Runtastic PRO app: an excellent all-rounder for logging fitness , 2015, British Journal of Sports Medicine.

[6]  Danielle E. Jake-Schoffman,et al.  Using Commercial Physical Activity Trackers for Health Promotion Research: Four Case Studies , 2019, Health promotion practice.

[7]  G. Flores Mateo,et al.  Mobile Phone Apps to Promote Weight Loss and Increase Physical Activity: A Systematic Review and Meta-Analysis , 2015, Journal of medical Internet research.

[8]  Gregory J Welk,et al.  Validity of consumer-based physical activity monitors. , 2014, Medicine and science in sports and exercise.

[9]  Emily Anthes,et al.  Mental health: There’s an app for that , 2016, Nature.

[10]  Gregory J Welk,et al.  Comparison of Consumer and Research Monitors under Semistructured Settings. , 2016, Medicine and science in sports and exercise.

[11]  Ruairi O'Driscoll,et al.  How well do activity monitors estimate energy expenditure? A systematic review and meta-analysis of the validity of current technologies , 2020, British Journal of Sports Medicine.

[12]  R. Warner Applied statistics: From bivariate through multivariate techniques, 2nd ed. , 2013 .

[13]  Ulf Ekelund,et al.  A systematic literature review of reviews on techniques for physical activity measurement in adults: a DEDIPAC study , 2018, International Journal of Behavioral Nutrition and Physical Activity.

[14]  G. Welk,et al.  Validation of the SenseWear mini armband in children during semi-structure activity settings. , 2016, Journal of science and medicine in sport.

[15]  Ann V Rowlands,et al.  The Measurement and Interpretation of Children's Physical Activity. , 2007, Journal of sports science & medicine.

[16]  Timothy Baghurst,et al.  Considerations When Choosing a Fitness Tracking Device , 2018 .

[17]  Samuel R LaMunion,et al.  Use of Consumer Monitors for Estimating Energy Expenditure in Youth. , 2020, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[18]  M. Delgado-Rodríguez,et al.  Systematic review and meta-analysis. , 2017, Medicina intensiva.

[19]  Gregory J Welk,et al.  Validation of pattern-recognition monitors in children using doubly labeled water. , 2013, Medicine and science in sports and exercise.

[20]  C. Vandelanotte,et al.  Efficacy of interventions that use apps to improve diet, physical activity and sedentary behaviour: a systematic review , 2016, International Journal of Behavioral Nutrition and Physical Activity.

[21]  Balazs Laurenczy,et al.  Accuracy of a smartphone pedometer application according to different speeds and mobile phone locations in a laboratory context , 2018, Journal of exercise science and fitness.

[22]  R A Boileau,et al.  Skinfold equations for estimation of body fatness in children and youth. , 1988, Human biology.

[23]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[24]  A Martinez-Nicolas,et al.  Runkeeper: a complete app for monitoring outdoor sports , 2016, British Journal of Sports Medicine.

[25]  J. B. Weir New methods for calculating metabolic rate with special reference to protein metabolism , 1949, The Journal of physiology.

[26]  P. Thompson,et al.  ACSM's Guidelines for Exercise Testing and Prescription , 1995 .

[27]  R. Warner Applied Statistics: From Bivariate through Multivariate Techniques [with CD-ROM]. , 2007 .

[28]  Esha Arora,et al.  Validity of Mobile-Based Technology vs Direct Observation in Measuring Number of Steps and Distance Walked in 6 Minutes. , 2018, Mayo Clinic proceedings.

[29]  U. Ekelund,et al.  Effect of pedometer-based walking interventions on long-term health outcomes: Prospective 4-year follow-up of two randomised controlled trials using routine primary care data , 2019, PLoS medicine.

[30]  N. Ramli,et al.  Filling Missing Data Using Interpolation Methods: Study on the Effect of Fitting Distribution , 2013 .

[31]  C. Compher,et al.  Best practice methods to apply to measurement of resting metabolic rate in adults: a systematic review. , 2006, Journal of the American Dietetic Association.

[32]  Zoran Milanović,et al.  Accupedo pedometer: daily walking step counter , 2016, British Journal of Sports Medicine.

[33]  C Höchsmann,et al.  Validity of activity trackers, smartphones, and phone applications to measure steps in various walking conditions , 2018, Scandinavian journal of medicine & science in sports.

[34]  Yeh-Liang Hsu,et al.  A Review of Accelerometry-Based Wearable Motion Detectors for Physical Activity Monitoring , 2010, Sensors.

[35]  Enhad A. Chowdhury,et al.  Assessment of laboratory and daily energy expenditure estimates from consumer multi-sensor physical activity monitors , 2017, PloS one.

[36]  Nuala M. Byrne,et al.  Assessment of Physical Activity and Energy Expenditure: An Overview of Objective Measures , 2014, Front. Nutr..

[37]  J. Leskovec,et al.  Large-scale physical activity data reveal worldwide activity inequality , 2017, Nature.

[38]  M Benjamin Nelson,et al.  Validity of Consumer-Based Physical Activity Monitors for Specific Activity Types. , 2016, Medicine and science in sports and exercise.

[39]  Sarah Kozey Keadle,et al.  Perspectives for Progress - A Framework to Evaluate Devices that Assess Physical Behavior. , 2019, Exercise and sport sciences reviews.

[40]  M. Murphy,et al.  Effects of frequency, intensity, duration and volume of walking interventions on CVD risk factors: a systematic review and meta-regression analysis of randomised controlled trials among inactive healthy adults , 2018, British Journal of Sports Medicine.

[41]  Jyh Eiin Wong,et al.  Accuracy of three Android-based pedometer applications in laboratory and free-living settings , 2017, Journal of sports sciences.