Mobile Apps to Quantify Aspects of Physical Activity: a Systematic Review on its Reliability and Validity

The purpose of this study was to systematically review and evaluate the evidence on the accuracy (validity) and consistency (reliability) of mobile apps used to quantify physical activity. Systematic literature searches were conducted in Pubmed, Science Direct, Web of Science, Physiotherapy Evidence Database (PEDro), Academic Search Complete and IEEE Xplore. Studies were included if they reported on the validity and/or reliability of a mobile application aiming primarily at measuring physical activity in humans with or without pathology. The reference lists of included articles were also screened for reports not identified through electronic searches. The methodological quality of included studies was assessed by 2 independent reviewers and data extracted by one reviewer and checked for accuracy by a second reviewer. A total of 25 articles were included in this review, of which 18 refer to validity and 7 to both validity and reliability. Mean percentage difference was used as an indicator of validity and varied between 0.1% and 79.3%. Intraclass Correlation Coefficients varied between 0.02 and 0.99 indicating poor to excellent reliability. There is conflicting and insufficient evidence on the validity and reliability, respectively, of apps for measuring physical activity. Nevertheless, velocity and the place where the smartphone is carried seem to have an impact on validity.

[1]  Kathleenl N. Lohr,et al.  Assessing health status and quality-of-life instruments: Attributes and review criteria , 2002, Quality of Life Research.

[2]  Thierry Troosters,et al.  A Mobile Phone App to Stimulate Daily Physical Activity in Patients with Chronic Obstructive Pulmonary Disease: Development, Feasibility, and Pilot Studies , 2016, JMIR mHealth and uHealth.

[3]  Thea J. M. Kooiman,et al.  Reliability and Validity of Ten Consumer Activity Trackers Depend on Walking Speed , 2017, Medicine and science in sports and exercise.

[4]  Gabriela Tomedi Leites,et al.  Prevalence of insufficient physical activity in adolescents in South Brazil , 2013 .

[5]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[6]  M. Tremblay,et al.  A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review , 2008, The international journal of behavioral nutrition and physical activity.

[7]  A. Söderlund,et al.  Investigation of the validity and reliability of a smartphone pedometer application , 2016 .

[8]  J. Weir Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. , 2005, Journal of strength and conditioning research.

[9]  Nelson Pacheco da Rocha,et al.  Higher Pain Intensity, Depression, and Being 75 Years or Older are Associated with Lower Levels of Self-Reported Physical Activity in Older Adults with Pain Attending Primary Care , 2016 .

[10]  J. Stessman,et al.  Physical activity and health service utilization among older people. , 2013, Journal of the American Medical Directors Association.

[11]  Ashraf Khalil,et al.  StepUp: A step counter mobile application to promote healthy lifestyle , 2009, 2009 International Conference on the Current Trends in Information Technology (CTIT).

[12]  Q. Louw,et al.  Clinical instruments: reliability and validity critical appraisal. , 2012, Journal of evaluation in clinical practice.

[13]  C. Terwee,et al.  Quality criteria were proposed for measurement properties of health status questionnaires. , 2007, Journal of clinical epidemiology.

[14]  S. Walter,et al.  Sample size and optimal designs for reliability studies. , 1998, Statistics in medicine.

[15]  K. Charlton,et al.  Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods , 2015, Nutrition Journal.

[16]  Nicholas D. Gilson,et al.  Measuring and Influencing Physical Activity with Smartphone Technology: A Systematic Review , 2014, Sports Medicine.

[17]  Alexander Woll,et al.  Long-term health benefits of physical activity – a systematic review of longitudinal studies , 2013, BMC Public Health.

[18]  Junqing Xie,et al.  Evaluating the Validity of Current Mainstream Wearable Devices in Fitness Tracking Under Various Physical Activities: Comparative Study , 2018, JMIR mHealth and uHealth.

[19]  Jordi Alonso,et al.  The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: A clarification of its content , 2010, BMC medical research methodology.

[20]  Harshvardhan Vathsangam,et al.  Quantifying Human Movement Using the Movn Smartphone App: Validation and Field Study , 2017, JMIR mHealth and uHealth.

[21]  W. Eungpinichpong,et al.  Validity and Reliability of Smartphone Applications for the Assessment of Walking and Running in Normal-weight and Overweight/Obese Young Adults. , 2016, Journal of physical activity & health.

[22]  Guy Faulkner,et al.  Walk this way: validity evidence of iphone health application step count in laboratory and free-living conditions , 2018, Journal of sports sciences.

[23]  Nicholas D Gilson,et al.  Monitoring sedentary patterns in office employees: validity of an m-health tool (Walk@Work-App) for occupational health. , 2017, Gaceta sanitaria.

[24]  Thomas P. Schmalzried,et al.  The accuracy of personal activity monitoring devices , 2017 .

[25]  D. Streiner,et al.  Health Measurement Scales: A practical guide to thier development and use , 1989 .

[26]  Feasibility, validity and reliability of objective smartphone measurements of physical activity and fitness in patients with cancer , 2018, BMC Cancer.

[27]  Anabela G. Silva,et al.  Functioning and primary healthcare utilization in older adults: a 1-year follow-up study , 2019, Physiotherapy theory and practice.

[28]  J. Brug,et al.  Apps to promote physical activity among adults: a review and content analysis , 2014, International Journal of Behavioral Nutrition and Physical Activity.

[29]  Thierry Troosters,et al.  How to assess physical activity? How to assess physical fitness? , 2005, European journal of cardiovascular prevention and rehabilitation : official journal of the European Society of Cardiology, Working Groups on Epidemiology & Prevention and Cardiac Rehabilitation and Exercise Physiology.

[30]  Monika Pobiruchin,et al.  Accuracy and Adoption of Wearable Technology Used by Active Citizens: A Marathon Event Field Study , 2017, JMIR mHealth and uHealth.

[31]  L. Rajmil Health measurement scales. A practical guide to their development and use, 3rd ed , 2005 .

[32]  C Höchsmann,et al.  Validity of activity trackers, smartphones, and phone applications to measure steps in various walking conditions , 2018, Scandinavian journal of medicine & science in sports.

[33]  Guy Faulkner,et al.  Validity of smartphone pedometer applications , 2015, BMC Research Notes.

[34]  C. Rand,et al.  Can Commercially Available Pedometers Be Used For Physical Activity Monitoring In Patients With COPD Following Exacerbations? , 2016, Chronic obstructive pulmonary diseases.

[35]  Björn Ekblom,et al.  The importance of non-exercise physical activity for cardiovascular health and longevity , 2013, British Journal of Sports Medicine.

[36]  Djamel Belaïd,et al.  SmartFit: A Step Count Based Mobile Application for Engagement in Physical Activities , 2015 .

[37]  J. Spence,et al.  How many steps/day are enough? for adults , 2011, The international journal of behavioral nutrition and physical activity.

[38]  S. Wyke,et al.  Validation of smartphone step count algorithm used in STARFISH smartphone application. , 2017, Technology and health care : official journal of the European Society for Engineering and Medicine.

[39]  Shawn M. Bergman,et al.  Is there a valid app for that? Validity of a free pedometer iPhone application. , 2012, Journal of physical activity & health.

[40]  Catrine Tudor-Locke,et al.  A step-defined sedentary lifestyle index: <5000 steps/day. , 2013, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[41]  J Alonso,et al.  BMC Medical Research Methodology BioMed Central Study protocol Protocol of the COSMIN study: COnsensus-based Standards for the selection of health Measurement INstruments , 2006 .

[42]  Jyh Eiin Wong,et al.  Accuracy of three Android-based pedometer applications in laboratory and free-living settings , 2017, Journal of sports sciences.

[43]  L. Bruce,et al.  Physical activity intensity can be accurately monitored by smartphone global positioning system ‘app’ , 2016, European journal of sport science.

[44]  Lyndell Bruce,et al.  Reliability and validity of a GPS-enabled iPhoneTM “app” to measure physical activity , 2015, Journal of sports sciences.

[45]  C. Caspersen,et al.  Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. , 1985, Public health reports.

[46]  Balazs Laurenczy,et al.  Accuracy of a smartphone pedometer application according to different speeds and mobile phone locations in a laboratory context , 2018, Journal of exercise science and fitness.

[47]  M. Adamakis Comparing the Validity of a GPS Monitor and a Smartphone Application to Measure Physical Activity , 2017 .

[48]  Jatuporn Chinrungrueng,et al.  My act: an automatic detection of daily physical activity and calorie expenditure using smart phones , 2014 .