Evaluation of mobile applications for fitness training and physical activity in healthy low-trained people - A modular interdisciplinary framework

Abstract Numerous mobile applications are available that aim at supporting sustainable physical activity and fitness training in sedentary or low-trained healthy people. However, the evaluation of the quality of these applications often suffers from severe shortcomings such as reduction to selective aspects, lack of theory or suboptimal methods. What is still missing, is a framework that integrates the insights of the relevant scientific disciplines. In this paper, we propose an integrative framework comprising four modules: training, behavior change techniques, sensors and technology, and evaluation of effects. This framework allows to integrate insights from training science, exercise physiology, social psychology, computer science, and civil engineering as well as methodology. Furthermore, the framework can be flexibly adapted to the specific features of the mobile applications, e.g., regarding training goals and training methods or the relevant behavior change techniques as well as formative or summative evaluation.

[1]  D J Plonczynski,et al.  Measurement of motivation for exercise. , 2000, Health education research.

[2]  Jerilyn K Allen,et al.  Mobile phone interventions to increase physical activity and reduce weight: a systematic review. , 2013, The Journal of cardiovascular nursing.

[3]  Emily Knight,et al.  Public Health Guidelines for Physical Activity: Is There an App for That? A Review of Android and Apple App Stores , 2014, JMIR mHealth and uHealth.

[4]  Jylana L. Sheats,et al.  Effects of Three Motivationally Targeted Mobile Device Applications on Initial Physical Activity and Sedentary Behavior Change in Midlife and Older Adults: A Randomized Trial , 2016, PloS one.

[5]  Todd D. Little,et al.  Principled Missing Data Treatments , 2018, Prevention Science.

[6]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, International Coaching Psychology Review.

[7]  B. Franklin,et al.  American College of Sports Medicine position stand. Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for prescribing exercise. , 2011, Medicine and science in sports and exercise.

[8]  H. Heckhausen,et al.  Motivation und Handeln , 1989 .

[9]  G. Flores Mateo,et al.  Mobile Phone Apps to Promote Weight Loss and Increase Physical Activity: A Systematic Review and Meta-Analysis , 2015, Journal of medical Internet research.

[10]  Patrick Wahl,et al.  Criterion-Validity of Commercially Available Physical Activity Tracker to Estimate Step Count, Covered Distance and Energy Expenditure during Sports Conditions , 2017, Front. Physiol..

[11]  J. Prochaska,et al.  The transtheoretical model and stages of change. , 1996 .

[12]  Jure Leskovec,et al.  How Gamification Affects Physical Activity: Large-scale Analysis of Walking Challenges in a Mobile Application , 2017, WWW.

[13]  Ulf Ekelund,et al.  A systematic review of reliability and objective criterion-related validity of physical activity questionnaires , 2012, International Journal of Behavioral Nutrition and Physical Activity.

[14]  Catherine Sherrington,et al.  Reliability of the PEDro scale for rating quality of randomized controlled trials. , 2003, Physical therapy.

[15]  J. Duchateau,et al.  Muscle stretching and motoneuron excitability , 2004, European Journal of Applied Physiology and Occupational Physiology.

[16]  Emma Derbyshire,et al.  Smartphone Medical Applications for Women's Health: What Is the Evidence-Base and Feedback? , 2013, International journal of telemedicine and applications.

[17]  Gerald Gartlehner,et al.  [GRADE guidelines: 1. Introduction - GRADE evidence profiles and summary of findings tables]. , 2012, Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen.

[18]  Ye Li,et al.  Physical Activity Recognition Utilizing the Built-In Kinematic Sensors of a Smartphone , 2013, Int. J. Distributed Sens. Networks.

[19]  Thomas P. Schmalzried,et al.  The accuracy of personal activity monitoring devices , 2017 .

[20]  Urs Boutellier,et al.  New fundamental resistance exercise determinants of molecular and cellular muscle adaptations , 2006, European Journal of Applied Physiology.

[21]  Guang-Zhong Yang,et al.  Wearable Sensing for Solid Biomechanics: A Review , 2015, IEEE Sensors Journal.

[22]  Judy Kay,et al.  Harnessing Long Term Physical Activity Data—How Long-term Trackers Use Data and How an Adherence-based Interface Supports New Insights , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[23]  G Atkinson,et al.  Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine , 1998, Sports medicine.

[24]  Aldo Roda,et al.  Smartphone-based biosensors: A critical review and perspectives , 2016 .

[25]  I. Janssen,et al.  Systematic review of the health benefits of physical activity and fitness in school-aged children and youth , 2010, The international journal of behavioral nutrition and physical activity.

[26]  M. Campbell,et al.  What is a pilot or feasibility study? A review of current practice and editorial policy , 2010, BMC medical research methodology.

[27]  E. Heath Borg's Perceived Exertion and Pain Scales , 1998 .

[28]  A. Donabedian,et al.  The quality of care. How can it be assessed? , 1988, JAMA.

[29]  Franz Konstantin Fuss,et al.  Recommendations for Assessment of the Reliability, Sensitivity, and Validity of Data Provided by Wearable Sensors Designed for Monitoring Physical Activity , 2018, JMIR mHealth and uHealth.

[30]  Muhammad Usman Warraich Wellness Routines with Wearable Activity Trackers: A Systematic Review , 2016, MCIS.

[31]  Sean P Mullen,et al.  Increasing Physical Activity With Mobile Devices: A Meta-Analysis , 2012, Journal of medical Internet research.

[32]  A. Bandura Social cognitive theory of personality. , 1999 .

[33]  S. Grant,et al.  Objective measurement of physical activity and sedentary behaviour: review with new data , 2008, Archives of Disease in Childhood.

[34]  R. Whittaker,et al.  Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? , 2014, BMC Public Health.

[35]  Mark W. Newman,et al.  When fitness trackers don't 'fit': end-user difficulties in the assessment of personal tracking device accuracy , 2015, UbiComp.

[36]  Julie B. Wang,et al.  Mobile and Wearable Device Features that Matter in Promoting Physical Activity. , 2016, Journal of mobile technology in medicine.

[37]  Matthew Dunn,et al.  The App Behavior Change Scale: Creation of a Scale to Assess the Potential of Apps to Promote Behavior Change , 2019, JMIR mHealth and uHealth.

[38]  C. Abraham,et al.  The Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques: Building an International Consensus for the Reporting of Behavior Change Interventions , 2013, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[39]  Donna Spruijt-Metz,et al.  Current mHealth technologies for physical activity assessment and promotion. , 2013, American journal of preventive medicine.

[40]  Jonathan Earthy,et al.  New ISO Standards for Usability, Usability Reports and Usability Measures , 2016, HCI.

[41]  Harri Oinas-Kukkonen,et al.  Persuasive Systems Design: Key Issues, Process Model, and System Features , 2009, Commun. Assoc. Inf. Syst..

[42]  Harri Oinas-Kukkonen,et al.  Persuasive Technology in Mobile Applications Promoting Physical Activity: a Systematic Review , 2016, Journal of Medical Systems.

[43]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[44]  Ming-Chih Lin,et al.  Smartphone Applications (Apps) for Heart Rate Measurement in Children: Comparison with Electrocardiography Monitor , 2013, Pediatric Cardiology.

[45]  Markus Makkonen,et al.  Critical Experiences during the Implementation of a Self-tracking Technology , 2016, PACIS.

[46]  Shona L Halson,et al.  Wearable Technology for Athletes: Information Overload and Pseudoscience? , 2016, International journal of sports physiology and performance.

[47]  Alan M. Jette,et al.  When Adults Don’t Exercise: Behavioral Strategies to Increase Physical Activity in Sedentary Middle-Aged and Older Adults , 2018, Innovation in aging.

[48]  R. Plotnikoff,et al.  Can Smartphone Apps Increase Physical Activity? Systematic Review and Meta-Analysis , 2018, Journal of medical Internet research.

[49]  E. Deci,et al.  Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. , 2000, The American psychologist.

[50]  I. Yildirim,et al.  Why Should We Do Physical Activity? More Active People for a Healthier World , 2018, International Journal of Disabilities Sports & Health Sciences.

[51]  Ron Kwok Chi-Wai,et al.  Can mobile virtual fitness apps replace human fitness trainer , 2011 .

[52]  C. Abraham,et al.  A taxonomy of behavior change techniques used in interventions. , 2008, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[53]  D. Altman,et al.  Assessing Risk of Bias in Included Studies , 2008 .

[54]  Sherri Rose,et al.  The International Journal of Biostatistics Why Match ? Investigating Matched Case-Control Study Designs with Causal Effect Estimation , 2011 .

[55]  Michael Herczeg,et al.  Applying ISO 9241-110 dialogue principles to tablet applications in emergency medical services , 2013, ISCRAM.

[56]  Benedikt Schmidt,et al.  Fitness tracker or digital personal coach: how to personalize training , 2015, UbiComp/ISWC Adjunct.

[57]  S. Michie,et al.  A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: The CALO-RE taxonomy , 2011, Psychology & health.

[58]  Christina Cheng,et al.  Evaluating mobile phone applications for health behaviour change: A systematic review , 2018, Journal of telemedicine and telecare.

[59]  W. Brown,et al.  Cognitive mediation of intervention effects on physical exercise: Causal models for the adoption and maintenance stage , 2012, Psychology & health.

[60]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. , 2009, Journal of clinical epidemiology.

[61]  Romain Meeusen,et al.  Recovery and Performance in Sport: Consensus Statement. , 2018, International journal of sports physiology and performance.

[62]  Jeremy Grimshaw,et al.  AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. , 2009, Journal of clinical epidemiology.

[63]  Damian Farrow,et al.  Development of a Skill Acquisition Periodisation Framework for High-Performance Sport , 2017, Sports Medicine.

[64]  The significance fallacy in inferential statistics , 2015, BMC Research Notes.

[65]  A. Townshend,et al.  Data acquisition and processing , 1975 .

[66]  Tuomas Kari,et al.  Influence of Digital Coaching on Physical Activity: Motivation and Behaviour of Physically Inactive Individuals , 2018, Bled eConference.

[67]  B. Schoenfeld,et al.  Stimuli and sensors that initiate skeletal muscle hypertrophy following resistance exercise. , 2019, Journal of applied physiology.

[68]  D. Conroy,et al.  Behavior change techniques in top-ranked mobile apps for physical activity. , 2014, American journal of preventive medicine.

[69]  Deborah Kendzierski,et al.  Physical Activity Enjoyment Scale: Two Validation Studies , 1991 .

[70]  Ulf Ekelund,et al.  A systematic literature review of reviews on techniques for physical activity measurement in adults: a DEDIPAC study , 2018, International Journal of Behavioral Nutrition and Physical Activity.

[71]  C. Skinner,et al.  The health belief model. , 2008 .

[72]  Patrick Olivier,et al.  The mobile fitness coach: Towards individualized skill assessment using personalized mobile devices , 2013, Pervasive Mob. Comput..

[73]  Fabrizio Bert,et al.  Smartphones and Health Promotion: A Review of the Evidence , 2013, Journal of Medical Systems.

[74]  D. French,et al.  What are the most effective intervention techniques for changing physical activity self-efficacy and physical activity behaviour--and are they the same? , 2011, Health education research.

[75]  C. Caspersen,et al.  Physical activity, exercise, and physical fitness: definitions and distinctions for health-related research. , 1985, Public health reports.

[76]  Judy Kay,et al.  Daily & Hourly Adherence: Towards Understanding Activity Tracker Accuracy , 2016, CHI Extended Abstracts.

[77]  Vincent Koenig,et al.  User experience: A concept without consensus? Exploring practitioners' perspectives through an international survey , 2015, Comput. Hum. Behav..

[78]  Yonatan Dov Mintz,et al.  Evaluating Machine Learning–Based Automated Personalized Daily Step Goals Delivered Through a Mobile Phone App: Randomized Controlled Trial , 2018, JMIR mHealth and uHealth.

[79]  K. W. Kallus,et al.  Recovery-stress questionnaire for athletes: User manual. , 2001 .

[80]  Ivana Murković Steinberg,et al.  Wireless chemical sensors and biosensors: A review , 2018, Sensors and Actuators B: Chemical.

[81]  Sean A. Munson,et al.  Exploring goal-setting, rewards, self-monitoring, and sharing to motivate physical activity , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[82]  M. Blais,et al.  Toward a New Measure of Intrinsic Motivation, Extrinsic Motivation, and Amotivation in Sports: The Sport Motivation Scale (SMS) , 1995 .

[83]  Sam Emaminejad,et al.  Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis , 2016, Nature.

[84]  Thea J. M. Kooiman,et al.  Reliability and validity of ten consumer activity trackers , 2015, BMC Sports Science, Medicine and Rehabilitation.

[85]  David Heaney,et al.  Patients’ experiences of using a smartphone application to increase physical activity: the SMART MOVE qualitative study in primary care , 2014, The British journal of general practice : the journal of the Royal College of General Practitioners.

[86]  Christopher K. Rhea,et al.  Toward Evidence-Based Smartphone Apps to Enhance Human Health: Adoption of Behavior Change Techniques , 2018 .

[87]  I-Min Lee,et al.  Leisure time physical activity and mortality: a detailed pooled analysis of the dose-response relationship. , 2015, JAMA internal medicine.

[88]  H. Seelig,et al.  Long-term effects of a psychological group intervention on physical exercise and health: the MoVo concept. , 2011, Journal of physical activity & health.

[89]  L Tian,et al.  Wearable sensors: modalities, challenges, and prospects. , 2018, Lab on a chip.

[90]  A. Leunes,et al.  Profile of Mood States Research in Sport and Exercise Psychology: Past, Present, and Future , 2000 .

[91]  John P. Sullivan,et al.  A Critical Review of Consumer Wearables, Mobile Applications, and Equipment for Providing Biofeedback, Monitoring Stress, and Sleep in Physically Active Populations , 2018, Front. Physiol..

[92]  José Antonio Pow-Sang,et al.  A Systematic Mapping Review of Usability Evaluation Methods for Software Development Process , 2016 .

[93]  A. Fenning,et al.  Effects of high-intensity interval training on cardiometabolic health: a systematic review and meta-analysis of intervention studies , 2016, British Journal of Sports Medicine.

[94]  Arnold Baca,et al.  Mobile motion advisor - a feedback system for physical exercise in schools , 2010 .

[95]  C. Gore-felton,et al.  A review of efficacious technology-based weight-loss interventions: five key components. , 2010, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[96]  Elizabeth Murray,et al.  Quality of Publicly Available Physical Activity Apps: Review and Content Analysis , 2018, JMIR mHealth and uHealth.

[97]  Charles Abraham,et al.  THE BEHAVIOR CHANGE TECHNIQUE TAXONOMY (V1) OF 93 HIERARCHICALLY-CLUSTERED TECHNIQUES: TESTING RELIABILITY OF THE TAXONOMY , 2013 .

[98]  J F Sallis,et al.  Compendium of physical activities: classification of energy costs of human physical activities. , 1993, Medicine and science in sports and exercise.

[99]  O. Faude,et al.  How to Construct, Conduct and Analyze an Exercise Training Study? , 2018, Front. Physiol..

[100]  Eeva Kettunen,et al.  Can Digital Coaching Boost Your Performance? - A Qualitative Study among Physically Active People , 2019, HICSS.

[101]  Thea J. M. Kooiman,et al.  Reliability and Validity of Ten Consumer Activity Trackers Depend on Walking Speed , 2017, Medicine and science in sports and exercise.

[102]  Mauro Conti,et al.  Breaking Fitness Records Without Moving: Reverse Engineering and Spoofing Fitbit , 2017, RAID.

[103]  Stefan Endler,et al.  Measurement, Prediction, and Control of Individual Heart Rate Responses to Exercise—Basics and Options for Wearable Devices , 2018, Front. Physiol..

[104]  Toshitaka Tsuda,et al.  Data acquisition and processing , 1989 .

[105]  Eeva Kettunen,et al.  Can Sport and Wellness Technology be My Personal Trainer? - Teenagers and Digital Coaching , 2018, Bled eConference.

[106]  D. J. van der Valk,et al.  How accurately can sitting and the intensity of walking and cycling be classified using an accelerometer on the waist for the purpose of the “Global recommendations on physical activity for health”? , 2015 .

[107]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[108]  A. Donabedian The quality of care. How can it be assessed? , 1988, JAMA.

[109]  Russell R. Pate,et al.  Systematic review of the relationships between objectively measured physical activity and health indicators in school-aged children and youth. , 2016, Applied physiology, nutrition, and metabolism = Physiologie appliquee, nutrition et metabolisme.

[110]  David E Conroy,et al.  Implementation of behavior change techniques in mobile applications for physical activity. , 2015, American journal of preventive medicine.

[111]  Ulf Ekelund,et al.  The ABC of Physical Activity for Health: A consensus statement from the British Association of Sport and Exercise Sciences , 2010, Journal of sports sciences.

[112]  Justin Cappos,et al.  Measuring the fitness of fitness trackers , 2017, 2017 IEEE Sensors Applications Symposium (SAS).

[113]  K. Volpp,et al.  Accuracy of smartphone applications and wearable devices for tracking physical activity data. , 2015, JAMA.

[114]  Thomas Zimmermann,et al.  Persuasive technology in the real world: a study of long-term use of activity sensing devices for fitness , 2014, CHI.

[115]  C. McCoy,et al.  Understanding the Intention-to-treat Principle in Randomized Controlled Trials , 2017, The western journal of emergency medicine.

[116]  S. Marshall,et al.  The transtheoretical model of behavior change: a meta-analysis of applications to physical activity and exercise , 2001, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[117]  M. Hagger,et al.  An Integrated Behavior Change Model for Physical Activity , 2014, Exercise and sport sciences reviews.

[118]  R. Ryan,et al.  Exercise, physical activity, and self-determination theory: A systematic review , 2012, International Journal of Behavioral Nutrition and Physical Activity.