Usability and Acceptance of an Interactive Tablet-Based Exercise Application: A Mixed Methods Study

Purpose: To investigate usability and acceptance of a newly developed interactive, tablet-based exercise application (app) and to explore personal opinions of therapists when using this app in the clinical setting. Methods: Twenty participants (10 therapists and 10 inactive healthy adults) tested usability of this app performing different test tasks, using the think aloud method, and rated overall satisfaction with the System Usability Scale and acceptance with a modified Technology Acceptance Model Questionnaire. For a secondary objective, personal opinions of therapists were evaluated with two focus groups, one for team leaders and one for team members. Results: Overall, the app was judged to be usable. Effectiveness varied between 73 and 90%, overall satisfaction between 70.5 and 85.5/100 points and acceptance between 74 and 80%. Team leader and team member focus groups considered the app as providing a great opportunity for therapy extension, especially because of its blended character. Barriers to its implementation were seen in the existing clinical working processes, personal attitudes of therapists and uncertainty of who would cover expenses for this new form of therapy. Some improvements such as using videos instead of photos, the integration of more interactive tools and the possibility to add additional exercises were suggested in both settings. Conclusion: The app showed high acceptance and usability in trainees and therapists, although some ideas for upgrading functions were formulated. Before this app can be used in clinical practice, feasibility of this blended approach should be evaluated in a clinical setting.

[1]  Pia Bülow,et al.  Who's talking: drawing conclusions from focus groups—some methodological considerations , 2003 .

[2]  A. Bauman,et al.  Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. , 2007, Circulation.

[3]  S. Michie,et al.  Using the Internet to Promote Health Behavior Change: A Systematic Review and Meta-analysis of the Impact of Theoretical Basis, Use of Behavior Change Techniques, and Mode of Delivery on Efficacy , 2010, Journal of medical Internet research.

[4]  Steven Allender,et al.  Understanding participation in sport and physical activity among children and adults: a review of qualitative studies. , 2006, Health education research.

[5]  Robert A. Virzi,et al.  Refining the Test Phase of Usability Evaluation: How Many Subjects Is Enough? , 1992 .

[6]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[7]  M. Delgado-Rodríguez,et al.  Systematic review and meta-analysis. , 2017, Medicina intensiva.

[8]  J. Dekker,et al.  Determinants of Adherence to the Online Component of a Blended Intervention for Patients with Hip and/or Knee Osteoarthritis: A Mixed Methods Study Embedded in the e-Exercise Trial. , 2017, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[9]  J. Dekker,et al.  Physiotherapists’ experiences with a blended osteoarthritis intervention: a mixed methods study , 2018, Physiotherapy theory and practice.

[10]  F. Hamilton,et al.  Acceptability of a digital health intervention alongside physiotherapy to support patients following anterior cruciate ligament reconstruction , 2017, BMC Musculoskeletal Disorders.

[11]  M. Trivedi,et al.  Physical activity dose-response effects on outcomes of depression and anxiety. , 2001, Medicine and science in sports and exercise.

[12]  Bernadine Brady,et al.  A MIXED-METHODS STUDY , 2019 .

[13]  Fabio Casati,et al.  Tablet-Based Strength-Balance Training to Motivate and Improve Adherence to Exercise in Independently Living Older People: Part 2 of a Phase II Preclinical Exploratory Trial , 2013, Journal of medical Internet research.

[14]  M. Bonab randomised trial , 2022 .

[15]  L. Faulkner Beyond the five-user assumption: Benefits of increased sample sizes in usability testing , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[16]  A. Sanabria,et al.  Randomized controlled trial. , 2005, World journal of surgery.

[17]  D. Wantland,et al.  The Effectiveness of Web-Based vs. Non-Web-Based Interventions: A Meta-Analysis of Behavioral Change Outcomes , 2004, Journal of medical Internet research.

[18]  J. Dekker,et al.  Cost-effectiveness of a blended physiotherapy intervention compared to usual physiotherapy in patients with hip and/or knee osteoarthritis: a cluster randomized controlled trial , 2018, BMC Public Health.

[19]  B. Thomas,et al.  Usability Evaluation In Industry , 1996 .

[20]  M. Meis,et al.  Knowledge Mapping as a Tool for Analyzing Focus Groups and Presenting Their Results in Market and Evaluation Research , 2004 .

[21]  Martin Schmettow,et al.  Sample size in usability studies , 2012, Commun. ACM.

[22]  Lucas J Carr,et al.  The Role of Resistance Training in the Prevention and Treatment of Chronic Disease , 2010 .

[23]  Ethan Nadelmann,et al.  Additional considerations. , 2012, Addiction.

[24]  R. Hinman,et al.  Does a web-based exercise programming system improve home exercise adherence for people with musculoskeletal conditions? Randomized controlled trial. , 2019, American journal of physical medicine & rehabilitation.

[25]  Joseph Finkelstein,et al.  Home-based physical telerehabilitation in patients with multiple sclerosis: a pilot study. , 2008, Journal of rehabilitation research and development.

[26]  J. M. Christian Bastien,et al.  Usability testing: a review of some methodological and technical aspects of the method , 2010, Int. J. Medical Informatics.

[27]  Fabio Casati,et al.  Tablet-Based Strength-Balance Training to Motivate and Improve Adherence to Exercise in Independently Living Older People: A Phase II Preclinical Exploratory Trial , 2013, Journal of medical Internet research.

[28]  Ian Robinson,et al.  Benefits of and barriers to involving users in medical device technology development and evaluation , 2007, International Journal of Technology Assessment in Health Care.

[29]  Maslin Masrom,et al.  Technology Acceptance Model and E-learning , 2007 .

[30]  S. Sieczkowska,et al.  Effects of resistance training on the health-related quality of life of patients with rheumatic diseases: Systematic review with meta-analysis and meta-regression. , 2020, Seminars in arthritis and rheumatism.

[31]  T. Rader,et al.  Resistance exercise training for fibromyalgia. , 2013, The Cochrane database of systematic reviews.

[32]  S. Thilarajah,et al.  Effectiveness of resistance training on muscle strength and physical function in people with Parkinson’s disease: a systematic review and meta-analysis , 2016, Clinical rehabilitation.

[33]  S. Kelders,et al.  Persuasive System Design Does Matter: A Systematic Review of Adherence to Web-Based Interventions , 2012, Journal of medical Internet research.

[34]  A. Schättin,et al.  Making More of IT: Enabling Intensive Motor Cognitive Rehabilitation Exercises in Geriatrics Using Information Technology Solutions , 2018, BioMed research international.

[35]  Anne Forster,et al.  Cluster Randomized Controlled Trial , 2015, Stroke.

[36]  B. Kröse,et al.  Translating Behavior Change Principles Into a Blended Exercise Intervention for Older Adults: Design Study , 2018, JMIR research protocols.

[37]  B. Cardinal,et al.  Evaluation of the revised physical activity readiness questionnaire in older adults. , 1995, Medicine and science in sports and exercise.

[38]  L. Harvey,et al.  An app with remote support achieves better adherence to home exercise programs than paper handouts in people with musculoskeletal conditions: a randomised trial. , 2017, Journal of physiotherapy.

[39]  Monique W. M. Jaspers,et al.  A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence , 2009, Int. J. Medical Informatics.

[40]  C. Baird,et al.  The pilot study. , 2000, Orthopedic nursing.

[41]  J R Lewis,et al.  Sample Sizes for Usability Studies: Additional Considerations , 1994, Human factors.

[42]  A. Franklyn-Miller,et al.  Resistance training in musculoskeletal rehabilitation: a systematic review , 2011, British Journal of Sports Medicine.

[43]  Y. Anziska,et al.  Exercise in Neuromuscular Disease , 2014, Seminars in Neurology.

[44]  Jagdeep Singh,et al.  Design of Study , 2019 .

[45]  Gavriel Salvendy,et al.  Number of people required for usability evaluation , 2010, Commun. ACM.

[46]  Birgit Wirtz Persuasive Technology Using Computers To Change What We Think And Do , 2016 .

[47]  A. Ismaila,et al.  A tutorial on pilot studies: the what, why and how , 2010, BMC Medical Research Methodology.

[48]  Katherine D. Seelman,et al.  Telerehabilitation: Policy Issues and Research Tools , 2009, International journal of telerehabilitation.

[49]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[50]  M. Fiatarone Singh,et al.  Progressive resistance training in breast cancer: a systematic review of clinical trials , 2008, Breast Cancer Research and Treatment.

[51]  J. Dekker,et al.  Effectiveness of a Blended Physical Therapist Intervention in People With Hip Osteoarthritis, Knee Osteoarthritis, or Both: A Cluster-Randomized Controlled Trial , 2018, Physical therapy.

[52]  E. Ciolac,et al.  Resistance Training as a Tool for Preventing and Treating Musculoskeletal Disorders , 2016, Sports Medicine.

[53]  P. Sainsbury,et al.  Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[54]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .