The Electronic Patient Reported Outcome Tool: Testing Usability and Feasibility of a Mobile App and Portal to Support Care for Patients With Complex Chronic Disease and Disability in Primary Care Settings

Background People experiencing complex chronic disease and disability (CCDD) face some of the greatest challenges of any patient population. Primary care providers find it difficult to manage multiple discordant conditions and symptoms and often complex social challenges experienced by these patients. The electronic Patient Reported Outcome (ePRO) tool is designed to overcome some of these challenges by supporting goal-oriented primary care delivery. Using the tool, patients and providers collaboratively develop health care goals on a portal linked to a mobile device to help patients and providers track progress between visits. Objectives This study tested the usability and feasibility of adopting the ePRO tool into a single interdisciplinary primary health care practice in Toronto, Canada. The Fit between Individuals, Fask, and Technology (FITT) framework was used to guide our assessment and explore whether the ePRO tool is: (1) feasible for adoption in interdisciplinary primary health care practices and (2) usable from both the patient and provider perspectives. This usability pilot is part of a broader user-centered design development strategy. Methods A 4-week pilot study was conducted in which patients and providers used the ePRO tool to develop health-related goals, which patients then monitored using a mobile device. Patients and providers collaboratively set goals using the system during an initial visit and had at least 1 follow-up visit at the end of the pilot to discuss progress. Focus groups and interviews were conducted with patients and providers to capture usability and feasibility measures. Data from the ePRO system were extracted to provide information regarding tool usage. Results Six providers and 11 patients participated in the study; 3 patients dropped out mainly owing to health issues. The remaining 8 patients completed 210 monitoring protocols, equal to over 1300 questions, with patients often answering questions daily. Providers and patients accessed the portal on an average of 10 and 1.5 times, respectively. Users found the system easy to use, some patients reporting that the tool helped in their ability to self-manage, catalyzed a sense of responsibility over their care, and improved patient-centered care delivery. Some providers found that the tool helped focus conversations on goal setting. However, the tool did not fit well with provider workflows, monitoring questions were not adequately tailored to individual patient needs, and daily reporting became tedious and time-consuming for patients. Conclusions Although our study suggests relatively low usability and feasibility of the ePRO tool, we are encouraged by the early impact on patient outcomes and generally positive responses from both user groups regarding the potential of the tool to improve care for patients with CCDD. As is consistent with our user-centered design development approach, we have modified the tool based on user feedback, and are now testing the redeveloped tool through an exploratory trial.

[1]  M. Puhan,et al.  Health and Quality of Life Outcomes , 2009 .

[2]  Manolis Tsiknakis,et al.  Organizational factors affecting successful adoption of innovative eHealth services: A case study employing the FITT framework , 2009, Int. J. Medical Informatics.

[3]  Ping Yu,et al.  Lessons learned from the practice of mobile health application development , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[4]  A. Sheikh,et al.  Does telehealthcare offer a patient-centred way forward for the community-based management of long-term respiratory disease? , 2009, Primary care respiratory journal : journal of the General Practice Airways Group.

[5]  Liam J. Bannon,et al.  Exploring User-Centred Design in Practice: Some Caveats , 2009 .

[6]  V. Strecher Internet methods for delivering behavioral and health-related interventions (eHealth). , 2007, Annual review of clinical psychology.

[7]  M. O'Kane,et al.  Efficacy of self monitoring of blood glucose in patients with newly diagnosed type 2 diabetes (ESMON study): randomised controlled trial , 2008, BMJ : British Medical Journal.

[8]  Aksel Tjora,et al.  Privacy vs Usability: A Qualitative Exploration of Patients' Experiences With Secure Internet Communication With Their General Practitioner , 2005, Journal of medical Internet research.

[9]  Judith Green,et al.  Qualitative methods for health research , 2004 .

[10]  Yaser Mowafi,et al.  Study of the Usability of Spaced Retrieval Exercise Using Mobile Devices for Alzheimer’s Disease Rehabilitation , 2014, JMIR mHealth and uHealth.

[11]  Dave Dongelmans,et al.  A usability evaluation of a SNOMED CT based compositional interface terminology for intensive care , 2012, Int. J. Medical Informatics.

[12]  Luc P de Witte,et al.  User-centered development and testing of a monitoring system that provides feedback regarding physical functioning to elderly people , 2013, Patient preference and adherence.

[13]  Ross Upshur,et al.  A qualitative descriptive study on the alignment of care goals between older persons with multi-morbidities, their family physicians and informal caregivers , 2013, BMC Family Practice.

[14]  Martin Fortin,et al.  Future of Multimorbidity Research: How Should Understanding of Multimorbidity Inform Health System Design? , 2010 .

[15]  Trudy van der Weijden,et al.  Technology Combined with a Counseling Protocol to Stimulate Physical Activity of Chronically Ill Patients in Primary Care , 2014, Nursing Informatics.

[16]  J. Pugh,et al.  Collaborative care needs and preferences of primary care patients with multimorbidity , 2005, Health expectations : an international journal of public participation in health care and health policy.

[17]  B. Bloom Crossing the Quality Chasm: A New Health System for the 21st Century , 2002 .

[18]  A. Wu,et al.  Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. , 2005, JAMA.

[19]  Diana Gosálvez Prados Institute for Clinical Evaluative Sciences (ICES) , 2011 .

[20]  Rachel Davey,et al.  Development and Pilot Testing of the Eating4two Mobile Phone App to Monitor Gestational Weight Gain , 2015, JMIR mHealth and uHealth.

[21]  R. Bollinger,et al.  Feasibility and Acceptability of Smartphone-Based Ecological Momentary Assessment of Alcohol Use Among African American Men Who Have Sex With Men in Baltimore , 2015, JMIR mHealth and uHealth.

[22]  Daniel J Buysse,et al.  The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. , 2010, Journal of clinical epidemiology.

[23]  A. Bierman,et al.  Improving Patient Experience and Primary Care Quality for Patients With Complex Chronic Disease Using the Electronic Patient-Reported Outcomes Tool: Adopting Qualitative Methods Into a User-Centered Design Approach , 2016, JMIR research protocols.

[24]  Jie Zhou,et al.  Integration of user centered design in the development of health monitoring system for elderly , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[25]  Bambang Parmanto,et al.  A Persuasive and Social mHealth Application for Physical Activity: A Usability and Feasibility Study , 2014, JMIR mHealth and uHealth.

[26]  K. Hemachandran,et al.  A working Framework for the User-Centered Design Approach and a Survey of the available Methods , 2014 .

[27]  Jean-Yves Reginster,et al.  The promise of wearable activity sensors to define patient recovery , 2014, Journal of Clinical Neuroscience.

[28]  Urs-Vito Albrecht,et al.  mHealth 2.0: Experiences, Possibilities, and Perspectives , 2014, JMIR mHealth and uHealth.

[29]  William Brown,et al.  Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology , 2013, J. Biomed. Informatics.

[30]  Walter P. Wodchis,et al.  A scoping review and thematic classification of patient complexity: offering a unifying framework , 2012, Journal of comorbidity.

[31]  H. Bosworth,et al.  Supporting self-management for patients with complex medical needs: recommendations of a working group , 2007, Chronic illness.

[32]  L. Fratiglioni,et al.  Aging with multimorbidity: A systematic review of the literature , 2011, Ageing Research Reviews.

[33]  Jelena Mirkovic,et al.  Supporting Cancer Patients in Illness Management: Usability Evaluation of a Mobile App , 2014, JMIR mHealth and uHealth.

[34]  Gabriella Dodero,et al.  A mobile e-health system based on workflow automation tools , 2002, Proceedings of 15th IEEE Symposium on Computer-Based Medical Systems (CBMS 2002).

[35]  Rachel Davey,et al.  Development and Pilot Testing of the Eating 4 two Mobile Phone App to Monitor Gestational Weight Gain , 2017 .

[36]  Beenish Chaudry,et al.  An offline mobile nutrition monitoring intervention for varying-literacy patients receiving hemodialysis: a pilot study examining usage and usability , 2012, J. Am. Medical Informatics Assoc..

[37]  Trudy van der Weijden,et al.  The Development of a Mobile Monitoring and Feedback Tool to Stimulate Physical Activity of People With a Chronic Disease in Primary Care: A User-Centered Design , 2013, JMIR mHealth and uHealth.

[38]  P. Tsasis,et al.  Management of complex chronic disease: facing the challenges in the Canadian health-care system , 2008, Health services management research.

[39]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[40]  Huiru Zheng,et al.  Smart self management: assistive technology to support people with chronic disease , 2010, Journal of telemedicine and telecare.

[41]  J. Preece,et al.  User-Centered Design , 2004 .

[42]  L. Andersson,et al.  Too complex and time-consuming to fit in! Physicians' experiences of elderly patients and their participation in medical decision making: a grounded theory study , 2012, BMJ Open.

[43]  J. Browne,et al.  GPs’ perspectives on the management of patients with multimorbidity: systematic review and synthesis of qualitative research , 2013, BMJ Open.

[44]  Doerte U. Junghaenel,et al.  Validity and Reliability of Patient‐Reported Outcomes Measurement Information System Instruments in Osteoarthritis , 2013, Arthritis care & research.

[45]  Ross Upshur,et al.  Do Clinical Guidelines Still Make Sense? No , 2014, The Annals of Family Medicine.

[46]  Jodi G. Daniel,et al.  A national action plan to support consumer engagement via e-health. , 2013, Health affairs.

[47]  Vimla L. Patel,et al.  A Cognitive Framework for Understanding Barriers to the Productive Use of a Diabetes Home Telemedicine System , 2003, AMIA.

[48]  C. Upshur,et al.  A survey of primary care provider attitudes and behaviors regarding treatment of adult depression: what changes after a collaborative care intervention? , 2008, Primary care companion to the Journal of clinical psychiatry.

[49]  M. Tinetti,et al.  Goal-oriented patient care--an alternative health outcomes paradigm. , 2012, The New England journal of medicine.

[50]  Antonio León,et al.  A novel multimodal tool for telemonitoring patients with COPD , 2015, Informatics for health & social care.

[51]  Terry Winograd,et al.  The Action Workflow Approach to Workflow Management Technology , 1993, Inf. Soc..

[52]  Cheryl Cott,et al.  Tying eHealth Tools to Patient Needs: Exploring the Use of eHealth for Community-Dwelling Patients With Complex Chronic Disease and Disability , 2014, JMIR research protocols.

[53]  D. Wade,et al.  Writing SMART rehabilitation goals and achieving goal attainment scaling: a practical guide , 2009, Clinical rehabilitation.

[54]  C. Steele Gray,et al.  Patient-Centered Care and Patient-Reported Measures: Let’s Look Before We Leap , 2014, The Patient - Patient-Centered Outcomes Research.

[55]  B Sheehan,et al.  A comparison of usability factors of four mobile devices for accessing healthcare information by adolescents. , 2012, Applied clinical informatics.