The PAediatric Risk Assessment (PARA) Mobile App to Reduce Postdischarge Child Mortality: Design, Usability, and Feasibility for Health Care Workers in Uganda

Background Postdischarge death in children is increasingly being recognized as a major contributor to overall child mortality. The PAediatric Risk Assessment (PARA) app is an mHealth tool developed to aid health care workers in resource-limited settings such as Sub-Saharan Africa to identify pediatric patients at high risk of both in-hospital and postdischarge mortality. The intended users of the PARA app are health care workers (ie, nurses, doctors, and clinical officers) with varying levels of education and technological exposure, making testing of this clinical tool critical to successful implementation. Objective Our aim was to summarize the usability evaluation of the PARA app among target users, which consists of assessing the ease of use, functionality, and navigation of the interfaces and then iteratively improving the design of this clinical tool. Methods Health care workers (N=30) were recruited to participate at Mbarara Regional Referral Hospital and Holy Innocents Children’s Hospital in Mbarara, Southwestern Uganda. This usability study was conducted in two phases to allow for iterative improvement and testing of the interfaces. The PARA app was evaluated using quantitative and qualitative measures, which were compared between Phases 1 and 2 of the study. Participants were given two patient scenarios that listed hypothetical information (ie, demographic, social, and clinical data) to be entered into the app and to determine the patient’s risk of in-hospital and postdischarge mortality. Time-to-completion and user errors were recorded for each participant while using the app. A modified computer system usability questionnaire was utilized at the end of each session to elicit user satisfaction with the PARA app and obtain suggestions for future improvements. Results The average time to complete the PARA app decreased by 30% from Phase 1 to Phase 2, following user feedback and modifications. Participants spent the longest amount of time on the oxygen saturation interface, but modifications following Phase 1 cut this time by half. The average time-to-completion (during Phase 2) for doctors/medical students was 3 minutes 56 seconds. All participants agreed they would use the PARA app if available at their health facility. Given a high PARA risk score, participants suggested several interventions that would be appropriate for the sociocultural context in southwestern Uganda, which involved strengthening discharge and referral procedures within the current health care system. Conclusions Through feedback and modifications made during this usability study, the PARA app was developed into a user-friendly app, encompassing user expectations and culturally intuitive interfaces for users with a range of technological exposure. Doctors and medical students had shorter task completion times, though all participants reported the usefulness of this tool to improve postdischarge outcomes.

[1]  Clara B. Aranda-Jan,et al.  Systematic review on what works, what does not work and why of implementation of mobile health (mHealth) projects in Africa , 2014, BMC Public Health.

[2]  Sidney Fels,et al.  A framework for evaluating usability of clinical monitoring technology , 2007, Journal of Clinical Monitoring and Computing.

[3]  Jamie Perin,et al.  Global, regional, and national causes of child mortality in 2000–13, with projections to inform post-2015 priorities: an updated systematic analysis , 2015, The Lancet.

[4]  Matthew M Davis,et al.  Pediatric hospital discharge interventions to reduce subsequent utilization: a systematic review. , 2014, Journal of hospital medicine.

[5]  Heather Adair-Rohani,et al.  Limited electricity access in health facilities of sub-Saharan Africa: a systematic review of data on electricity access, sources, and reliability , 2013, Global Health: Science and Practice.

[6]  Guy A. Dumont,et al.  Measuring Adequacy of Analgesia with Cardiorespiratory Coherence , 2012 .

[7]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[8]  Guy Albert Dumont,et al.  Experience report: functional programming of mHealth applications , 2013, ICFP.

[9]  Guy A Dumont,et al.  Usability and Feasibility of PIERS on the Move: An mHealth App for Pre-Eclampsia Triage , 2015, JMIR mHealth and uHealth.

[10]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[11]  N. Kissoon,et al.  Postdischarge mortality in children with acute infectious diseases: derivation of postdischarge mortality prediction models , 2015, BMJ Open.

[12]  N. Kissoon,et al.  Pediatric Post-Discharge Mortality in Resource Poor Countries: A Systematic Review , 2013, PloS one.

[13]  Walter Karlen,et al.  Human-centered Phone Oximeter Interface Design for the Operating Room - Pulse Oximeter Interfaced to a Mobile Device for Anesthesia Monitoring in the Developing World , 2011, HEALTHINF.

[14]  A. Bastawrous,et al.  Mobile health use in low- and high-income countries: an overview of the peer-reviewed literature , 2013, Journal of the Royal Society of Medicine.