Understanding the barriers to successful adoption and use of a mobile health information system in a community health center in São Paulo, Brazil: a cohort study

BackgroundMobile technology to support community health has surged in popularity, yet few studies have systematically examined usability of mobile platforms for this setting.MethodsWe conducted a mixed-methods study of 14 community healthcare workers at a public healthcare clinic in São Paulo, Brazil. We held focus groups with community healthcare workers to elicit their ideas about a mobile health application and used this input to build a prototype app. A pre-use test survey was administered to all participants, who subsequently use-tested the app on three different devices (iPhone, iPad mini, iPad Air). Usability was assessed by objectively scored data entry errors and through a post-use focus group held to gather open-ended feedback on end-user satisfaction.ResultsAll of the participants were women, ranging from 18–64 years old. A large percentage (85.7%) of participants had at least a high school education. Internet (92.8%), computer (85.7%) and cell phone (71.4%) use rates were high. Data entry error rates were also high, particularly in free text fields, ranging from 92.3 to 100%. Error rates were comparable across device type. In a post-use focus group, participants reported that they found the app easy to use and felt that its design was consistent with their vision. The participants raised several concerns, including that they did not find filling out the forms in the app to be a useful task. They also were concerned about an app potentially creating more work for them and personal security issues related to carrying a mobile device in low-income areas.ConclusionIn a cohort of formally educated community healthcare workers with high levels of personal computer and cell phone use, we identified no technological barriers to adapting their existing work to a mobile device based system. Transferring current data entry work into a mobile platform, however, uncovered underlying dissatisfaction with some data entry tasks. This dissatisfaction may be a more significant barrier than the data entry errors our testing revealed. Our results highlight the fact that without a deep understanding of local process to optimize usability, technology-based solutions in health may fail. Developing such an understanding must be a central component in the design of any mHealth solution in global health.

[1]  Adolfo Rubinstein,et al.  Design and Multi-Country Validation of Text Messages for an mHealth Intervention for Primary Prevention of Progression to Hypertension in Latin America , 2015, JMIR mHealth and uHealth.

[2]  Sanjay Arora,et al.  A mobile health intervention for inner city patients with poorly controlled diabetes: proof-of-concept of the TExT-MED program. , 2012, Diabetes technology & therapeutics.

[3]  Audie A Atienza,et al.  Mobile health technology evaluation: the mHealth evidence workshop. , 2013, American journal of preventive medicine.

[4]  Feasibility of the SMART Project: A Text Message Program for Adolescents With Type 1 Diabetes , 2014, Diabetes Spectrum.

[5]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[6]  Helen Schneider,et al.  Comparing a paper based monitoring and evaluation system to a mHealth system to support the national community health worker programme, South Africa: an evaluation , 2014, BMC Medical Informatics and Decision Making.

[7]  G. Ghanizadeh,et al.  Health education via mobile text messaging for glycemic control in adults with type 2 diabetes: a systematic review and meta-analysis. , 2014, Primary care diabetes.

[8]  Sanjana J Ravi,et al.  Going Mobile: How Mobile Personal Health Records Can Improve Health Care During Emergencies , 2014, JMIR mHealth and uHealth.

[9]  Jules T. Mitchel,et al.  Evaluation of Data Entry Errors and Data Changes to an Electronic Data Capture Clinical Trial Database , 2011, Drug information journal.

[10]  Sheana S Bull,et al.  Putting prevention in their pockets: developing mobile phone-based HIV interventions for black men who have sex with men. , 2013, AIDS patient care and STDs.

[11]  A. Bastawrous,et al.  Mobile health use in low- and high-income countries: an overview of the peer-reviewed literature , 2013, Journal of the Royal Society of Medicine.

[12]  B. Kirkwood,et al.  Mobile Health (mHealth) Approaches and Lessons for Increased Performance and Retention of Community Health Workers in Low- and Middle-Income Countries: A Review , 2013, Journal of medical Internet research.

[13]  R. Stott,et al.  The World Bank , 2008, Annals of tropical medicine and parasitology.

[14]  Clara B. Aranda-Jan,et al.  Systematic review on what works, what does not work and why of implementation of mobile health (mHealth) projects in Africa , 2014, BMC Public Health.

[15]  Gari D Clifford,et al.  SMARTHealth India: Development and Field Evaluation of a Mobile Clinical Decision Support System for Cardiovascular Diseases in Rural India , 2014, JMIR mHealth and uHealth.

[16]  Narath Carlile,et al.  User Perceptions of an mHealth Medicine Dosing Tool for Community Health Workers , 2013, JMIR mHealth and uHealth.

[17]  Robert Hoyt,et al.  Lessons learned from implementation of voice recognition for documentation in the military electronic health record system. , 2010, Perspectives in health information management.

[18]  Enrico W. Coiera,et al.  Risks and benefits of speech recognition for clinical documentation: a systematic review , 2016, J. Am. Medical Informatics Assoc..

[19]  Ali Idri,et al.  Empirical Studies on Usability of mHealth Apps: A Systematic Literature Review , 2015, Journal of Medical Systems.

[20]  Bassam Bin Abbas,et al.  Effect of Mobile Phone Short Text Messages on Glycemic Control in Type 2 Diabetes , 2014, International journal of endocrinology and metabolism.

[21]  Courtney R. Lyles,et al.  Online patient websites for electronic health record access among vulnerable populations: portals to nowhere? , 2017, J. Am. Medical Informatics Assoc..

[22]  Lorraine R. Buis,et al.  Text Messaging to Improve Hypertension Medication Adherence in African Americans: BPMED Intervention Development and Study Protocol , 2015, JMIR research protocols.

[23]  Andrew Stellman,et al.  What is Agile , 2017 .

[24]  Lionel Tarassenko,et al.  Efficacy of a text messaging (SMS) based intervention for adults with hypertension: protocol for the StAR (SMS Text-message Adherence suppoRt trial) randomised controlled trial , 2014, BMC Public Health.

[25]  A. Labrique,et al.  Evidence on feasibility and effective use of mHealth strategies by frontline health workers in developing countries: systematic review* , 2015, Tropical medicine & international health : TM & IH.

[26]  Morwenna Kirwan,et al.  Diabetes Self-Management Smartphone Application for Adults With Type 1 Diabetes: Randomized Controlled Trial , 2013, Journal of medical Internet research.

[27]  J. Creswell,et al.  Qualitative Inquiry and Research Design , 1998 .

[28]  R. Bollinger,et al.  Perceptions and acceptability of mHealth interventions for improving patient care at a community-based HIV/AIDS clinic in Uganda: A mixed methods study , 2013, AIDS care.

[29]  A. Carrico,et al.  Creating Effective Mobile Phone Apps to Optimize Antiretroviral Therapy Adherence: Perspectives From Stimulant-Using HIV-Positive Men Who Have Sex With Men , 2016, JMIR mHealth and uHealth.

[30]  Arul Chib,et al.  mHealth Adoption in Low-Resource Environments: A Review of the Use of Mobile Healthcare in Developing Countries , 2015, Journal of health communication.

[31]  Mauricio L Barreto,et al.  Health conditions and health-policy innovations in Brazil: the way forward , 2011, The Lancet.

[32]  Sarah P. Slight,et al.  A systematic review of the types and causes of prescribing errors generated from using computerized provider order entry systems in primary and secondary care , 2017, AMIA.

[33]  Nancy Staggers,et al.  Quantifying usability: an evaluation of a diabetes mHealth system on effectiveness, efficiency, and satisfaction metrics with associated user characteristics , 2015, J. Am. Medical Informatics Assoc..

[34]  R. Whittaker,et al.  Diabetes Text-Message Self-Management Support Program (SMS4BG): A Pilot Study , 2015, JMIR mHealth and uHealth.

[35]  A. Strauss Basics Of Qualitative Research , 1992 .

[36]  Sisira Edirippulige,et al.  Evaluating the use of mobile phone technology to enhance cardiovascular disease screening by community health workers , 2014, Int. J. Medical Informatics.

[37]  Marcos A. Simplício,et al.  Mobile health in emerging countries: A survey of research initiatives in Brazil , 2013, Int. J. Medical Informatics.

[38]  B. Kirkwood,et al.  Interventions to Improve Motivation and Retention of Community Health Workers Delivering Integrated Community Case Management (iCCM): Stakeholder Perceptions and Priorities , 2012, The American journal of tropical medicine and hygiene.

[39]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[40]  Krisda H. Chaiyachati,et al.  A Pilot Study of an mHealth Application for Healthcare Workers: Poor Uptake Despite High Reported Acceptability at a Rural South African Community-Based MDR-TB Treatment Program , 2013, PloS one.

[41]  J. Macinko,et al.  The Brazilian health system: history, advances, and challenges , 2011, The Lancet.

[42]  John W. Creswell,et al.  Designing and Conducting Mixed Methods Research , 2006 .