Design and Usability Testing of an mHealth Application for Midwives in Rural Ghana

Design and Usability Testing of a mHealth Application for Midwives in Rural Ghana Olivia Velez Midwives in Ghana provide the majority of rural primary and maternal healthcare services, but have limited access to data for decision making and knowledge work. Few mobile health (mHealth) applications have been designed for midwives. The study purpose was to design and test an mHealth application (mClinic) that can improve data access and reduce the reporting burden for midwives at the Millennium Villages Project site in Ghana. From the design science field, the Information Systems Research Framework guided this study through two research cycles: 1) Relevance, and 2) Design. The first phase of the Relevance Cycle took a user-centered approach to assess the people, organizations, and technology of the midwives’ environment through participant observation, contextual inquiry, and interviews. In the second phase, structured requirements specification was used to categorize the data into goals, system qualities, and constraints. From the categorized data, use cases were developed for patient registration, antenatal care, malaria, family planning, and referrals. Use cases then informed the development of functional requirements. In the Design Cycle, we first used functional requirements for patient registration and malaria to develop the mClinic prototype as part of a coded-in-country initiative. Next, we examined usability of the mClinic prototype by conducting field testing, heuristic evaluation, and usability surveys. Additionally, low-fidelity prototyping was used to determine applicability of the other use cases to the midwives’ environment. Midwives reported inability to access critical data, high patient loads, and extensive reporting requirements. Low technical self-efficacy and inadequate infrastructure were identified as barriers to implementation. Heuristic evaluation noted issues related to hardware selection, workflow, and security. Midwives ranked the tool as useful in the usability survey; however, ease-of-use rankings were neutral. Interviews indicated this was related to low technical self-efficacy. Applicability checks found support for touch-entry prototypes over those that included lengthy forms or text-entry. The study supported the utility of design science and user-centered methods in rural Ghana for understanding the midwives’ environment, developing functional requirements, and guiding evaluation. Midwives reported mClinic would facilitate data access and reduce reporting burdens. Improving midwives data access is essential for clinical decision making and promoting their knowledge work.

[1]  Edwin H. Blake,et al.  Designing interactive systems for the developing world - reflections on user-centred design , 2007, 2007 International Conference on Information and Communication Technologies and Development.

[2]  N. Speybroeck,et al.  Reassessing the Relationship Between Human Resources for Health, Intervention Coverage and Health Outcomes , 2006 .

[3]  Jen-Her Wu,et al.  What Drives Mobile Health Care? An Empirical Evaluation of Technology Acceptance , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[4]  Honest C. Kimaro,et al.  Challenges of user participation in the design of a computer based system: the possibility of participatory customisation in low income countries , 2008 .

[5]  Rajendra T. Kumar,et al.  Sustainability failures of rural telecenters: Challenges from the sustainable access in rural india (sari) project , 2008 .

[6]  Gary Marsden,et al.  After access: challenges facing mobile-only internet users in the developing world , 2010, CHI.

[7]  C. Agyemang,et al.  Tackling Africa's chronic disease burden: from the local to the global , 2010, Globalization and health.

[8]  Gordon B. Davis,et al.  User Acceptance of Information Technology: Toward a Unified View , 2003, MIS Q..

[9]  C. Menéndez,et al.  Clinico-Pathological Discrepancies in the Diagnosis of Causes of Maternal Death in Sub-Saharan Africa: Retrospective Analysis , 2009, PLoS medicine.

[10]  K. Burton,et al.  Relevance of Electronic Health Information to Doctors in the Developing World: Results of the Ptolemy Project’s Internet-based Health Information Study (IBHIS) , 2005, World Journal of Surgery.

[11]  Thomas G Rundall,et al.  Kaiser Permanente's experience of implementing an electronic medical record: a qualitative study , 2005, BMJ : British Medical Journal.

[12]  Richard Heeks,et al.  Health information systems: Failure, success and improvisation , 2006, Int. J. Medical Informatics.

[13]  Tigest Tamrat,et al.  Special Delivery: An Analysis of mHealth in Maternal and Newborn Health Programs and Their Outcomes Around the World , 2012, Maternal and Child Health Journal.

[14]  Sarah Jane Marshall,et al.  Developing countries face double burden of disease. , 2004, Bulletin of the World Health Organization.

[15]  Michael Rosemann,et al.  Toward Improving the Relevance of Information Systems Research to Practice: The Role of Applicability Checks , 2008, MIS Q..

[16]  Jørn Braa,et al.  Networks of Action: Sustainable Health Information Systems Across Developing Countries , 2004, MIS Q..

[17]  R. Istepanian,et al.  M-Health: Emerging Mobile Health Systems , 2006 .

[18]  Judith Good,et al.  Designing new technologies for illiterate populations: A study in mobile phone interface design , 2008, Interact. Comput..

[19]  Luiz Augusto Facchini,et al.  Health information technology in primary health care in developing countries: a literature review. , 2004, Bulletin of the World Health Organization.

[20]  Matthew Kam,et al.  Social dynamics of early stage co-design in developing regions , 2007, CHI.

[21]  Arul Chib,et al.  The Aceh Besar midwives with mobile phones project: Design and evaluation perspectives using the information and communication technologies for healthcare development model , 2010, J. Comput. Mediat. Commun..

[22]  Steven H. Brown,et al.  Research Paper: Changes in Physicians' Computer Anxiety and Attitudes Related to Clinical Information System Use , 1994, J. Am. Medical Informatics Assoc..

[23]  R. J. Hayes,et al.  The validity of verbal autopsies for assessing the causes of institutional maternal death. , 1998, Studies in family planning.

[24]  Guilbert Jj The World Health Report 2006: working together for health. , 2006 .

[25]  Carol Priestley,et al.  Meeting the information needs of health workers in developing countries , 1997, BMJ.

[26]  Kentaro Toyama,et al.  Computing for global development: is it computer science research? , 2009, CCRV.

[27]  Mohsen Naghavi,et al.  Maternal Mortality for 181 Countries, 1980−2008: A Systematic Analysis of Progress Toward Millennium Development Goal 5 , 2011 .

[28]  S Corcoran-Perry,et al.  Developing clinical practice environments supporting the knowledge work of nurses. , 2001, Computers in nursing.

[29]  Stephen Pearson,et al.  The Implications of Shortages of Health Professionals for Maternal Health in Sub-Saharan Africa , 2006, Reproductive health matters.

[30]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[31]  J. Sorrells-Jones,et al.  Knowledge workers and knowledge-intense organizations, Part 3. Implications for preparing healthcare professionals. , 1999, The Journal of nursing administration.

[32]  Bradley A. Evanoff,et al.  An Analysis of Nurses' Cognitive Work: A New Perspective for Understanding Medical Errors , 2005 .

[33]  C. Whitty,et al.  Deployment of ACT antimalarials for treatment of malaria: challenges and opportunities , 2008, Malaria Journal.

[34]  B. Trudell Local-language literacy and sustainable development in Africa , 2009 .

[35]  M. Chopra,et al.  HIV and infant feeding: Child health. , 2006 .

[36]  John L. Bennett,et al.  Visual display terminals: Usability issues and health concerns , 1984 .

[37]  S. Bakken,et al.  Assessment of South African Nurse‐Midwives' Knowledge Pre– and Post–Short‐Term Training in Antiretroviral Treatment , 2006, The Journal of the Association of Nurses in AIDS Care : JANAC.

[38]  Sandeep Purao,et al.  Design Research in the Technology of Information Systems: Truth or Dare , 2002 .

[39]  Stephen Kimani,et al.  Appropriating and assessing heuristics for mobile computing , 2006, AVI '06.

[40]  Jay Lundell,et al.  Tales, Tours, Tools, and Troupes: A Tiered Research Method to Inform Ubiquitous Designs for the Elderly , 2004, BCS HCI.

[41]  Arthur Heywood,et al.  Developing a District Health Information System in South Africa: A Social Process or Technical Solution? , 2001, MedInfo.

[42]  Richard Heeks,et al.  Information Systems and Developing Countries: Failure, Success, and Local Improvisations , 2002, Inf. Soc..

[43]  Tom Gross,et al.  Mobile HCI and technical ICTD: a methodological perspective , 2010, Mobile HCI.

[44]  Po-Yin Yen Health information technology usability evaluation: methods, models, and measures , 2010 .

[45]  Doris Deedei Khalil,et al.  Experiences of teaching nursing in four countries. , 2006, Nursing forum.

[46]  Alan R. Hevner,et al.  The Three Cycle View of Design Science , 2007, Scand. J. Inf. Syst..

[47]  M G Kahn,et al.  Contextual inquiry: discovering physicians' true needs. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[48]  A. Aikins Healer shopping in Africa: new evidence from rural-urban qualitative study of Ghanaian diabetes experiences , 2005, BMJ : British Medical Journal.

[49]  P. Scott,et al.  Knowledge work in nursing and midwifery: an evaluation through computer-mediated communication. , 2006, International journal of nursing studies.

[50]  C. Whitty,et al.  How can malaria rapid diagnostic tests achieve their potential? A qualitative study of a trial at health facilities in Ghana , 2010, Malaria Journal.

[51]  C. Fofie,et al.  A two-year review of uterine rupture in a regional hospital. , 2011, Ghana medical journal.

[52]  Susanna Martikainen,et al.  Participatory interaction design in user requirements specification in healthcare , 2010, MedInfo.

[53]  Charles P. Friedman,et al.  Where's the Science in Medical Informatics? , 1995, J. Am. Medical Informatics Assoc..

[54]  Ronald Rosenfeld,et al.  HealthLine: Speech-based access to health information by low-literate users , 2007, 2007 International Conference on Information and Communication Technologies and Development.

[55]  M. Kruk,et al.  Key factors leading to reduced recruitment and retention of health professionals in remote areas of Ghana: a qualitative study and proposed policy solutions , 2011, Human resources for health.

[56]  P. Allotey,et al.  Information quality in a remote rural maternity unit in Ghana. , 2000, Health policy and planning.

[57]  J G Ozbolt,et al.  Clinical nursing informatics. Developing tools for knowledge workers. , 1993, The Nursing clinics of North America.

[58]  J. Rayner,et al.  Malaria, Intestinal Helminths and Other Risk Factors for Stillbirth in Ghana , 2010, Infectious diseases in obstetrics and gynecology.

[59]  P. Mechael The Case for mHealth in Developing Countries , 2009, Innovations: Technology, Governance, Globalization.

[60]  D. Aheto,et al.  Rural perspectives on HIV/AIDS prevention: a comparative study of Thailand and Ghana. , 2005, Health policy.

[61]  J. Blaya,et al.  Implementing medical information systems in developing countries, what works and what doesn't. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[62]  J. Guilbert,et al.  The World Health Report 2006: working together for health. , 2006, Education for health.

[63]  Francisco del Pozo,et al.  Analysis of information and communication needs in rural primary health care in developing countries , 2005, IEEE Transactions on Information Technology in Biomedicine.

[64]  P. Andreatta,et al.  Evaluation of simulation-based training on the ability of birth attendants to correctly perform bimanual compression as obstetric first aid , 2011 .

[65]  Adam Wright,et al.  Persistent Paper: The Myth of "Going Paperless" , 2009, AMIA.

[66]  Martin Bichler,et al.  Design science in information systems research , 2006, Wirtschaftsinf..

[67]  Hong Wang,et al.  The financial protection effect of Ghana National Health Insurance Scheme: evidence from a study in two rural districts , 2011, International journal for equity in health.

[68]  Richard Heeks,et al.  Explaining ERP failure in a developing country: a Jordanian case study , 2010, J. Enterp. Inf. Manag..

[69]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[70]  Marc Berg,et al.  Implementing information systems in health care organizations: myths and challenges , 2001, Int. J. Medical Informatics.

[71]  Gaetano Borriello,et al.  E-imci: improving pediatric health care in low-income countries , 2008, CHI.

[72]  D. Southall,et al.  Strengthening the emergency healthcare system for mothers and children in The Gambia , 2010, Reproductive health.

[73]  P. Boynton,et al.  Developing effective chronic disease interventions in Africa: insights from Ghana and Cameroon , 2010, Globalization and health.

[74]  Jun Zhang,et al.  Model Formulation: The AMPATH Nutritional Information System: Designing a Food Distribution Electronic Record System in Rural Kenya , 2009, J. Am. Medical Informatics Assoc..

[75]  Juhani Iivari,et al.  A Paradigmatic Analysis of Information Systems As a Design Science , 2007, Scand. J. Inf. Syst..

[76]  Jørn Braa,et al.  DEVELOPING HEALTH INFORMATION SYSTEMS IN DEVELOPING COUNTRIES THE FLEXIBLE STANDARDS STRATEGY , 2006 .

[77]  N. Donkor,et al.  21st century nursing practice in Ghana: challenges and opportunities. , 2011, International nursing review.

[78]  Barbara Aronson,et al.  Improving online access to medical information for low-income countries. , 2004, The New England journal of medicine.

[79]  J. Wyatt,et al.  Evaluating computerised health information systems: hard lessons still to be learnt , 2003, BMJ : British Medical Journal.

[80]  Richard Heeks,et al.  ICT4D 2.0: The Next Phase of Applying ICT for International Development , 2008, Computer.

[81]  William M. Tierney,et al.  Evaluating a scalable model for implementing electronic health records in resource-limited settings , 2010, J. Am. Medical Informatics Assoc..

[82]  C. Finn Autonomy: an important component for nurses' job satisfaction. , 2001, International journal of nursing studies.

[83]  Jeffrey James,et al.  Mobile phones in Africa: how much do we really know? , 2007, Social indicators research.

[84]  Bonnie Kaplan,et al.  Review: Addressing Organizational Issues into the Evaluation of Medical Systems , 1997, J. Am. Medical Informatics Assoc..

[85]  Alan R. Hevner,et al.  The Information Systems Research Cycle , 2003, Computer.

[86]  Edward Johnson,et al.  Millennium Global Village-Net: Bringing together Millennium Villages throughout sub-Saharan Africa , 2009, Int. J. Medical Informatics.

[87]  Warren J. Winkelman,et al.  Evaluating computerised health information systems: Opportunities were missed , 2003, BMJ : British Medical Journal.

[88]  H. Skinner,et al.  An agenda for action. , 1990, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[89]  Stephen M. Mutula,et al.  Testing a recent model of ICT in development: Botswana and its university , 2007 .

[90]  Ariel Pablos-Mendez,et al.  An agenda for action on global e-health. , 2010, Health affairs.

[91]  Peter Hoonakker,et al.  ICU nurses' acceptance of electronic health records , 2011, J. Am. Medical Informatics Assoc..

[92]  Alan D. Lopez,et al.  Maternal mortality for 181 countries, 1980–2008: a systematic analysis of progress towards Millennium Development Goal 5 , 2010, The Lancet.

[93]  Diane M. Strong,et al.  Data quality in context , 1997, CACM.

[94]  Ashish K. Jha,et al.  Electronic health records in small physician practices: availability, use, and perceived benefits , 2011, J. Am. Medical Informatics Assoc..

[95]  G. Musinguzi,et al.  Distribution of causes of maternal mortality among different socio-demographic groups in Ghana; a descriptive study , 2011, BMC public health.

[96]  Steven R. Simon,et al.  Implementation and Use of an Electronic Health Record within the Indian Health Service , 2007, J. Am. Medical Informatics Assoc..

[97]  David W. Bates,et al.  Synthesis of Research Paper: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality , 2003, J. Am. Medical Informatics Assoc..

[98]  J. Sorrells-Jones,et al.  Knowledge workers and knowledge-intense organizations, Part 1: A promising framework for nursing and healthcare. , 1999, The Journal of nursing administration.

[99]  George Wak,et al.  Self-reported health and functional limitations among older people in the Kassena-Nankana District, Ghana , 2010, Global health action.

[100]  Harold I. Goldberg Electronic Medical Record (EMR) , 2002 .

[101]  S. Ward,et al.  The Nurse as the Knowledge Worker , 1987 .

[102]  S Antrobus,et al.  Developing the nurse as a knowledge worker in health--learning the artistry of practice. , 1997, Journal of advanced nursing.

[103]  Maria G. N. Musoke Maternal Health Care in Rural Uganda: Leveraging Traditional and Modern Knowledge Systems , 2002 .

[104]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[105]  Ken Orr,et al.  Structured requirements definition , 1981 .

[106]  W. Kaplan,et al.  Globalization and Health BioMed Central Debate , 2006 .

[107]  Fabian A. Ehikhamenor,et al.  The information needs and sources of primary health care workers in the Upper East Region of Ghana , 1996, J. Inf. Sci..

[108]  Gerald P. Douglas,et al.  Experience Implementing a Point-of-Care Electronic Medical Record System for Primary Care in Malawi , 2010, MedInfo.

[109]  R. Hinson,et al.  Towards a sustainable framework for computer based health information systems (CHIS) for least developed countries (LDCs). , 2007, International journal of health care quality assurance.

[110]  Alan R. Hevner,et al.  Design Research in Information Systems: Theory and Practice , 2010 .

[111]  A. Hill,et al.  The Health of the “Older Women” in Accra, Ghana: Results of the Women’s Health Study of Accra , 2011, Journal of cross-cultural gerontology.

[112]  Suzanne Bakken,et al.  The Effect of a Mobile Clinical Decision Support System on the Diagnosis of Obesity and Overweight in Acute and Primary Care Encounters , 2009, ANS. Advances in nursing science.

[113]  Katharina Kober,et al.  Scaling up access to antiretroviral treatment in southern Africa: who will do the job? , 2004, The Lancet.

[114]  L. Matowe,et al.  Knowledge of medicine outlets’ staff and their practices for prevention and management of malaria in Ghana , 2010, Pharmacy World & Science.

[115]  S. Leshabari,et al.  HIV and infant feeding counselling: challenges faced by nurse-counsellors in northern Tanzania , 2007, Human resources for health.

[116]  Á. Gil,et al.  Factors associated with maternal mortality in Sub-Saharan Africa: an ecological study , 2009, BMC public health.

[117]  J. Blaya,et al.  E-health technologies show promise in developing countries. , 2010, Health affairs.

[118]  G. Walsham,et al.  Research on information systems in developing countries: Current landscape and future prospects , 2006 .

[119]  I D Montoya,et al.  Point-of-care systems, informatics, and health care delivery. , 1996, The Health care supervisor.

[120]  Arie Hasman,et al.  Review Paper: Determinants of Success of Inpatient Clinical Information Systems: A Literature Review , 2003, J. Am. Medical Informatics Assoc..

[121]  Lydia Kapiriri,et al.  Health practitioners' and health planners' information needs and seeking behavior for decision making in Uganda , 2006, Int. J. Medical Informatics.

[122]  S. Bakken,et al.  Development of a Customizable Health IT Usability Evaluation Scale. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[123]  Matt Jones,et al.  Mobile Interaction Design , 2006 .

[124]  J. Fullerton,et al.  Quality considerations in midwifery pre-service education: exemplars from Africa. , 2011, Midwifery.

[125]  Montoya Id,et al.  Point-of-care systems, informatics, and health care delivery. , 1996 .

[126]  Darrell L. Parks,et al.  Agenda for action , 2005, Including the Excluded.

[127]  M. Musoke Information and its value to health workers in rural Uganda: a qualitative perspective. , 2008, Health libraries review.

[128]  Suzanne Bakken,et al.  Integrating evidence into clinical information systems for nursing decision support , 2008, Int. J. Medical Informatics.

[129]  Qingxia Chen,et al.  An Electronic Medical Record in Primary Care: Impact on Satisfaction, Work Efficiency and Clinic Processes , 2006, AMIA.

[130]  Jun Gong,et al.  GUIDELINES FOR HANDHELD MOBILE DEVICE INTERFACE DESIGN , 2004 .

[131]  E.K Appah,et al.  Improving recordkeeping for maternal mortality programs, Kumasi, Ghana , 1997, International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics.

[132]  Trudie Lang,et al.  Advancing Global Health Research Through Digital Technology and Sharing Data , 2011, Science.

[133]  H. Simon,et al.  The sciences of the artificial (3rd ed.) , 1996 .

[134]  T. Bärnighausen,et al.  Health workers and vaccination coverage in developing countries: an econometric analysis , 2007, The Lancet.

[135]  Ajay S. Vinze,et al.  Understanding the Philosophical Underpinnings of Software Engineering Research in Information Systems , 2001, Inf. Syst. Frontiers.