Improving the quality of health information: a qualitative assessment of data management and reporting systems in Botswana

BackgroundEnsuring that data collected through national health information systems are of sufficient quality for meaningful interpretation is a challenge in many resource-limited countries. An assessment was conducted to identify strengths and weaknesses of the health data management and reporting systems that capture and transfer routine monitoring and evaluation (M&E) data in Botswana.MethodsThis was a descriptive, qualitative assessment. In-depth interviews were conducted at the national (n = 27), district (n = 31), and facility/community (n = 71) levels to assess i) M&E structures, functions, and capabilities; ii) indicator definitions and reporting guidelines; iii) data collection forms and tools; iv) data management processes; and v) links with the national reporting system. A framework analysis was conducted using ATLAS.ti v6.1.ResultsHealth programs generally had standardized data collection and reporting tools and defined personnel for M&E responsibilities at the national and district levels. Best practices unique to individual health programs were identified and included a variety of relatively low-resource initiatives such as attention to staffing patterns, making health data more accessible for evidence-based decision-making, developing a single source of information related to indicator definitions, data collection tools, and management processes, and utilization of supportive supervision visits to districts and facilities. Weakness included limited ownership of M&E-related duties within facilities, a lack of tertiary training programs to build M&E skills, few standard practices related to confidentiality and document storage, limited dissemination of indicator definitions, and limited functionality of electronic data management systems.ConclusionsAddressing fundamental M&E system issues, further standardization of M&E practices, and increasing health services management responsiveness to time-sensitive information are critical to sustain progress related to health service delivery in Botswana. In addition to high-resource initiatives, such as investments in electronic medical record systems and tertiary training programs, there are a variety of low-resource initiatives, such as regular data quality checks, that can strengthen national health information systems. Applying best practices that are effective within one health program to data management and reporting systems of other programs is a practical approach for strengthening health informatics and improving data quality.

[1]  J. Ledikwe,et al.  Establishing a health information workforce: innovation for low- and middle-income countries , 2013, Human Resources for Health.

[2]  Gabrielle E. O'Malley,et al.  Evaluation of a Well-Established Task-Shifting Initiative: The Lay Counselor Cadre in Botswana , 2013, PloS one.

[3]  Agnes Binagwaho,et al.  Cell Phone-Based and Internet-Based Monitoring and Evaluation of the National Antiretroviral Treatment Program During Rapid Scale-Up in Rwanda: TRACnet, 2004–2010 , 2012, Journal of acquired immune deficiency syndromes.

[4]  O. Ronveaux,et al.  Accuracy and quality of immunization information systems in forty‐one low income countries , 2009, Tropical medicine & international health : TM & IH.

[5]  K. Mate,et al.  Challenges for Routine Health System Data Management in a Large Public Programme to Prevent Mother-to-Child HIV Transmission in South Africa , 2009, PloS one.

[6]  David L. Blazes,et al.  Impact of two interventions on timeliness and data quality of an electronic disease surveillance system in a resource limited setting (Peru): a prospective evaluation , 2009, BMC Medical Informatics Decis. Mak..

[7]  Theo Lippeveld,et al.  Evaluation of the Performance of Routine Information System Management (PRISM) framework: evidence from Uganda , 2010, BMC health services research.

[8]  C. AbouZahr,et al.  Health information systems: the foundations of public health. , 2005, Bulletin of the World Health Organization.

[9]  Jaap Koot,et al.  Design and implementation of a health management information system in Malawi: issues, innovations and results. , 2005, Health policy and planning.

[10]  N. Ford,et al.  A systematic review of task- shifting for HIV treatment and care in Africa , 2010, Human resources for health.

[11]  Improving national data collection systems from voluntary counselling and testing centres in Kenya. , 2007, Bulletin of the World Health Organization.

[12]  S. Fonn,et al.  Aligning vertical interventions to health systems: a case study of the HIV monitoring and evaluation system in South Africa , 2012, Health Research Policy and Systems.

[13]  Anthony D Harries,et al.  Assessing the quality of data aggregated by antiretroviral treatment clinics in Malawi. , 2008, Bulletin of the World Health Organization.

[14]  Margaret Chan,et al.  Meeting the Demand for Results and Accountability: A Call for Action on Health Data from Eight Global Health Agencies , 2010, PLoS medicine.

[15]  Vincent Shaw Health information system reform in South Africa: developing an essential data set. , 2005, Bulletin of the World Health Organization.

[16]  Johan Sæbø,et al.  Comprehensive yet scalable health information systems for low resource settings: a collaborative effort in sierra leone. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[17]  L. van der Merwe,et al.  Errors in the completion of the death notification form. , 2007, South African medical journal = Suid-Afrikaanse tydskrif vir geneeskunde.

[18]  Judith Green,et al.  Qualitative methods for health research , 2004 .

[19]  D. Ekouevi,et al.  Strengthening health systems through HIV monitoring and evaluation in Sub-Saharan Africa , 2011, Current opinion in HIV and AIDS.

[20]  Frederick Bukachi,et al.  Information technology for health in developing countries. , 2007, Chest.

[21]  Jørn Braa,et al.  Improving quality and use of data through data-use workshops: Zanzibar, United Republic of Tanzania. , 2012, Bulletin of the World Health Organization.

[22]  K. Mate,et al.  Improving public health information: a data quality intervention in KwaZulu-Natal, South Africa. , 2012, Bulletin of the World Health Organization.

[23]  N. Thorogood,et al.  Qualitative Methods for Health Research. (2nd edition) , 2009 .

[24]  Shehzad Ali,et al.  The effectiveness and cost implications of task-shifting in the delivery of antiretroviral therapy to HIV-infected patients: a systematic review. , 2013, Health policy and planning.

[25]  Theo Lippeveld,et al.  PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems , 2009, Health policy and planning.

[26]  Denis Nash,et al.  Strategies for More Effective Monitoring and Evaluation Systems in HIV Programmatic Scale-Up in Resource-Limited Settings: Implications for Health Systems Strengthening , 2009, Journal of acquired immune deficiency syndromes.

[27]  Health information system reform in South Africa : developing an essential data set , .

[28]  Stephanie Tierney,et al.  Using Framework Analysis in nursing research: a worked example. , 2013, Journal of advanced nursing.

[29]  K. Herbst,et al.  An evaluation of the District Health Information System in rural South Africa. , 2008, South African medical journal = Suid-Afrikaanse tydskrif vir geneeskunde.