Data cleaning process for HIV-indicator data extracted from DHIS2 national reporting system: a case study of Kenya

Background The District Health Information Software-2 (DHIS2) is widely used by countries for national-level aggregate reporting of health-data. To best leverage DHIS2 data for decision-making, countries need to ensure that data within their systems are of the highest quality. Comprehensive, systematic, and transparent data cleaning approaches form a core component of preparing DHIS2 data for analyses. Unfortunately, there is paucity of exhaustive and systematic descriptions of data cleaning processes employed on DHIS2-based data. The aim of this study was to report on methods and results of a systematic and replicable data cleaning approach applied on HIV-data gathered within DHIS2 from 2011 to 2018 in Kenya, for secondary analyses. Methods Six programmatic area reports containing HIV-indicators were extracted from DHIS2 for all care facilities in all counties in Kenya from 2011 to 2018. Data variables extracted included reporting rate, reporting timeliness, and HIV-indicator data elements per facility per year. 93,179 facility-records from 11,446 health facilities were extracted from year 2011 to 2018. Van den Broeck et al. ’s framework, involving repeated cycles of a three-phase process (data screening, data diagnosis and data treatment), was employed semi-automatically within a generic five-step data-cleaning sequence, which was developed and applied in cleaning the extracted data. Various quality issues were identified, and Friedman analysis of variance conducted to examine differences in distribution of records with selected issues across eight years. Results Facility-records with no data accounted for 50.23% and were removed. Of the remaining, 0.03% had over 100% in reporting rates. Of facility-records with reporting data, 0.66% and 0.46% were retained for voluntary medical male circumcision and blood safety programmatic area reports respectively, given that few facilities submitted data or offered these services. Distribution of facility-records with selected quality issues varied significantly by programmatic area ( p  < 0.001). The final clean dataset obtained was suitable to be used for subsequent secondary analyses. Conclusions Comprehensive, systematic, and transparent reporting of cleaning-process is important for validity of the research studies as well as data utilization. The semi-automatic procedures used resulted in improved data quality for use in secondary analyses, which could not be secured by automated procedures solemnly.

[1]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[2]  G. Peersman,et al.  Are the Investments in National HIV Monitoring and Evaluation Systems Paying Off? , 2009, Journal of acquired immune deficiency syndromes.

[3]  Dorian Pyle,et al.  Data Preparation for Data Mining , 1999 .

[4]  A. Manya,et al.  DHIS2: The Tool to Improve Health Data Demand and Use in Kenya , 2014 .

[5]  Stephen Bach The HIV pandemic : local and global implications , 2007 .

[6]  Hyun Kang The prevention and handling of the missing data , 2013, Korean journal of anesthesiology.

[7]  Taoxin Peng,et al.  A rule based taxonomy of dirty data. , 2010 .

[8]  Dursun Delen,et al.  An assessment and cleaning framework for electronic health records data , 2018 .

[9]  Chunhua Weng,et al.  Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research , 2013, J. Am. Medical Informatics Assoc..

[10]  Thomas A. Smith,et al.  Incidence and admission rates for severe malaria and their impact on mortality in Africa , 2017, Malaria Journal.

[11]  Carlo Curino,et al.  And what can context do for data? , 2009, Commun. ACM.

[12]  Mohammad Hossain Mehrolhassani,et al.  The District Health Information System (DHIS2): A literature review and meta-synthesis of its strengths and operational challenges based on the experiences of 11 countries , 2018, Health information management : journal of the Health Information Management Association of Australia.

[13]  Diane M. Strong,et al.  Data quality in context , 1997, CACM.

[14]  J. Welton,et al.  Using a Data Quality Framework to Clean Data Extracted from the Electronic Health Record: A Case Study , 2016, EGEMS.

[15]  Joseph M. Hellerstein,et al.  Quantitative Data Cleaning for Large Databases , 2008 .

[16]  R. Snow,et al.  Sub-national stratification of malaria risk in mainland Tanzania: a simplified assembly of survey and routine data , 2020, Malaria Journal.

[17]  Xuan Li,et al.  Optimizing de novo transcriptome assembly from short-read RNA-Seq data: a comparative study , 2011, BMC Bioinformatics.

[18]  James M. Kariuki,et al.  Automating indicator data reporting from health facility EMR to a national aggregate data system in Kenya: An Interoperability field-test using OpenMRS and DHIS2 , 2016, Online journal of public health informatics.

[19]  Lei Jiang,et al.  Data Quality Is Context Dependent , 2010, BIRTE.

[20]  T. Boerma,et al.  Using health-facility data to assess subnational coverage of maternal and child health indicators, Kenya , 2017, Bulletin of the World Health Organization.

[21]  R. Snow,et al.  Completeness of malaria indicator data reporting via the District Health Information Software 2 in Kenya, 2011–2015 , 2017, Malaria Journal.

[22]  G. Asiki,et al.  Generating statistics from health facility data: the state of routine health information systems in Eastern and Southern Africa , 2019, BMJ Global Health.

[23]  David Moher,et al.  The REporting of Studies Conducted Using Observational Routinely-Collected Health Data (RECORD) Statement: Methods for Arriving at Consensus and Developing Reporting Guidelines , 2015, PloS one.

[24]  R. Granich,et al.  Status and methodology of publicly available national HIV care continua and 90-90-90 targets: A systematic review , 2017, PLoS medicine.

[25]  Ihab F. Ilyas,et al.  Data Cleaning: Overview and Emerging Challenges , 2016, SIGMOD Conference.

[26]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[27]  Roger Eeckels,et al.  Data Cleaning: Detecting, Diagnosing, and Editing Data Abnormalities , 2005, PLoS medicine.

[28]  Lukasz Golab,et al.  Contextual Data Cleaning , 2018, 2018 IEEE 34th International Conference on Data Engineering Workshops (ICDEW).

[29]  Helena Galhardas,et al.  A Taxonomy of Data Quality Problems , 2005 .

[30]  N. Umar,et al.  Quality of routine facility data for monitoring priority maternal and newborn indicators in DHIS2: A case study from Gombe State, Nigeria , 2019, PloS one.

[31]  Mark L. Diana,et al.  How can routine health information systems improve health systems functioning in low- and middle-income countries? Assessing the evidence base. , 2012, Advances in health care management.

[32]  Paul P. De Lay,et al.  Strategic information for HIV programmes , 2009 .

[33]  Heiko Mueller,et al.  Problems , Methods , and Challenges in Comprehensive Data Cleansing , 2005 .

[34]  R. Snow,et al.  Coverage of routine reporting on malaria parasitological testing in Kenya, 2015–2016 , 2017, Global health action.

[35]  Alice Muga,et al.  Door – to – door immunization strategy for improving access and utilization of immunization Services in Hard-to-Reach Areas: a case of Migori County, Kenya , 2019, BMC Public Health.

[36]  Padhraic Smyth,et al.  Knowledge Discovery and Data Mining: Towards a Unifying Framework , 1996, KDD.

[37]  Wenfei Fan,et al.  Foundations of Data Quality Management , 2012, Foundations of Data Quality Management.

[38]  Dilip Kumar Kulkarni Interpretation and display of research results , 2016, Indian journal of anaesthesia.

[39]  Olav Poppe,et al.  Manual for the DHIS2 quality tool. Understanding the basics of improving data quality , 2017 .

[40]  Panos Vassiliadis,et al.  ARKTOS: A Tool For Data Cleaning and Transformation in Data Warehouse Environments , 2000, IEEE Data Eng. Bull..

[41]  Janet Wiles,et al.  Detecting contaminated birthdates using generalized additive models , 2014, BMC Bioinformatics.

[42]  Bradley H Wagenaar,et al.  Opportunities and challenges in conducting secondary analysis of HIV programmes using data from routine health information systems and personal health information , 2016, Journal of the International AIDS Society.

[43]  F. Ssengooba,et al.  The impact of PEPFAR transition on HIV service delivery at health facilities in Uganda , 2019, PloS one.