A Review of Data Quality Assessment Methods for Public Health Information Systems

High quality data and effective data quality assessment are required for accurately evaluating the impact of public health interventions and measuring public health outcomes. Data, data use, and data collection process, as the three dimensions of data quality, all need to be assessed for overall data quality assessment. We reviewed current data quality assessment methods. The relevant study was identified in major databases and well-known institutional websites. We found the dimension of data was most frequently assessed. Completeness, accuracy, and timeliness were the three most-used attributes among a total of 49 attributes of data quality. The major quantitative assessment methods were descriptive surveys and data audits, whereas the common qualitative assessment methods were interview and documentation review. The limitations of the reviewed studies included inattentiveness to data use and data collection process, inconsistency in the definition of attributes of data quality, failure to address data users’ concerns and a lack of systematic procedures in data quality assessment. This review study is limited by the coverage of the databases and the breadth of public health information systems. Further research could develop consistent data quality definitions and attributes. More research efforts should be given to assess the quality of data use and the quality of data collection process.

[1]  P. D. De Lay,et al.  Are We on Course for Reporting on the Millennium Development Goals in 2015? , 2009, Journal of acquired immune deficiency syndromes.

[2]  Takeo Nakayama,et al.  Quantitative and qualitative verification of data quality in the childbirth registers of two rural district hospitals in Western Kenya. , 2012, Midwifery.

[3]  David L Buckeridge,et al.  Exploring the feasibility of integrating barcode scanning technology into vaccine inventory recording in seasonal influenza vaccination clinics. , 2012, Vaccine.

[4]  Muhammad Suleman Qazi,et al.  Health Management Information System utilization in Pakistan: challenges, pitfalls and the way forward. , 2011, Bioscience trends.

[5]  Rae Walker Health Information and Public Health , 2008, The HIM journal.

[6]  M. Dunne,et al.  Factors associated with health risk behavior among school children in urban Vietnam , 2013, Global health action.

[7]  R C Coile,et al.  The future of public health. , 1990, Hospital strategy report.

[8]  Diane M. Strong,et al.  Data quality in context , 1997, CACM.

[9]  Yu Wang,et al.  Emergence and control of infectious diseases in China , 2008, The Lancet.

[10]  E. Venkatarao,et al.  Monitoring Data Quality in Syndromic Surveillance: Learnings from a Resource Limited Setting , 2012, Journal of global infectious diseases.

[11]  Jian Xing,et al.  The profession of public health informatics: Still emerging? , 2009, Int. J. Medical Informatics.

[12]  Stacie Petter,et al.  Evaluating the success of an emergency response medical information system , 2011, Int. J. Medical Informatics.

[13]  C. Wong,et al.  Evaluation of sentinel surveillance system for monitoring hand, foot and mouth disease in Hong Kong , 2011, Public Health.

[14]  Anthony D Harries,et al.  Assessing the quality of data aggregated by antiretroviral treatment clinics in Malawi. , 2008, Bulletin of the World Health Organization.

[15]  Richard Y. Wang,et al.  Data Quality Assessment , 2002 .

[16]  A. Moodie Australia: the healthiest country by 2020 , 2008, The Medical journal of Australia.

[17]  Theo Lippeveld,et al.  PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems , 2009, Health policy and planning.

[18]  Pamela L Krahl,et al.  Public health potential of a disability tracking system: analysis of U.S. Navy and Marine Corps physical evaluation boards 2005-2006. , 2007, Military medicine.

[19]  C E Winslow,et al.  THE UNTILLED FIELDS OF PUBLIC HEALTH. , 2017, Science.

[20]  Carlo Batini,et al.  Methodologies for data quality assessment and improvement , 2009, CSUR.

[21]  W. Yasnoff,et al.  Public health informatics: improving and transforming public health in the information age. , 2000, Journal of public health management and practice : JPHMP.

[22]  Matthias Egger,et al.  Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings. , 2008, Bulletin of the World Health Organization.

[23]  Julie J McGowan,et al.  Electronic laboratory data quality and the value of a health information exchange to support public health reporting processes. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[24]  William B. Lober,et al.  Implementation and expansion of an electronic medical record for HIV care and treatment in Haiti: An assessment of system use and the impact of large-scale disruptions , 2012, Int. J. Medical Informatics.

[25]  Å. Thörn,et al.  The Nicaraguan Pesticide Poisoning Register: Constant Underreporting , 2008, International journal of health services : planning, administration, evaluation.

[26]  Mindy Hochgesang,et al.  Assessment of a national monitoring and evaluation system for rapid expansion of antiretroviral treatment in Malawi , 2007, Tropical medicine & international health : TM & IH.

[27]  W. Sappenfield,et al.  The Florida Investigation of Primary Late Preterm and Cesarean Delivery: The accuracy of the birth certificate and hospital discharge records , 2013, Maternal and Child Health Journal.

[28]  David L. Banks,et al.  Data quality: A statistical perspective , 2006 .

[29]  J. Lloyd,et al.  The immunization data quality audit: verifying the quality and consistency of immunization monitoring systems. , 2005, Bulletin of the World Health Organization.

[30]  A. Grant,et al.  Record-linkage and capture–recapture analysis to estimate the incidence and completeness of reporting of tuberculosis in England 1999–2002 , 2008, Epidemiology and Infection.

[31]  He Wang,et al.  Birth defects surveillance in China , 2011, World journal of pediatrics : WJP.

[32]  Rainu Kaushal,et al.  Root causes underlying challenges to secondary use of data. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[33]  J. A. Magnuson,et al.  Public Health Informatics and Information Systems , 2014, Health Informatics.

[34]  K. Mate,et al.  Challenges for Routine Health System Data Management in a Large Public Programme to Prevent Mother-to-Child HIV Transmission in South Africa , 2009, PloS one.

[35]  Dennis Wollersheim,et al.  Geocoding Coronial Data: Tools and Techniques to Improve Data Quality , 2012, Health information management : journal of the Health Information Management Association of Australia.

[36]  R. Asghar,et al.  Evaluation of the national tuberculosis surveillance system in Afghanistan. , 2013, Eastern Mediterranean health journal = La revue de sante de la Mediterranee orientale = al-Majallah al-sihhiyah li-sharq al-mutawassit.

[37]  Ruth Henderson,et al.  Case by case. , 2001, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[38]  N. Palomino,et al.  Data do count! Collection and use of maternal mortality data in Peru, 1990–2005, and improvements since 2005 , 2012, Reproductive health matters.

[39]  O. Ronveaux,et al.  Accuracy and quality of immunization information systems in forty‐one low income countries , 2009, Tropical medicine & international health : TM & IH.

[40]  Margaret Chan,et al.  Meeting the Demand for Results and Accountability: A Call for Action on Health Data from Eight Global Health Agencies , 2010, PLoS medicine.

[41]  Kerin Robinson,et al.  The Risk and Consequences of Clinical Miscoding Due to Inadequate Medical Documentation: A Case Study of the Impact on Health Services Funding , 2009, Health information management : journal of the Health Information Management Association of Australia.

[42]  John W. Loonsk,et al.  Implementation Brief: The Public Health Information Network (PHIN) Preparedness Initiative , 2006, J. Am. Medical Informatics Assoc..

[43]  S B Thacker,et al.  Future directions for comprehensive public health surveillance and health information systems in the United States. , 1994, American journal of epidemiology.

[44]  D. Henderson-smart,et al.  Using hospital discharge data for determining neonatal morbidity and mortality: a validation study , 2007, BMC Health Services Research.

[45]  Richard Y. Wang,et al.  Developing Measurement Scales for Data-Quality Dimensions , 2014 .

[46]  Mark McCarthy,et al.  Use of comparative data for integrated cancer services , 2007, BMC Health Services Research.

[47]  Diane M. Strong,et al.  Beyond Accuracy: What Data Quality Means to Data Consumers , 1996, J. Manag. Inf. Syst..

[48]  L. Curry The Future of the Public's Health in the 21st Century , 2005 .

[49]  William B. Lober,et al.  Timeliness and data element completeness of immunization data in Washington State in 2010: a comparison of data transfer methods , 2012, AMIA.

[50]  Thomas C. Redman,et al.  Measuring Data Accuracy: A Framework and Review , 2014 .

[51]  K. Sabin,et al.  Is the HIV sentinel surveillance system adequate in China? Findings from an evaluation of the national HIV sentinel surveillance system. , 2012, Western Pacific surveillance and response journal : WPSAR.

[52]  E. Andresen,et al.  Public health foundations: concepts and practices. , 2010 .

[53]  A. Peterson,et al.  Effects of georeferencing effort on mapping monkeypox case distributions and transmission risk , 2012, International Journal of Health Geographics.

[54]  Hong Chen,et al.  Do We Have the Reliable Data? An Exploration of Data Quality for AIDS Information System in China , 2013, MedInfo.

[55]  Daniel A Rodriguez,et al.  International Journal of Health Geographics the Importance of Accurate Road Data for Spatial Applications in Public Health: Customizing a Road Network , 2022 .

[56]  Margaret Chan,et al.  From new estimates to better data , 2012, The Lancet.

[57]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[58]  C. Schuster-Wallace,et al.  Improving Aboriginal health data capture: evidence from a health registry evaluation , 2010, Epidemiology and Infection.

[59]  N.L. Snee,et al.  The case for integrating public health informatics networks , 2004, IEEE Engineering in Medicine and Biology Magazine.

[60]  S. Vernon,et al.  Mortality Ascertainment of Women Veterans: A Comparison of Sources of Vital Status Information, 1979–2002 , 2009, Medical care.

[61]  Michael Marx,et al.  Where is information quality lost at clinical level? A mixed-method study on information systems and data quality in three urban Kenyan ANC clinics , 2013, Global health action.