Defining & assessing the quality, usability, and utilization of immunization data

BackgroundHigh quality data are needed for decision-making at all levels of the public health system, from guiding public health activities at the local level, to informing national policy development, to monitoring the impact of global initiatives. Although a number of approaches have been developed to evaluate the underlying quality of routinely collected vaccination administrative data, there remains a lack of consensus around how data quality is best defined or measured.DiscussionWe present a definitional framework that is intended to disentangle many of the elements that have confused discussions of vaccination data quality to date. The framework describes immunization data in terms of three key characteristics: data quality, data usability, and data utilization. The framework also offers concrete suggestions for a specific set of indicators that could be used to better understand immunization those key characteristics, including Trueness, Concurrence, Relevancy, Efficiency, Completeness, Timeliness, Integrity, Consistency, and Utilization.ConclusionBeing deliberate about the choice of indicators; being clear on their definitions, limitations, and methods of measurement; and describing how those indicators work together to give a more comprehensive and practical understanding of immunization data quality, usability, and use, should yield more informed, and therefore better, programmatic decision-making.

[1]  Robert M. Deiters Organization for Economic Co-Operation and Development (OECD). , 1968 .

[2]  Sybil P. Parker,et al.  McGraw-Hill dictionary of scientific and technical terms , 1976 .

[3]  マグローヒル科学技術用語大辞典編集委員会,et al.  マグローヒル科学技術用語大辞典 = McGraw-Hill dictionary of scientific and technical terms , 1979 .

[4]  E. Hansen,et al.  The quality of immunization data from routine primary health care reports: a case from Nepal. , 1998, Health policy and planning.

[5]  A. Batson,et al.  Using Immunization Coverage Rates for Monitoring Health Sector Performance Measurement and Interpretation Issues , 2000 .

[6]  C. Murray,et al.  Validity of reported vaccination coverage in 45 countries , 2003, The Lancet.

[7]  D. Pfeffermann,et al.  Small area estimation , 2011 .

[8]  J. Lloyd,et al.  The immunization data quality audit: verifying the quality and consistency of immunization monitoring systems. , 2005, Bulletin of the World Health Organization.

[9]  David R. Cox,et al.  The Oxford Dictionary of Statistical Terms , 2006 .

[10]  Stephen S Lim,et al.  Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analysis of three-dose diphtheria, tetanus, and pertussis immunisation coverage , 2008, The Lancet.

[11]  O. Ronveaux,et al.  Accuracy and quality of immunization information systems in forty‐one low income countries , 2009, Tropical medicine & international health : TM & IH.

[12]  G. Gurtner,et al.  Statistics in medicine. , 2011, Plastic and reconstructive surgery.

[13]  J. Bryce,et al.  Comparison of Methods for Assessing Quality of Care for Community Case Management of Sick Children: An Application with Community Health Workers in Malawi , 2012, The American journal of tropical medicine and hygiene.

[14]  R. Kowalski,et al.  A Formal Representation of the WHO and UNICEF Estimates of National Immunization Coverage: A Computational Logic Approach , 2012, PloS one.

[15]  Debbie Bradshaw,et al.  Human Factors Affecting the Quality of Routinely Collected Data in South Africa , 2013, MedInfo.

[16]  Dale A. Rhoda,et al.  Measuring Coverage in MNCH: Design, Implementation, and Interpretation Challenges Associated with Tracking Vaccination Coverage Using Household Surveys , 2013, PLoS medicine.

[17]  Elizabeth T Luman,et al.  Validity of vaccination cards and parental recall to estimate vaccination coverage: a systematic review of the literature. , 2013, Vaccine.

[18]  D. Elbourne,et al.  Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects☆ , 2014, Journal of clinical epidemiology.

[19]  Ping Yu,et al.  A Review of Data Quality Assessment Methods for Public Health Information Systems , 2014, International journal of environmental research and public health.

[20]  A. MacNeil,et al.  Country Immunization Information System Assessments — Kenya, 2015 and Ghana, 2016 , 2017, MMWR. Morbidity and mortality weekly report.

[21]  A. MacNeil,et al.  Comparison of inflation of third dose diphtheria tetanus pertussis (DTP3) administrative coverage to other vaccine antigens. , 2017, Vaccine.

[22]  A. MacNeil,et al.  Enhancing Workforce Capacity to Improve Vaccination Data Quality, Uganda , 2017, Emerging Infectious Diseases.

[23]  Antigens , 2020, Encyclopedia of Behavioral Medicine.