The pot calling the kettle black: the extent and type of errors in a computerized immunization registry and by parent report

BackgroundAccurate classification of children’s immunization status is essential for clinical care, administration and evaluation of immunization programs, and vaccine program research. Computerized immunization registries have been proposed as a valuable alternative to provider paper records or parent report, but there is a need to better understand the challenges associated with their use. This study assessed the accuracy of immunization status classification in an immunization registry as compared to parent report and determined the number and type of errors occurring in both sources.MethodsThis study was a sub-analysis of a larger study which compared the characteristics of children whose immunizations were up to date (UTD) at two years as compared to those not UTD. Children’s immunization status was initially determined from a population-based immunization registry, and then compared to parent report of immunization status, as reported in a postal survey. Discrepancies between the two sources were adjudicated by review of immunization providers’ hard-copy clinic records. Descriptive analyses included calculating proportions and confidence intervals for errors in classification and reporting of the type and frequency of errors.ResultsAmong the 461 survey respondents, there were 60 discrepancies in immunization status. The majority of errors were due to parent report (n = 44), but the registry was not without fault (n = 16). Parents tended to erroneously report their child as UTD, whereas the registry was more likely to wrongly classify children as not UTD. Reasons for registry errors included failure to account for varicella disease history, variable number of doses required due to age at series initiation, and doses administered out of the region.ConclusionsThese results confirm that parent report is often flawed, but also identify that registries are prone to misclassification of immunization status. Immunization program administrators and researchers need to institute measures to identify and reduce misclassification, in order for registries to play an effective role in the control of vaccine-preventable disease.

[1]  R. Daum,et al.  Accuracy of immunization histories provided by adults accompanying preschool children to a pediatric emergency department. , 1993, JAMA.

[2]  A. Pennisi,et al.  Evaluating the accuracy of transcribed computer-stored immunization data. , 1994, Pediatrics.

[3]  S. Halperin,et al.  Childhood pertussis immunization status as reported by parents and the completeness of public-health and physician records in Nova Scotia. , 1996, Canada communicable disease report = Releve des maladies transmissibles au Canada.

[4]  Comparing a Computer-based Childhood Vaccination Registry with Parental Vaccination Cards: A Population-based Study of Delaware Children , 1997, Clinical pediatrics.

[5]  David R. Smith,et al.  Errors and correlates in parental recall of child immunizations: effects on vaccination coverage estimates. , 1997, Pediatrics.

[6]  B. Guyer,et al.  Estimating vaccination coverage using parental recall, vaccination cards, and medical records. , 1998, Public health reports.

[7]  R. Linkins,et al.  Immunization registries: the cornerstone of childhood immunization in the 21st century. , 1998, Pediatric annals.

[8]  D Wood,et al.  Immunization registries in the United States: implications for the practice of public health in a changing health care system. , 1999, Annual review of public health.

[9]  P. McIntyre,et al.  Immunisation coverage in Australian children: a systematic review 1990-1998. , 1999, Communicable diseases intelligence.

[10]  S. Palfrey,et al.  Immunization entry at the point of service improves quality, saves time, and is well-accepted. , 2000, Pediatrics.

[11]  S. Stokley,et al.  The impact of record scattering on the measurement of immunization coverage. , 2001, Pediatrics.

[12]  R. Samuels,et al.  Improving accuracy in a computerized immunization registry. , 2002, Ambulatory pediatrics : the official journal of the Ambulatory Pediatric Association.

[13]  R. Linkins,et al.  Assessing immunization registry data completeness in Bexar County, Texas. , 2002, American journal of preventive medicine.

[14]  L. Rodewald,et al.  Fragmentation of immunization history among providers and parents of children in selected underserved areas. , 2002, American journal of preventive medicine.

[15]  G. DeFriese,et al.  The challenge and potential of childhood immunization registries. , 2003, Annual review of public health.

[16]  J. Steiner,et al.  Immunization registry accuracy: improvement with progressive clinical application. , 2003, American journal of preventive medicine.

[17]  L. Valiquette,et al.  [Why are some children incompletely vaccinated at the age of 2?]. , 2003, Canadian journal of public health = Revue canadienne de sante publique.

[18]  B. Duval,et al.  Pourquoi certains enfants sont incomplètement vaccinés à l’âge de 2 ans ? , 2003 .

[19]  B. Hull,et al.  Effectiveness of the linkage of child care and maternity payments to childhood immunisation. , 2004, Vaccine.

[20]  E. P. Johnson.  The Pot Calling the Kettle "Black" , 2006 .

[21]  BMC Pediatrics , 2005 .

[22]  Meena Khare,et al.  Assessment of immunization registry databases as supplemental sources of data to improve ascertainment of vaccination coverage estimates in the national immunization survey. , 2006, Archives of pediatrics & adolescent medicine.

[23]  S. Omer,et al.  Measuring immunization coverage among preschool children: past, present, and future opportunities. , 2006, Epidemiologic reviews.

[24]  M. Kolasa,et al.  How complete are immunization registries? The Philadelphia story. , 2006, Ambulatory pediatrics : the official journal of the Ambulatory Pediatric Association.

[25]  L. Zimmerman,et al.  Immunization information systems national research and evaluation agenda. , 2007, Journal of public health management and practice : JPHMP.

[26]  B. Mahon,et al.  Implications for registry-based vaccine effectiveness studies from an evaluation of an immunization registry: A cross-sectional study , 2008, BMC public health.

[27]  B. Bulloch,et al.  Accuracy of a State Immunization Registry in the Pediatric Emergency Department , 2008, Pediatric emergency care.

[28]  E. Belongia,et al.  Evaluation of self-reported and registry-based influenza vaccination status in a Wisconsin cohort. , 2009, Vaccine.

[29]  S. Greene,et al.  Accuracy of data on influenza vaccination status at four Vaccine Safety Datalink sites. , 2009, American journal of preventive medicine.

[30]  D. Yankey,et al.  Validity of Parent-Reported Vaccination Status for Adolescents Aged 13–17 Years: National Immunization Survey-Teen, 2008 , 2011, Public health reports.

[31]  L. Madoff,et al.  The use of immunization registry-based data in vaccine effectiveness studies. , 2011, Vaccine.

[32]  J A Laroche,et al.  Immunisation registers in Canada: progress made, current situation, and challenges for the future. , 2012, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[33]  Elizabeth T Luman,et al.  Validity of vaccination cards and parental recall to estimate vaccination coverage: a systematic review of the literature. , 2013, Vaccine.