Influenza Vaccination Among Pregnant Women: Self-report Compared With Vaccination Data From Electronic Health Records, 2018-2020 Influenza Seasons

Objectives: Having accurate influenza vaccination coverage estimates can guide public health activities. The objectives of this study were to (1) validate the accuracy of electronic health record (EHR)–based influenza vaccination data among pregnant women compared with survey self-report and (2) assess whether survey respondents differed from survey nonrespondents by demographic characteristics and EHR-based vaccination status. Methods: This study was conducted in the Vaccine Safety Datalink, a network of 8 large medical care organizations in the United States. Using EHR data, we identified all women pregnant during the 2018-2019 or 2019-2020 influenza seasons. Surveys were conducted among samples of women who did and did not appear vaccinated for influenza according to EHR data. Separate surveys were conducted after each influenza season, and respondents reported their influenza vaccination status. Analyses accounted for the stratified design, sampling probability, and response probability. Results: The survey response rate was 50.5% (630 of 1247) for 2018-2019 and 41.2% (721 of 1748) for 2019-2020. In multivariable analyses combining both survey years, non-Hispanic Black pregnant women had 3.80 (95% CI, 2.13-6.74) times the adjusted odds of survey nonresponse; odds of nonresponse were also higher for Hispanic pregnant women and women who had not received (per EHR data) influenza vaccine during current or prior influenza seasons. The sensitivity, specificity, and positive predictive value of EHR documentation of influenza vaccination compared with self-report were ≥92% for both survey years combined. The negative predictive value of EHR-based influenza vaccine status was 80.5% (95% CI, 76.7%-84.0%). Conclusions: EHR-based influenza vaccination data among pregnant women were generally concordant with self-report. New data sources and novel approaches to mitigating nonresponse bias may be needed to enhance influenza vaccination surveillance efforts.

[1]  M. Lindley,et al.  Coverage and Timing of Influenza Vaccination Among Privately Insured Pregnant Women in the United States, 2010-2018 , 2021, Public health reports.

[2]  S. Omer,et al.  Racial/Ethnic Disparities in Maternal Vaccine Knowledge, Attitudes, and Intentions , 2021, Public health reports.

[3]  K. Vesco,et al.  Vaccine Safety Datalink infrastructure enhancements for evaluating the safety of maternal vaccination , 2021, Therapeutic advances in drug safety.

[4]  Denise V. D’Angelo,et al.  Influenza and Tdap Vaccination Coverage Among Pregnant Women — United States, April 2020 , 2020, MMWR. Morbidity and mortality weekly report.

[5]  L. Grohskopf,et al.  Prevention and Control of Seasonal Influenza with Vaccines: Recommendations of the Advisory Committee on Immunization Practices — United States, 2020–21 Influenza Season , 2020, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[6]  International Classification of Diseases, Tenth Revision, Clinical Modification , 2020, Definitions.

[7]  Denise V. D’Angelo,et al.  Vital Signs: Burden and Prevention of Influenza and Pertussis Among Pregnant Women and Infants — United States , 2019, MMWR. Morbidity and mortality weekly report.

[8]  A. Srivastav,et al.  Seasonal Influenza Vaccination Coverage Trends Among Adult Populations, U.S., 2010-2016. , 2019, American journal of preventive medicine.

[9]  L. Grohskopf,et al.  Prevention and Control of Seasonal Influenza with Vaccines: Recommendations of the Advisory Committee on Immunization Practices — United States, 2019–20 Influenza Season , 2019, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[10]  Paul A. Harris,et al.  The REDCap consortium: Building an international community of software platform partners , 2019, J. Biomed. Informatics.

[11]  Mandi Yu,et al.  Statistical inference of the relative concentration index for complex surveys , 2019, Statistics in medicine.

[12]  Q. S. Huang,et al.  Influenza-Associated Outcomes Among Pregnant, Postpartum, and Nonpregnant Women of Reproductive Age. , 2019, The Journal of infectious diseases.

[13]  H. Ding,et al.  Influenza Vaccination Coverage Among Pregnant Women in the U.S., 2012-2015. , 2019, American journal of preventive medicine.

[14]  J. Singleton,et al.  Vaccination Coverage Among Children Aged 19–35 Months — United States, 2017 , 2018, MMWR. Morbidity and mortality weekly report.

[15]  Denise V. D’Angelo,et al.  Influenza and Tdap Vaccination Coverage Among Pregnant Women — United States, April 2018 , 2018, MMWR. Morbidity and mortality weekly report.

[16]  E. Belongia,et al.  Validation of self‐reported influenza vaccination in the current and prior season , 2018, Influenza and other respiratory viruses.

[17]  Denise V. D’Angelo,et al.  Disparities in Preconception Health Indicators — 
Behavioral Risk Factor Surveillance System, 2013–2015, and Pregnancy Risk Assessment Monitoring System, 2013–2014 , 2018, Morbidity and mortality weekly report. Surveillance summaries.

[18]  Ivo M Foppa,et al.  Annual estimates of the burden of seasonal influenza in the United States: A tool for strengthening influenza surveillance and preparedness , 2018, Influenza and other respiratory viruses.

[19]  J. Singleton,et al.  Vaccination Coverage Among Children Aged 19–35 Months — United States, 2016 , 2017, MMWR. Morbidity and mortality weekly report.

[20]  Noele P. Nelson,et al.  Surveillance of Vaccination Coverage among Adult Populations — United States, 2015 , 2017, Morbidity and mortality weekly report. Surveillance summaries.

[21]  V. Dietz,et al.  Vaccination Coverage Among Children Aged 19-35 Months - United States, 2015. , 2016, MMWR. Morbidity and mortality weekly report.

[22]  T. Cheetham,et al.  Influenza Vaccination During Pregnancy: Influenza Seasons 2002-2012, Vaccine Safety Datalink. , 2016, American journal of preventive medicine.

[23]  Noele P. Nelson,et al.  Surveillance of Vaccination Coverage Among Adult Populations - United States, 2014. , 2016, Morbidity and mortality weekly report. Surveillance summaries.

[24]  D. Mak,et al.  Surveillance of antenatal influenza vaccination: validity of current systems and recommendations for improvement , 2015, BMC Public Health.

[25]  M. Loeb,et al.  Pregnancy as a risk factor for severe outcomes from influenza virus infection: A systematic review and meta-analysis of observational studies , 2017, Vaccine.

[26]  S. Jacobsen,et al.  Demographic characteristics of members of the Vaccine Safety Datalink (VSD): A comparison with the United States population. , 2015, Vaccine.

[27]  L. Grohskopf,et al.  Prevention and Control of Seasonal Influenza with Vaccines: Recommendations of the Advisory Committee on Immunization Practices—United States, 2018–19 Influenza Season , 2015, MMWR. Recommendations and reports : Morbidity and mortality weekly report. Recommendations and reports.

[28]  C. Reed,et al.  Estimating Influenza Disease Burden from Population-Based Surveillance Data in the United States , 2015, PloS one.

[29]  Roger Baxter,et al.  The Vaccine Safety Datalink: successes and challenges monitoring vaccine safety. , 2014, Vaccine.

[30]  Chris Moriarity,et al.  Design and estimation for the national health interview survey, 2006-2015. , 2014, Vital and health statistics. Series 2, Data evaluation and methods research.

[31]  M. Durkin,et al.  2009 H1N1 and Seasonal Influenza Immunization Among Pregnant Women: A Comparison of Different Sources of Immunization Information , 2014, Maternal and Child Health Journal.

[32]  C. Bridges,et al.  Surveillance of influenza vaccination coverage--United States, 2007-08 through 2011-12 influenza seasons. , 2013, Morbidity and mortality weekly report. Surveillance summaries.

[33]  A. Crain,et al.  Self-report compared to electronic medical record across eight adult vaccines: do results vary by demographic factors? , 2013, Vaccine.

[34]  T. Cheetham,et al.  Identifying pregnancy episodes, outcomes, and mother-infant pairs in the Vaccine Safety Datalink. , 2013, Vaccine.

[35]  C. Bridges,et al.  Monitoring seasonal influenza vaccination coverage among pregnant women in the United States. , 2012, American journal of obstetrics and gynecology.

[36]  L. Pickering.  Influenza vaccination coverage among pregnant women , 2011, AAP News.

[37]  S. Jacobsen,et al.  Monitoring vaccine safety using the Vaccine Safety Datalink: utilizing immunization registries for pandemic influenza. , 2011, Vaccine.

[38]  Steven J. Jacobsen,et al.  The Vaccine Safety Datalink: A Model for Monitoring Immunization Safety , 2011, Pediatrics.

[39]  S. Greene,et al.  Accuracy of influenza vaccination status in a computer-based immunization tracking system of a managed care organization. , 2010, Vaccine.

[40]  S. Greene,et al.  Accuracy of data on influenza vaccination status at four Vaccine Safety Datalink sites. , 2009, American journal of preventive medicine.

[41]  E. Belongia,et al.  Evaluation of self-reported and registry-based influenza vaccination status in a Wisconsin cohort. , 2009, Vaccine.

[42]  Patricia A. Gabow,et al.  Changes in Insurance Status and Access to Care in an Integrated Safety Net Healthcare System , 2009, Journal of Community Health.

[43]  P. Gabow,et al.  Denver Health: A Model for the Integration of a Public Hospital and Community Health Centers , 2003, Annals of Internal Medicine.

[44]  F. Destefano,et al.  Quality of HMO vaccination databases used to monitor childhood vaccine safety. Vaccine Safety DataLink Team. , 1999, American journal of epidemiology.

[45]  Erin Burns,et al.  Estimates of deaths associated with seasonal influenza --- United States, 1976-2007. , 2010, MMWR. Morbidity and mortality weekly report.