Theoretical Basis of the Test-Negative Study Design for Assessment of Influenza Vaccine Effectiveness.

Influenza viruses undergo frequent antigenic changes. As a result, the viruses circulating change within and between seasons, and the composition of the influenza vaccine is updated annually. Thus, estimation of the vaccine's effectiveness is not constant across seasons. In order to provide annual estimates of the influenza vaccine's effectiveness, health departments have increasingly adopted the "test-negative design," using enhanced data from routine surveillance systems. In this design, patients presenting to participating general practitioners with influenza-like illness are swabbed for laboratory testing; those testing positive for influenza virus are defined as cases, and those testing negative form the comparison group. Data on patients' vaccination histories and confounder profiles are also collected. Vaccine effectiveness is estimated from the odds ratio comparing the odds of testing positive for influenza among vaccinated patients and unvaccinated patients, adjusting for confounders. The test-negative design is purported to reduce bias associated with confounding by health-care-seeking behavior and misclassification of cases. In this paper, we use directed acyclic graphs to characterize potential biases in studies of influenza vaccine effectiveness using the test-negative design. We show how studies using this design can avoid or minimize bias and where bias may be introduced with particular study design variations.

[1]  Jennifer C Nelson,et al.  The test-negative design for estimating influenza vaccine effectiveness. , 2013, Vaccine.

[2]  N. Andrews,et al.  Incidence of 2009 pandemic influenza A H1N1 infection in England: a cross-sectional serological study , 2010, The Lancet.

[3]  S Greenland,et al.  Small-sample bias and corrections for conditional maximum-likelihood odds-ratio estimators. , 2000, Biostatistics.

[4]  S. Cole,et al.  Invited Commentary: Causal diagrams and measurement bias. , 2009, American journal of epidemiology.

[5]  Jennifer A. Roberts,et al.  Validation of influenza and pneumococcal vaccine status in adults based on self-report , 2006, Epidemiology and Infection.

[6]  P. Heagerty,et al.  Potential Confounding by Exposure History and Prior Outcomes: An Example From Perinatal Epidemiology , 2007, Epidemiology.

[7]  J. Robins,et al.  Marginal Structural Models and Causal Inference in Epidemiology , 2000, Epidemiology.

[8]  E. Belongia,et al.  Evaluation of self-reported and registry-based influenza vaccination status in a Wisconsin cohort. , 2009, Vaccine.

[9]  Kenneth J Rothman,et al.  Effects of imperfect test sensitivity and specificity on observational studies of influenza vaccine effectiveness. , 2015, Vaccine.

[10]  Benjamin J Cowling,et al.  Potential of the test-negative design for measuring influenza vaccine effectiveness: a systematic review , 2014, Expert review of vaccines.

[11]  Libo Dong,et al.  Cross-reactive antibody responses to the 2009 pandemic H1N1 influenza virus. , 2009, The New England journal of medicine.

[12]  H. Kelly,et al.  Vaccine Effectiveness Against Laboratory-confirmed Influenza in Healthy Young Children: A Case–Control Study , 2011, The Pediatric infectious disease journal.

[13]  A. Frank,et al.  Patterns of shedding of myxoviruses and paramyxoviruses in children. , 1981, The Journal of infectious diseases.

[14]  D. Bernstein,et al.  Live and inactivated influenza vaccines induce similar humoral responses, but only live vaccines induce diverse T-cell responses in young children. , 2011, The Journal of infectious diseases.

[15]  K. Nichol,et al.  Validation of self-report of influenza and pneumococcal vaccination status in elderly outpatients. , 1999, American journal of preventive medicine.

[16]  M. Kenward,et al.  Using causal diagrams to guide analysis in missing data problems , 2012, Statistical methods in medical research.

[17]  S. Greenland,et al.  Simulation study of confounder-selection strategies. , 1993, American journal of epidemiology.

[18]  T. Friedrich,et al.  Impact of Repeated Vaccination on Vaccine Effectiveness Against Influenza A(H3N2) and B During 8 Seasons , 2014, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[19]  J. McVernon,et al.  Virus detection and its association with symptoms during influenza‐like illness in a sample of healthy adults enrolled in a randomised controlled vaccine trial , 2012, Influenza and other respiratory viruses.

[20]  M. Valenciano,et al.  First steps in the design of a system to monitor vaccine effectiveness during seasonal and pandemic influenza in EU/EEA Member States. , 2008, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[21]  M. Landry Diagnostic tests for influenza infection , 2011, Current opinion in pediatrics.

[22]  S Greenland,et al.  Basic methods for sensitivity analysis of biases. , 1996, International journal of epidemiology.

[23]  A S Perelson,et al.  Variable efficacy of repeated annual influenza vaccination. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[24]  J. Bloom,et al.  Estimating the Fitness Advantage Conferred by Permissive Neuraminidase Mutations in Recent Oseltamivir-Resistant A(H1N1)pdm09 Influenza Viruses , 2014, PLoS pathogens.

[25]  S. Cole,et al.  Overadjustment Bias and Unnecessary Adjustment in Epidemiologic Studies , 2009, Epidemiology.

[26]  B. Cowling,et al.  Hand hygiene and risk of influenza virus infections in the community: a systematic review and meta-analysis , 2014, Epidemiology and Infection.

[27]  Michael Haber,et al.  The case test-negative design for studies of the effectiveness of influenza vaccine. , 2013, Vaccine.

[28]  N. Ferguson,et al.  Time lines of infection and disease in human influenza: a review of volunteer challenge studies. , 2008, American journal of epidemiology.

[29]  H. Becher,et al.  The concept of residual confounding in regression models and some applications. , 1992, Statistics in medicine.

[30]  Tao Dong,et al.  Preliminary Assessment of the Efficacy of a T-Cell–Based Influenza Vaccine, MVA-NP+M1, in Humans , 2012, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[31]  M. Valenciano,et al.  Low and decreasing vaccine effectiveness against influenza A(H3) in 2011/12 among vaccination target groups in Europe: results from the I-MOVE multicentre case-control study. , 2013, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[32]  Sander Greenland,et al.  Estimating effects from randomized trials with discontinuations: the need for intent-to-treat design and G-estimation , 2008, Clinical trials.

[33]  C B Hall,et al.  Viral shedding patterns of children with influenza B infection. , 1979, The Journal of infectious diseases.

[34]  M. Hernán,et al.  Causal knowledge as a prerequisite for confounding evaluation: an application to birth defects epidemiology. , 2002, American journal of epidemiology.

[35]  J. Cornfield,et al.  A method of estimating comparative rates from clinical data; applications to cancer of the lung, breast, and cervix. , 1951, Journal of the National Cancer Institute.

[36]  S. Greenland,et al.  3 Epidemiologic Study Designs , 2007 .

[37]  James M. Robins,et al.  Causal Inference from Complex Longitudinal Data , 1997 .

[38]  B. Cowling,et al.  "Crude Vaccine Effectiveness" Is a Misleading Term in Test-negative Studies of Influenza Vaccine Effectiveness. , 2015, Epidemiology.

[39]  Tyler J. VanderWeele,et al.  On the Nondifferential Misclassification of a Binary Confounder , 2012, Epidemiology.

[40]  S Wacholder,et al.  The Case‐Control Study as Data Missing by Design: Estimating Risk Differences , 1996, Epidemiology.

[41]  J. Nelson,et al.  Evidence of bias in estimates of influenza vaccine effectiveness in seniors. , 2006, International journal of epidemiology.

[42]  R. Shaban,et al.  ‘The Australian Immunisation Handbook 8th Edition’. National Health and Medical Research Council, Australian Government. Canberra: Commonwealth of Australia; 2003. 350 pages, ISBN 0-642-82204-2 , 2015 .

[43]  Niels Keiding,et al.  Graphical models for inference under outcome-dependent sampling , 2010, 1101.0901.

[44]  S. Greenland,et al.  How far from non-differential does exposure or disease misclassification have to be to bias measures of association away from the null? , 2008, International journal of epidemiology.

[45]  B. Stricker,et al.  Confounding by indication: an example of variation in the use of epidemiologic terminology. , 1999, American journal of epidemiology.

[46]  Daniel Westreich,et al.  Berkson's bias, selection bias, and missing data. , 2012, Epidemiology.

[47]  Kuender D Yang,et al.  Correlation of Pandemic (H1N1) 2009 Viral Load with Disease Severity and Prolonged Viral Shedding in Children , 2010, Emerging infectious diseases.

[48]  C. Broome,et al.  Pneumococcal Disease after Pneumococcal Vaccination , 1980 .

[49]  A. Flahault,et al.  Intense Co-Circulation of Non-Influenza Respiratory Viruses during the First Wave of Pandemic Influenza pH1N1/2009: A Cohort Study in Reunion Island , 2012, PloS one.

[50]  James M. Robins,et al.  Causal diagrams for epidemiologic research. , 1999 .

[51]  H. Kelly,et al.  Stratified estimates of influenza vaccine effectiveness by prior vaccination: caution required. , 2013, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[52]  F. Greaves,et al.  Influenza Vaccination for Immunocompromised Patients: Systematic Review and Meta-Analysis from a Public Health Policy Perspective , 2011, PloS one.

[53]  J K McLaughlin,et al.  Selection of controls in case-control studies. I. Principles. , 1992, American journal of epidemiology.

[54]  Evan W. Orenstein,et al.  Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness. , 2007, International journal of epidemiology.

[55]  G. Dowse,et al.  Influenza vaccine effectiveness estimates for Western Australia during a period of vaccine and virus strain stability, 2010 to 2012. , 2014, Vaccine.

[56]  S. Greenland,et al.  Risk factors, confounding, and the illusion of statistical control. , 2004, Psychosomatic medicine.

[57]  D. Skowronski,et al.  The test-negative design: validity, accuracy and precision of vaccine efficacy estimates compared to the gold standard of randomised placebo-controlled clinical trials. , 2013, Euro surveillance : bulletin Europeen sur les maladies transmissibles = European communicable disease bulletin.

[58]  D. Lewis,et al.  Cellular Immune Responses in Children and Adults Receiving Inactivated or Live Attenuated Influenza Vaccines , 2006, Journal of Virology.

[59]  Tyler J. VanderWeele,et al.  On the definition of a confounder , 2013, Annals of statistics.

[60]  Keiji Fukuda,et al.  Epidemiological, antigenic and genetic characteristics of seasonal influenza A(H1N1), A(H3N2) and B influenza viruses: basis for the WHO recommendation on the composition of influenza vaccines for use in the 2009-2010 northern hemisphere season. , 2010, Vaccine.

[61]  H. Kelly,et al.  Laboratory diagnosis and surveillance of human respiratory viruses by PCR in Victoria, Australia, 2002–2003 , 2004, Journal of medical virology.

[62]  J. McElhaney,et al.  Immunosenescence: Influenza vaccination and the elderly. , 2014, Current opinion in immunology.

[63]  B. Cowling,et al.  Influenza vaccine effectiveness in the community and the household. , 2013, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.