The need for validation of statistical methods for estimating respiratory virus-attributable hospitalization.

Public policy regarding influenza has been based largely on the burden of hospitalization estimated through ecologic studies applying increasingly sophisticated statistical methods to administrative databases. None are known to have been validated by observational studies. The authors illustrated how 6 commonly applied statistical methods estimate virus-attributable hospitalization of children 6-23 months of age and compared the estimates with results obtained from a prospective study using virologic assessment. The proportions of pneumonia and influenza and of bronchiolitis hospitalizations attributable to respiratory syncytial virus and/or influenza were derived by using Serfling regression, periseason differences, Poisson regression with log link, negative binomial regression with identity link, and a Box-Jenkins transfer function. No method provided accurate or consistent estimates for both viruses and outcomes. Virus-attributable hospitalization estimates varied widely between statistical methods and between seasons, with greater between-season variation for admissions attributed to influenza compared with respiratory syncytial virus. Sophistication of statistical methods may have been interpreted as assurance that results are more accurate. Without validation against epidemiologic data, with viral etiology confirmed in individual patients, the accuracy of statistical methods in ecologic studies is simply not known. Until these methods are validated, their methodological limitations should be made explicit and proxy estimates used cautiously in guiding public policy.

[1]  L. Simonsen,et al.  The impact of influenza epidemics on mortality: introducing a severity index. , 1997, American journal of public health.

[2]  Joel Schwartz,et al.  Transitional Regression Models, with Application to Environmental Time Series , 2000 .

[3]  Keiji Fukuda,et al.  Mortality associated with influenza and respiratory syncytial virus in the United States. , 2003, JAMA.

[4]  P. Quénel,et al.  Sensitivity, specificity and predictive values of health service based indicators for the surveillance of influenza A epidemics. , 1994, International journal of epidemiology.

[5]  P. Ko Modelling the unidentified mortality burden from thirteen infectious pathogenic microorganisms in infants , 2007 .

[6]  J. Bresee,et al.  Substantial variability in community respiratory syncytial virus season timing , 2003, The Pediatric infectious disease journal.

[7]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[8]  R. Serfling Methods for current statistical analysis of excess pneumonia-influenza deaths. , 1963, Public health reports.

[9]  Cecile Viboud,et al.  Impact of influenza vaccination on seasonal mortality in the US elderly population. , 2005, Archives of internal medicine.

[10]  P. Orr An Advisory Committee Statement (ACS). National Advisory Committee on Immunization (NACI). Statement on influenza vaccination for the 2004-2005 season. , 2004, Canada communicable disease report = Releve des maladies transmissibles au Canada.

[11]  U Helfenstein,et al.  The use of transfer function models, intervention analysis and related time series methods in epidemiology. , 1991, International journal of epidemiology.

[12]  A. Tobías,et al.  Use of Poisson regression and Box–Jenkins models to evaluate the short-term effects of environmental noise levels on daily emergency admissions in Madrid, Spain , 2004, European Journal of Epidemiology.

[13]  National Advisory Committee on Immunization (NACI). , 1990, Canada diseases weekly report = Rapport hebdomadaire des maladies au Canada.

[14]  D. Schanzer,et al.  Hospitalization Attributable to Influenza and Other Viral Respiratory Illnesses in Canadian Children , 2006, The Pediatric infectious disease journal.

[15]  D M Fleming,et al.  Respiratory illness associated with influenza and respiratory syncytial virus infection , 2005, Archives of Disease in Childhood.

[16]  K. Nicholson Impact of influenza and respiratory syncytial virus on mortality in England and Wales from January 1975 to December 1990 , 1996, Epidemiology and Infection.

[17]  David A. Dickey,et al.  SAS® for Forecasting Time Series , 2004 .

[18]  A. Tobías,et al.  Impact of urban air pollutants and noise levels over daily hospital admissions in children in Madrid: a time series analysis , 2006, International archives of occupational and environmental health.

[19]  Jim Koopman,et al.  Modeling infection transmission. , 2004, Annual review of public health.

[20]  Muhammad M Mamdani,et al.  Community influenza outbreaks and emergency department ambulance diversion. , 2004, Annals of emergency medicine.

[21]  S. Hajat,et al.  The association of respiratory syncytial virus infection and influenza with emergency admissions for respiratory disease in London: an analysis of routine surveillance data. , 2006, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[22]  Joel Schwartz,et al.  Analysis of health outcome time series data in epidemiological studies , 2004 .

[23]  R. Davis,et al.  Influenza and the rates of hospitalization for respiratory disease among infants and young children. , 2000, The New England journal of medicine.

[24]  U Helfenstein,et al.  Box-Jenkins modelling of some viral infectious diseases. , 1986, Statistics in medicine.

[25]  C. Bridges,et al.  Prevention and control of influenza : recommendations of the Advisory Committee on Immunization Practices (ACIP) , 2004 .

[26]  Médecine Santé-Voyage An Advisory Committee Statement (ACS) , 2009 .

[27]  U Helfenstein,et al.  Box-Jenkins modelling in medical research , 1996, Statistical methods in medical research.

[28]  M. Bergeron,et al.  Distribution and clinical impact of human respiratory syncytial virus genotypes in hospitalized children over 2 winter seasons. , 2006, The Journal of infectious diseases.

[29]  V. Goel,et al.  Time-series analysis of the relation between influenza virus and hospital admissions of the elderly in Ontario, Canada, for pneumonia, chronic lung disease, and congestive heart failure. , 1999, American journal of epidemiology.

[30]  M. Bergeron,et al.  Human Metapneumovirus Infections in Hospitalized Children , 2003, Emerging infectious diseases.

[31]  George E. P. Box,et al.  Time Series Analysis: Box/Time Series Analysis , 2008 .

[32]  Alan Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[33]  E F Mitchel,et al.  The effect of influenza on hospitalizations, outpatient visits, and courses of antibiotics in children. , 2000, The New England journal of medicine.