Ambient Particulate Matter and Health Effects: Publication Bias in Studies of Short-Term Associations

Background: Time-series studies have shown short-term temporal associations between low levels of ambient particulate air pollution and adverse health effects. It is not known whether or to what extent this literature is affected by publication bias. Methods: We obtained effect estimates from time-series studies published up to January 2002. These were summarized and examined for funnel plot asymmetry. We compared summary estimates between single-city and prospective multicity studies. Using 1 multicity study, we examined the sensitivity of summary estimates to alternative lag selection policies. Results: We found evidence for publication bias among single-city studies of daily mortality, hospital admissions for chronic obstructive lung disease (COPD), and incidence of cough symptom, but not for studies of lung function. Statistical correction for this bias reduced summary relative risk estimates for a 10 μg/m3 increment of particulate matter less than 10 μm aerodynamic diameter (PM10) as follows: daily mortality from 1.006 to 1.005 and admissions for COPD from 1.013 to 1.011; and odds ratio for cough from 1.025 to 1.015. Analysis of results from a large multicity study suggested that selection of positive estimates from a range of lags could increase summary estimates for PM10 and daily mortality by up to 130% above those based on nondirectional approaches. Conclusion: We conclude that publication bias is present in single-city time-series studies of ambient particles. However, after correcting for publication bias statistically, associations between particles and adverse health effects remained positive and precisely estimated. Differential selection of positive lags may also inflate estimates.

[1]  J. Lawson Comparative Quantification of Health Risks. Global and Regional Burden of Disease Attributable to Selected Major Risk Factors , 2006 .

[2]  Michelle L. Bell,et al.  A Meta-Analysis of Time-Series Studies of Ozone and Mortality With Comparison to the National Morbidity, Mortality, and Air Pollution Study , 2005, Epidemiology.

[3]  M. Mahoney Publication prejudices: An experimental study of confirmatory bias in the peer review system , 1977, Cognitive Therapy and Research.

[4]  Alan D. Lopez,et al.  Comparative quantification of health risks. Global and regional burden of disease attributable to selected major risk factors. Volume 1. , 2004 .

[5]  T STATEMEN,et al.  Revised Analyses of Time-Series Studies of Air Pollution and Health , 2003 .

[6]  M Krzyzanowski,et al.  Quantification of health effects of exposure to air pollution , 2002, Occupational and environmental medicine.

[7]  B. Brunekreef,et al.  Air pollution and health , 2002, The Lancet.

[8]  David M Stieb,et al.  Meta-Analysis of Time-Series Studies of Air Pollution and Mortality: Effects of Gases and Particles and the Influence of Cause of Death, Age, and Season , 2002, Journal of the Air & Waste Management Association.

[9]  J. Sterne,et al.  Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. , 2001, Journal of clinical epidemiology.

[10]  J Schwartz,et al.  Confounding and Effect Modification in the Short-Term Effects of Ambient Particles on Total Mortality: Results from 29 European Cities within the APHEA2 Project , 2001, Epidemiology.

[11]  Jonathan A C Sterne,et al.  Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. , 2001, BMJ.

[12]  J. Sterne,et al.  Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. , 2000, Journal of clinical epidemiology.

[13]  N Künzli,et al.  Public-health impact of outdoor and traffic-related air pollution: a European assessment , 2000, The Lancet.

[14]  David R. Jones,et al.  Empirical assessment of effect of publication bias on meta-analyses , 2000, BMJ : British Medical Journal.

[15]  J. Schwartz,et al.  The National Morbidity, Mortality, and Air Pollution Study. Part II: Morbidity and mortality from air pollution in the United States. , 2000, Research report.

[16]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[17]  J D Spengler,et al.  Estimating the mortality impacts of particulate matter: what can be learned from between-study variability? , 1999, Environmental health perspectives.

[18]  D. Dockery,et al.  Epidemiology of Particle Effects , 1999 .

[19]  B. Brunekreef,et al.  Daily variations in air pollution and respiratory health in a multicentre study: the PEACE project. Pollution Effects on Asthmatic Children in Europe. , 1998, The European respiratory journal.

[20]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[21]  K. Dickersin How important is publication bias? A synthesis of available data. , 1997, AIDS education and prevention : official publication of the International Society for AIDS Education.

[22]  J. Schwartz,et al.  Short term effects of air pollution on health: a European approach using epidemiologic time series data: the APHEA protocol. , 1996, Journal of epidemiology and community health.

[23]  Rebecca Bascom,et al.  Health effects of outdoor air pollution , 1996 .

[24]  Health effects of outdoor air pollution. Committee of the Environmental and Occupational Health Assembly of the American Thoracic Society. , 1996, American journal of respiratory and critical care medicine.

[25]  U. Epa Air Quality Criteria for Particulate Matter , 1996 .

[26]  S. Holgate,et al.  Non-biological Particles and Health , 1995 .

[27]  H. R. Anderson,et al.  Short-term effects of air pollution on health: a European approach using epidemiological time-series data. The APHEA project: background, objectives, design. , 1995, The European respiratory journal.

[28]  Theodor D. Sterling,et al.  Publication decisions revisited: the effect of the outcome of statistical tests on the decision to p , 1995 .

[29]  Joel Schwartz,et al.  REVIEW OF EPIDEMIOLOGICAL EVIDENCE OF HEALTH EFFECTS OF PARTICULATE AIR POLLUTION , 1995 .

[30]  C. Begg,et al.  Operating characteristics of a rank correlation test for publication bias. , 1994, Biometrics.

[31]  Carl Rogers,et al.  AIDS Among Drug Users in Europe: Second Review. Copenhagen: WHO Regional Office For Europe. , 1994, British Journal of Psychiatry.

[32]  M. Tsechkovski,et al.  WHO Regional Office for Europe , 1993, The Lancet.

[33]  C. Begg,et al.  Publication bias and dissemination of clinical research. , 1989, Journal of the National Cancer Institute.

[34]  C. Begg,et al.  Publication bias : a problem in interpreting medical data , 1988 .

[35]  R. Simes Publication bias: the case for an international registry of clinical trials. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[36]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[37]  David B. Pillemer,et al.  Summing Up: The Science of Reviewing Research , 1984 .

[38]  T. Sterling Publication Decisions and their Possible Effects on Inferences Drawn from Tests of Significance—or Vice Versa , 1959 .