Meta-analysis: weighing the evidence.

Use of meta-analytical (quantitative overview) techniques is now commonplace in a wide range of medical research contexts, with a rapid rise in its frequency of use being particularly apparent in the last decade. The history of meta-analyses in other fields, particularly psychology and educational research, is longer. Many methods have been proposed and used, from crude 'vote counting' of studies showing significant or non-significant results, through methods for combination of effect size estimates based on fixed or random effects models, to general linear mixed models and Bayesian methods. The history of meta-analysis and the advantages and disadvantages of various approaches to it are briefly reviewed in this paper, with reference to pharmaceutical product licence applications, other reviews of clinical trials and epidemiological studies, and health services research.

[1]  Commentary on pooling the results of clinical trials , 1987 .

[2]  S Greenland,et al.  Bias in the one-step method for pooling study results. , 1990, Statistics in medicine.

[3]  S. Raudenbush,et al.  Empirical Bayes Meta-Analysis , 1985 .

[4]  J. Neilson,et al.  Oxford Database of Perinatal Trials , 1991 .

[5]  C. Furberg,et al.  Lessons from overviews of cardiovascular trials. , 1987, Statistics in medicine.

[6]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[7]  K. Phillips The use of meta-analysis in technology assessment: a meta-analysis of the enzyme immunosorbent assay human immunodeficiency virus antibody test. , 1991, Journal of clinical epidemiology.

[8]  N E Breslow,et al.  Power considerations in epidemiologic studies of vinyl chloride workers. , 1981, American journal of epidemiology.

[9]  A. M. Walker,et al.  Odd man out: a graphical approach to meta-analysis. , 1988, American journal of public health.

[10]  C. M. Parkes,et al.  Broken Heart: A Statistical Study of Increased Mortality among Widowers , 1969, British medical journal.

[11]  W. Spitzer Meta-meta-analysis: unanswered questions about aggregating data. , 1991, Journal of clinical epidemiology.

[12]  J. Fleiss Review papers : The statistical basis of meta-analysis , 1993 .

[13]  M. Jenicek,et al.  Meta-analysis in medicine. Where we are and where we want to go. , 1989, Journal of clinical epidemiology.

[14]  W. G. Cochran Problems arising in the analysis of a series of similar experiments , 1937 .

[15]  R. Simes Publication bias: the case for an international registry of clinical trials. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[16]  C. Meinert Meta-analysis: science or religion? , 1989, Controlled clinical trials.

[17]  G H Guyatt,et al.  Agreement among reviewers of review articles. , 1991, Journal of clinical epidemiology.

[18]  A Whitehead,et al.  A general parametric approach to the meta-analysis of randomized clinical trials. , 1991, Statistics in medicine.

[19]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[20]  P. Sheehe,et al.  Combination of log relative risk in retrospective studies of disease. , 1966, American journal of public health and the nation's health.

[21]  F. Wolf Problem‐based learning and meta‐analysis: can we see the forest through the trees? , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[22]  A. Dyer A method for combining results from several prospective epidemiologic studies. , 1986, Statistics in medicine.

[23]  S. Pocock,et al.  Estimation issues in clinical trials and overviews. , 1990, Statistics in medicine.

[24]  S Greenland,et al.  Meta‐analysis of Epidemiologic Dose‐Response Data , 1993, Epidemiology.

[25]  R. Peto,et al.  Beta blockade during and after myocardial infarction: an overview of the randomized trials. , 1985, Progress in cardiovascular diseases.

[26]  R Peto,et al.  Effect of intravenous streptokinase on acute myocardial infarction: pooled results from randomized trials. , 1982, The New England journal of medicine.

[27]  M. Parmar,et al.  Meta-analysis of the literature or of individual patient data: is there a difference? , 1993, The Lancet.

[28]  D L Demets,et al.  Methods for combining randomized clinical trials: strengths and limitations. , 1987, Statistics in medicine.

[29]  D. Ketley,et al.  Impact of clinical trials on clinical practice: example of thrombolysis for acute myocardial infarction , 1993, The Lancet.

[30]  M. Szklo,et al.  Mortality after bereavement. , 1981, American journal of epidemiology.

[31]  T. Chalmers,et al.  Meta-analyses of randomized controlled trials. , 1987, The New England journal of medicine.

[32]  R. Gelber,et al.  Interpretation of results from subset analyses within overviews of randomized clinical trials. , 1987, Statistics in medicine.

[33]  G. Lamas,et al.  Do the results of randomized clinical trials of cardiovascular drugs influence medical practice? The SAVE Investigators. , 1992, The New England journal of medicine.

[34]  S G Thompson,et al.  Controversies in meta-analysis: the case of the trials of serum cholesterol reduction , 1993, Statistical methods in medical research.

[35]  I. Holme Relation of coronary heart disease incidence and total mortality to plasma cholesterol reduction in randomised trials: use of meta-analysis. , 1993, British heart journal.

[36]  W. Rees,et al.  Mortality of bereavement. , 1967, British medical journal.

[37]  R Peto,et al.  Why do we need systematic overviews of randomized trials? , 1987, Statistics in medicine.

[38]  I Chalmers,et al.  Underreporting research is scientific misconduct. , 1990, JAMA.

[39]  J. Carlin Meta-analysis for 2 x 2 tables: a Bayesian approach. , 1992, Statistics in medicine.

[40]  M J Lichtenstein,et al.  Guidelines for reading case-control studies. , 1987, Journal of chronic diseases.

[41]  David R. Jones Improving Statistics in License Applications: Handle with Sensitivity? , 1993 .

[42]  M. Gardner,et al.  Confidence intervals rather than P values: estimation rather than hypothesis testing. , 1986, British medical journal.

[43]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[44]  Lesley Rushton,et al.  Oral contraceptive use and breast cancer risk: a meta‐analysis of variations with age at diagnosis, parity and total duration of oral contraceptive use , 1992 .

[45]  W. Haenszel,et al.  Statistical aspects of the analysis of data from retrospective studies of disease. , 1959, Journal of the National Cancer Institute.

[46]  C. Begg,et al.  Publication bias : a problem in interpreting medical data , 1988 .

[47]  S Greenland,et al.  Quantitative methods in the review of epidemiologic literature. , 1987, Epidemiologic reviews.

[48]  D. Sackett Bias in analytic research. , 1979, Journal of chronic diseases.

[49]  R F Galbraith,et al.  A note on graphical presentation of estimated odds ratios from several clinical trials. , 1988, Statistics in medicine.

[50]  W. G. Cochran The combination of estimates from different experiments. , 1954 .

[51]  K. Dickersin,et al.  Meta-analysis: state-of-the-science. , 1992, Epidemiologic reviews.

[52]  D. Yach,et al.  Meta-analysis in epidemiology. , 1990, South African medical journal = Suid-Afrikaanse tydskrif vir geneeskunde.

[53]  G. Guyatt,et al.  Determining optimal therapy--randomized trials in individual patients. , 1986, The New England journal of medicine.

[54]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[55]  F. Song,et al.  Cholesterol lowering and mortality: the importance of considering initial level of risk. , 1993, BMJ.

[56]  T C Chalmers,et al.  Cumulative meta-analysis of therapeutic trials for myocardial infarction. , 1992, The New England journal of medicine.

[57]  D. Jones Heart disease mortality following widowhood: some results from the OPCS Longitudinal Study. Office of Population Censuses and Surveys. , 1987, Journal of psychosomatic research.

[58]  T A Louis,et al.  Findings for public health from meta-analyses. , 1985, Annual review of public health.

[59]  M J Langman,et al.  Towards estimation and confidence intervals. , 1986, British medical journal.

[60]  T C Chalmers,et al.  Problems induced by meta-analyses. , 1991, Statistics in medicine.

[61]  T C Chalmers,et al.  A comparison of statistical methods for combining event rates from clinical trials. , 1989, Statistics in medicine.

[62]  J. Fleiss,et al.  Meta-analysis in epidemiology, with special reference to studies of the association between exposure to environmental tobacco smoke and lung cancer: a critique. , 1991, Journal of clinical epidemiology.

[63]  D. Mellström,et al.  Mortality among the Widowed in Sweden , 1982, Scandinavian journal of social medicine.

[64]  G G Koch,et al.  An overview of statistical issues and methods of meta-analysis. , 1991, Journal of biopharmaceutical statistics.