Methods for Exploring Heterogeneity in Meta-Analysis

In meta-analysis, when the difference in results between studies is greater than would be expected by chance, one needs to investigate whether the observed variation in results across studies is associated with clinical and/or methodological differences between studies. This article reviews methods used in meta-analysis for exploring heterogeneity, including statistical tests for homogeneity, methods for visually displaying results of primary studies, methods for reducing heterogeneity, methods for investigating sources of heterogeneity, and identification of moderator variables or effect modifiers. The investigation of sources of heterogeneity in meta-analysis is by nature exploratory, and therefore its results should always be interpreted with caution. However, careful investigation of heterogeneity may provide an important second level of evidence that can be useful in suggesting direction of future research. Sometimes, it may provide clinically important results by indicating who might benefit more or less from a treatment or how an intervention should be applied.

[1]  Á. Atallah,et al.  Calcium supplementation during pregnancy for preventing hypertensive disorders and related problems. , 2002, The Cochrane database of systematic reviews.

[2]  Alex J. Sutton,et al.  Methods for Meta-Analysis in Medical Research , 2000 .

[3]  Alex J. Sutton,et al.  Publication and related biases: a review , 2000 .

[4]  I Olkin,et al.  Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses. , 2000, Statistics in medicine.

[5]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[6]  J. L. Tang,et al.  Misleading funnel plot for detection of bias in meta-analysis. , 2000, Journal of clinical epidemiology.

[7]  M. Limburg,et al.  Calcium antagonists for acute ischemic stroke. , 2000, The Cochrane database of systematic reviews.

[8]  A J Sutton,et al.  Publication and related biases. , 2000, Health technology assessment.

[9]  T. Sheldon,et al.  Relation between hostility and coronary heart disease , 1999, British medical journal.

[10]  I Olkin,et al.  Diagnostic statistical procedures in medical meta-analyses. , 1999, Statistics in medicine.

[11]  D. Moher,et al.  The effectiveness of glucocorticoids in treating croup: meta-analysis , 1999, The Western journal of medicine.

[12]  S Greenland,et al.  Random-effects meta-analyses are not always conservative. , 1999, American journal of epidemiology.

[13]  R. Dersimonian,et al.  Resolving discrepancies between a meta-analysis and a subsequent large controlled trial. , 1999, JAMA.

[14]  F Song,et al.  Exploring heterogeneity in meta-analysis: is the L'Abbé plot useful? , 1999, Journal of clinical epidemiology.

[15]  D. Spiegelman,et al.  Evaluation of old and new tests of heterogeneity in epidemiologic meta-analysis. , 1999, American journal of epidemiology.

[16]  E. Ernst,et al.  Artemether for severe malaria: a meta-analysis of randomized clinical trials. , 1999, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[17]  H. V. van Houwelingen,et al.  Investigating underlying risk as a source of heterogeneity in meta-analysis. , 1999, Statistics in medicine.

[18]  Christopher H. Schmid,et al.  Exploring Heterogeneity in Randomized Trials Via Meta-Analysis , 1999 .

[19]  C H Schmid,et al.  An empirical study of the effect of the control rate as a predictor of treatment efficacy in meta-analysis of clinical trials. , 1998, Statistics in medicine.

[20]  L. Stewart,et al.  Individual patient data meta-analysis in cancer. , 1998, British Journal of Cancer.

[21]  S. Thompson,et al.  Detecting and describing heterogeneity in meta-analysis. , 1998, Statistics in medicine.

[22]  Christopher H Schmid,et al.  Summing up evidence: one answer is not always enough , 1998, The Lancet.

[23]  S D Walter,et al.  Variation in baseline risk as an explanation of heterogeneity in meta-analysis. , 1997, Statistics in medicine.

[24]  S G Thompson,et al.  Investigating underlying risk as a source of heterogeneity in meta-analysis. , 1997, Statistics in medicine.

[25]  George Davey Smith,et al.  Meta-analysis: Beyond the grand mean? , 1997, BMJ.

[26]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[27]  G. Grégoire,et al.  Discrepancies between meta-analyses and subsequent large randomized, controlled trials. , 1997, The New England journal of medicine.

[28]  J. Bailar The promise and problems of meta-analysis. , 1997, The New England journal of medicine.

[29]  Cindy Farquhar,et al.  3 The Cochrane Library , 1996 .

[30]  C H Schmid,et al.  Large trials vs meta-analysis of smaller trials : How do their results compare ? , 1996 .

[31]  Douglas G Altman,et al.  The relation between treatment benefit and underlying risk in meta-analysis , 1996, BMJ.

[32]  M. McIntosh,et al.  The population risk as an explanatory variable in research synthesis of clinical trials. , 1996, Statistics in medicine.

[33]  J. Slattery,et al.  A systematic review of the risks of stroke and death due to endarterectomy for symptomatic carotid stenosis. , 1996, Stroke.

[34]  J. Zalcberg,et al.  The role of 5-fluorouracil dose in the adjuvant therapy of colorectal cancer. , 1996, Annals of oncology : official journal of the European Society for Medical Oncology.

[35]  J. Villar,et al.  Predictive ability of meta-analyses of randomised controlled trials , 1995, The Lancet.

[36]  C S Berkey,et al.  A random-effects regression model for meta-analysis. , 1995, Statistics in medicine.

[37]  C H Schmid,et al.  Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. , 1995, Journal of clinical epidemiology.

[38]  C Anello,et al.  Exploratory or analytic meta-analysis: should we distinguish between them? , 1995, Journal of clinical epidemiology.

[39]  C. Begg,et al.  Operating characteristics of a rank correlation test for publication bias. , 1994, Biometrics.

[40]  S G Thompson,et al.  Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated , 1994, BMJ.

[41]  S Greenland,et al.  Invited commentary: a critical look at some popular meta-analytic methods. , 1994, American journal of epidemiology.

[42]  C S Berkey,et al.  Efficacy of BCG vaccine in the prevention of tuberculosis. Meta-analysis of the published literature. , 1994, JAMA.

[43]  U. Helfenstein,et al.  Fluoride varnishes (Duraphat): a meta-analysis. , 1994, Community dentistry and oral epidemiology.

[44]  E. Antman,et al.  Advantages and limitations of metaanalytic regressions of clinical trials data. , 1992, The Online journal of current clinical trials.

[45]  S. Senn,et al.  IMPORTANCE OF TRENDS IN THE INTERPRETATION OF AN OVERALL ODDS RATIO IN THEMETA-ANALYSIS OF CLINICAL TRIALS. AUTHOR'S REPLY , 1994 .

[46]  S Senn,et al.  Importance of trends in the interpretation of an overall odds ratio in the meta-analysis of clinical trials. , 1994, Statistics in medicine.

[47]  F. Song,et al.  Cholesterol lowering and mortality: the importance of considering initial level of risk. , 1993, BMJ.

[48]  J P Pignon,et al.  A meta-analysis of thoracic radiotherapy for small-cell lung cancer. , 1992, The New England journal of medicine.

[49]  P. Gøtzsche,et al.  Meta-analysis of second-line antirheumatic drugs: sample size bias and uncertain benefit. , 1992, Journal of clinical epidemiology.

[50]  H Kragt,et al.  Importance of trends in the interpretation of an overall odds ratio in the meta-analysis of clinical trials. , 1992, Statistics in medicine.

[51]  S G Thompson,et al.  The potential and limitations of meta-analysis. , 1991, Journal of epidemiology and community health.

[52]  T C Chalmers,et al.  A comparison of statistical methods for combining event rates from clinical trials. , 1989, Statistics in medicine.

[53]  R F Galbraith,et al.  A note on graphical presentation of estimated odds ratios from several clinical trials. , 1988, Statistics in medicine.

[54]  K A L'Abbé,et al.  Meta-analysis in clinical research. , 1987, Annals of internal medicine.

[55]  R. Light,et al.  Accumulating evidence from independent studies: what we can win and what we can lose. , 1987, Statistics in medicine.

[56]  K. Bailey,et al.  Inter-study differences: how should they influence the interpretation and analysis of results? , 1987, Statistics in medicine.

[57]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[58]  H. Morgenstern Uses of ecologic analysis in epidemiologic research. , 1982, American journal of public health.

[59]  N. Breslow,et al.  Statistical methods in cancer research: volume 1- The analysis of case-control studies , 1980 .