Exploring heterogeneity in meta-analyses: needs, resources and challenges.

The investigation of heterogeneity remains an essential but difficult issue in the conduct of meta-analysis. We reviewed standard and graphical methods used to explore heterogeneity in meta-analysis and publications from January 2005 to April 2007 regarding meta-analyses that focused on perinatal health topics. We assessed their approaches to the investigation of heterogeneity, including: (1) whether statistical testing for heterogeneity was performed and, if so, which test was used, (2) how a finding of statistically significant heterogeneity was handled, and (3) how the analyses were conducted in the presence of heterogeneity.

[1]  J. Slattery,et al.  The miracle of DICE therapy for acute stroke: fact or fictional product of subgroup analysis? , 1994, BMJ.

[2]  J. Gaughan,et al.  Diagnostic accuracy of noninvasive fetal Rh genotyping from maternal blood--a meta-analysis. , 2006, American journal of obstetrics and gynecology.

[3]  H. Johnson,et al.  A comparison of 'traditional' and multimedia information systems development practices , 2003, Inf. Softw. Technol..

[4]  Gerald Gartlehner,et al.  Perinatal Depression: A Systematic Review of Prevalence and Incidence , 2005, Obstetrics and gynecology.

[5]  A. Logan,et al.  Statistical Issues in a Metaregression Analysis of Randomized Trials: Impact on the Dietary Sodium Intake and Blood Pressure Relationship , 1999, Biometrics.

[6]  A. Kaunitz,et al.  Progestational Agents to Prevent Preterm Birth: A Meta-Analysis of Randomized Controlled Trials , 2005, Obstetrics and gynecology.

[7]  A Donner,et al.  Meta‐analyses in systematic reviews of randomized controlled trials in perinatal medicine: comparison of fixed and random effects models , 2001, Statistics in medicine.

[8]  P. Mahadevan,et al.  An overview , 2007, Journal of Biosciences.

[9]  B. Peterlin,et al.  Genetic polymorphisms in vasoactive genes and preeclampsia: a meta-analysis. , 2007, European journal of obstetrics, gynecology, and reproductive biology.

[10]  J. Ioannidis,et al.  Expectant, Medical, or Surgical Management of First-Trimester Miscarriage: A Meta-Analysis , 2005, Obstetrics and gynecology.

[11]  R J Cook,et al.  A logistic model for trend in 2 x 2 x kappa tables with applications to meta-analyses. , 1997, Biometrics.

[12]  E. Hutton,et al.  Late vs early clamping of the umbilical cord in full-term neonates: systematic review and meta-analysis of controlled trials. , 2007, JAMA.

[13]  Julian P T Higgins,et al.  Controlling the risk of spurious findings from meta‐regression , 2004, Statistics in medicine.

[14]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[15]  Douglas G. Altman,et al.  Systematic Reviews in Health Care: Meta-Analysis in Context: Second Edition , 2008 .

[16]  S G Thompson,et al.  A likelihood approach to meta-analysis with random effects. , 1996, Statistics in medicine.

[17]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[18]  J. Dodd,et al.  Misoprostol versus cervagem for the induction of labour to terminate pregnancy in the second and third trimester: a systematic review. , 2006, European journal of obstetrics, gynecology, and reproductive biology.

[19]  J. Fleiss,et al.  Analysis of data from multiclinic trials. , 1986, Controlled clinical trials.

[20]  R. Gelber,et al.  Interpretation of results from subset analyses within overviews of randomized clinical trials. , 1987, Statistics in medicine.

[21]  R Peto,et al.  Why do we need systematic overviews of randomized trials? , 1987, Statistics in medicine.

[22]  Dan Jackson,et al.  The power of the standard test for the presence of heterogeneity in meta‐analysis , 2006, Statistics in medicine.

[23]  Christopher H. Schmid,et al.  Exploring Heterogeneity in Randomized Trials Via Meta-Analysis , 1999 .

[24]  S G Thompson,et al.  Analysing the relationship between treatment effect and underlying risk in meta-analysis: comparison and development of approaches. , 2000, Statistics in medicine.

[25]  B. Butler,et al.  Systematic review: Misoprostol compared with prostaglandin E2 for labour induction in women at term with intact membranes and unfavourable cervix: a systematic review * , 2006, BJOG : an international journal of obstetrics and gynaecology.

[26]  G. Smith,et al.  Commentary: Statistical problems , 1994 .

[27]  J. Ioannidis,et al.  Bayesian meta‐analysis and meta‐regression for gene–disease associations and deviations from Hardy–Weinberg equilibrium , 2007, Statistics in medicine.

[28]  M. Hannah,et al.  Progesterone for the prevention of preterm birth among women at increased risk: a systematic review and meta-analysis of randomized controlled trials. , 2006, American journal of obstetrics and gynecology.

[29]  C. R. Breitkopf,et al.  Correlates of anxiety symptoms during pregnancy and association with perinatal outcomes: a meta-analysis. , 2006, American journal of obstetrics and gynecology.

[30]  S G Thompson,et al.  Investigating underlying risk as a source of heterogeneity in meta-analysis. , 1997, Statistics in medicine.

[31]  M. Rodger,et al.  A systematic review of the association between factor V Leiden or prothrombin gene variant and intrauterine growth restriction. , 2005, American journal of obstetrics and gynecology.

[32]  P. August,et al.  Genetic Thrombophilias and Preeclampsia: A Meta-Analysis , 2005, Obstetrics and gynecology.

[33]  G H Guyatt,et al.  A Consumer's Guide to Subgroup Analyses , 1992, Annals of Internal Medicine.

[34]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[35]  T Stijnen,et al.  Baseline risk as predictor of treatment benefit: three clinical meta-re-analyses. , 2000, Statistics in medicine.

[36]  Á. Atallah,et al.  Calcium supplementation during pregnancy for preventing hypertensive disorders and related problems. , 2002, The Cochrane database of systematic reviews.

[37]  J. Beyene,et al.  Perinatal outcomes of in vitro fertilization twins: a systematic review and meta-analyses. , 2005, American journal of obstetrics and gynecology.

[38]  N. Okun,et al.  Antibiotics for Bacterial Vaginosis or Trichomonas vaginalis in Pregnancy: A Systematic Review , 2005, Obstetrics and gynecology.

[39]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[40]  J. Kleijnen,et al.  The accuracy of maternal anthropometry measurements as predictor for spontaneous preterm birth--a systematic review. , 2005, European journal of obstetrics, gynecology, and reproductive biology.

[41]  S. Sharp,et al.  Explaining heterogeneity in meta-analysis: a comparison of methods. , 1999 .

[42]  S G Thompson,et al.  The potential and limitations of meta-analysis. , 1991, Journal of epidemiology and community health.

[43]  L. Hedges,et al.  Fitting Parametric Fixed Effect Models to Effect Sizes: Categorical Models , 1985 .

[44]  André Rogatko,et al.  Bayesian approach for meta - analysis of controlled clinical trials , 1992 .

[45]  K. Bailey,et al.  Inter-study differences: how should they influence the interpretation and analysis of results? , 1987, Statistics in medicine.

[46]  Stephen J. Sharp,et al.  Meta-analysis regression , 1998 .

[47]  T C Chalmers,et al.  A comparison of statistical methods for combining event rates from clinical trials. , 1989, Statistics in medicine.

[48]  E. Antman,et al.  Advantages and limitations of metaanalytic regressions of clinical trials data. , 1992, The Online journal of current clinical trials.

[49]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[50]  D. Altman,et al.  Statistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice , 2002, Journal of health services research & policy.

[51]  S. Thompson,et al.  How should meta‐regression analyses be undertaken and interpreted? , 2002, Statistics in medicine.

[52]  C. Roberts,et al.  A meta‐analysis of upright positions in the second stage to reduce instrumental deliveries in women with epidural analgesia , 2005, Acta obstetricia et gynecologica Scandinavica.

[53]  D J Spiegelhalter,et al.  Bayesian approaches to random-effects meta-analysis: a comparative study. , 1995, Statistics in medicine.

[54]  S Senn,et al.  Importance of trends in the interpretation of an overall odds ratio in the meta-analysis of clinical trials. , 1994, Statistics in medicine.

[55]  R. Rosenthal.  Parametric measures of effect size. , 1994 .

[56]  D O Stram,et al.  Meta-analysis of published data using a linear mixed-effects model. , 1996, Biometrics.

[57]  R F Galbraith,et al.  A note on graphical presentation of estimated odds ratios from several clinical trials. , 1988, Statistics in medicine.

[58]  W. G. Cochran.  The combination of estimates from different experiments. , 1954 .

[59]  V. Berghella,et al.  Cerclage for Short Cervix on Ultrasonography: Meta-Analysis of Trials Using Individual Patient-Level Data , 2005, Obstetrics and gynecology.

[60]  N. Breslow,et al.  The analysis of case-control studies , 1980 .

[61]  C B Begg,et al.  A model for incorporating historical controls into a meta-analysis. , 1991, Biometrics.

[62]  L. Hartling,et al.  Heat Loss Prevention: A Systematic Review of Occlusive Skin Wrap for Premature Neonates , 2005, Journal of Perinatology.

[63]  G. ter Riet,et al.  Accuracy of serum uric acid determination in predicting pre‐eclampsia: A systematic review , 2006, Acta obstetricia et gynecologica Scandinavica.

[64]  S Greenland,et al.  Quantitative methods in the review of epidemiologic literature. , 1987, Epidemiologic reviews.

[65]  G A Colditz,et al.  Heterogeneity in meta-analysis of data from epidemiologic studies: a commentary. , 1995, American journal of epidemiology.

[66]  M. McIntosh,et al.  The population risk as an explanatory variable in research synthesis of clinical trials. , 1996, Statistics in medicine.

[67]  C. Dennis.  Psychosocial and psychological interventions for prevention of postnatal depression: systematic review , 2005, BMJ : British Medical Journal.

[68]  Douglas G Altman,et al.  The relation between treatment benefit and underlying risk in meta-analysis , 1996, BMJ.

[69]  J. Brok,et al.  Effect of hepatitis B immunisation in newborn infants of mothers positive for hepatitis B surface antigen: systematic review and meta-analysis , 2006, BMJ : British Medical Journal.

[70]  M. McDonagh,et al.  The benefits and risks of inducing labour in patients with prior caesarean delivery: a systematic review , 2005, BJOG : an international journal of obstetrics and gynaecology.

[71]  C S Berkey,et al.  A random-effects regression model for meta-analysis. , 1995, Statistics in medicine.

[72]  Marvin Zelen,et al.  The analysis of several 2× 2 contingency tables , 1971 .

[73]  A. Barratt,et al.  Systematic review of adverse outcomes of external cephalic version and persisting breech presentation at term. , 2006, Paediatric and perinatal epidemiology.

[74]  M. Lin,et al.  Misoprostol for Labor Induction in Women With Term Premature Rupture of Membranes: A Meta-Analysis , 2005, Obstetrics and gynecology.

[75]  Kerrie Mengersen,et al.  THE IMPACT OF METHOD CHOICE ON META‐ANALYSIS , 1995 .

[76]  S. Pocock,et al.  Can meta-analyses be trusted? , 1991, The Lancet.

[77]  Alex J. Sutton,et al.  Meta‒Analysis Software , 2008 .

[78]  C H Schmid.  Using Bayesian Inference to Perform Meta-Analysis , 2001, Evaluation & the health professions.

[79]  B. Hutton,et al.  Use of intravenous immunoglobulin for treatment of recurrent miscarriage: a systematic review , 2007, BJOG : an international journal of obstetrics and gynaecology.

[80]  F Song,et al.  Exploring heterogeneity in meta-analysis: is the L'Abbé plot useful? , 1999, Journal of clinical epidemiology.

[81]  A. Conde-Agudelo,et al.  Birth spacing and risk of adverse perinatal outcomes: a meta-analysis. , 2006, JAMA.

[82]  N. Kaciroti,et al.  Selective Serotonin Reuptake Inhibitor (SSRI) Use during Pregnancy and Effects on the Fetus and Newborn: A Meta-Analysis , 2005, Journal of Perinatology.

[83]  Q E Whiting-O'Keefe,et al.  Controlled clinical trials. , 1983, The American journal of medicine.

[84]  S G Thompson,et al.  Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated , 1994, BMJ.

[85]  S. Thompson,et al.  Detecting and describing heterogeneity in meta-analysis. , 1998, Statistics in medicine.

[86]  A. Kaunitz,et al.  Assessing the Neonatal Safety of Indomethacin Tocolysis: A Systematic Review With Meta-Analysis , 2005, Obstetrics and gynecology.

[87]  Allan Donner,et al.  Small sample performance of tests of homogeneity of odds ratios in K 2 x 2 tables. , 1992, Statistics in medicine.

[88]  G G Koch,et al.  An overview of statistical issues and methods of meta-analysis. , 1991, Journal of biopharmaceutical statistics.

[89]  Walter R. Gilks,et al.  A Language and Program for Complex Bayesian Modelling , 1994 .

[90]  Winfred Arthur,et al.  Choice of Software and Programs in Meta-Analysis Research: Does it Make a Difference? , 1994 .

[91]  R. Woolson,et al.  A Monte Carlo investigation of homogeneity tests of the odds ratio under various sample size configurations. , 1989, Biometrics.

[92]  N Breslow,et al.  Generalized linear mixed models for meta-analysis. , 1999, Statistics in medicine.

[93]  C. Meads,et al.  Clinical effectiveness of treatment with hyperbaric oxygen for neonatal hypoxic-ischaemic encephalopathy: systematic review of Chinese literature , 2006, BMJ : British Medical Journal.

[94]  Jeffrey S. Robinson,et al.  Progesterone supplementation for preventing preterm birth: a systematic review and meta‐analysis , 2005, Acta obstetricia et gynecologica Scandinavica.