10. Meta‐analysis: Part 2: assessing the quality of published meta‐analyses

I n Part 1 of this review we concluded that metaanalysis has supplemented , and may eventually replace, the traditional narrative review as the prin. cipal source of information for those wishing to obtain an overview of new developments regarding the aetiology or management of the diseases encompassed by their clinical practice. ' We reviewed the aims of meta-analysis and evidence that it is a val id and reliable technique. However, this conclusion is itself only valid if steps have been taken by authors to minimise a range of biases which can affect meta-analyses. In Part 2 of this review we provide guidelines for assessing the quality of published meta-analyses. As in Part 1 we have illustrated important points with examples from the literature. In compiling Part 2 we have drawn on the work of Light and Pillemer, Sacks et al. and Oxman and Guyatt. ··· All have provided excellent reviews of meta-analysis which should be consulted by those interested in expanding their knowledge of this important topic. Meta-analysis is a discipline which provides methods for finding , appraising and combining data from a range of studies. Bias can intrude at each of these stages. Bias can also intrude during a traditional narrative review, but

[1]  D Elbourne,et al.  The effects of routine oxytocic administration in the management of the third stage of labour: an overview of the evidence from controlled trials , 1988, British journal of obstetrics and gynaecology.

[2]  G. Oster,et al.  RATES OF VENOUS THROMBOSIS AFTER GENERAL SURGERY: COMBINED RESULTS OF RANDOMISED CLINICAL TRIALS , 1986, The Lancet.

[3]  P. Gøtzsche,et al.  PATIENTS' PREFERENCE IN INDOMETHACIN TRIALS: AN OVERVIEW , 1989, The Lancet.

[4]  D. Henry,et al.  Meta-analysis. Part 1: An assessment of its aims, validity and reliability. , 1992, The Medical journal of Australia.

[5]  T C Chalmers,et al.  Should mild hypertension be treated? An attempted meta-analysis of the clinical trials. , 1985, The Mount Sinai journal of medicine, New York.

[6]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[7]  W. Schaffner,et al.  Nonsteroidal anti-inflammatory drug use and death from peptic ulcer in elderly persons. , 1988, Annals of internal medicine.

[8]  L Mutch,et al.  The Oxford Database of Perinatal Trials: developing a register of published reports of controlled trials. , 1986, Controlled clinical trials.

[9]  A. Blower,et al.  Non-steroidal anti-inflammatory drugs and life threatening complications of peptic ulceration. , 1987, Gut.

[10]  R. Collins,et al.  Blood pressure, stroke, and coronary heart disease Part 2, short-term reductions in blood pressure: overview of randomised drug trials in their epidemiological context , 1990, The Lancet.

[11]  R. Collins,et al.  Intravenous and intracoronary fibrinolytic therapy in acute myocardial infarction: overview of results on mortality, reinfarction and side-effects from 33 randomized controlled trials. , 1985, European heart journal.

[12]  David B. Pillemer,et al.  Summing Up: The Science of Reviewing Research , 1984 .

[13]  M. Langman,et al.  NON-STEROIDAL ANTI-INFLAMMATORY DRUGS AND BLEEDING PEPTIC ULCER , 1986, The Lancet.

[14]  D. Henry,et al.  The benefits of reducing cholesterol levels: the need to distinguish primary from secondary prevention: 1. A meta‐analysis of cholesterol‐lowering trials , 1991, The Medical journal of Australia.

[15]  D. Fromm Endoscopic coagulation for gastrointestinal bleeding. , 1987, The New England journal of medicine.

[16]  R. Simes Publication bias: the case for an international registry of clinical trials. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[17]  D Fleischer,et al.  Endoscopic therapy of upper gastrointestinal bleeding in humans. , 1986, Gastroenterology.

[18]  Gruppo Italiano per lo Studio della Soprawivenza nell'Inf Miocardico.,et al.  EFFECTIVENESS OF INTRAVENOUS THROMBOLYTIC TREATMENT IN ACUTE MYOCARDIAL INFARCTION , 1986, The Lancet.

[19]  T C Chalmers,et al.  Meta-analysis of clinical trials as a scientific discipline. I: Control of bias and comparison with large co-operative trials. , 1987, Statistics in medicine.

[20]  L. Hedges Estimation of effect size from a series of independent experiments. , 1982 .

[21]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[22]  R. Peto,et al.  Beta blockade during and after myocardial infarction: an overview of the randomized trials. , 1985, Progress in cardiovascular diseases.

[23]  J. Berlin,et al.  Meta‐analysis of randomized controlled trials as a method of estimating rare complications of non‐steroidal anti‐inflammatory drug therapy , 1988, Alimentary pharmacology & therapeutics.

[24]  R. Simes,et al.  Confronting publication bias: a cohort design for meta-analysis. , 1987, Statistics in medicine.

[25]  A. Banerjee,et al.  Non-Steroidal Anti-Inflammatory Drugs and Gastrointestinal Adverse Effects , 1983, Journal of the Royal College of Physicians of London.

[26]  C. Begg,et al.  Publication bias : a problem in interpreting medical data , 1988 .

[27]  T. Caradoc-Davies,et al.  Nonsteroidal anti-inflammatory drugs, arthritis, and gastrointestinal bleeding in elderly in-patients. , 1984, Age and ageing.

[28]  T C Chalmers,et al.  A comparison of statistical methods for combining event rates from clinical trials. , 1989, Statistics in medicine.

[29]  K A L'Abbé,et al.  Meta-analysis in clinical research. , 1987, Annals of internal medicine.

[30]  A. Dobson,et al.  NSAIDs and risk of upper gastrointestinal bleeding , 1991, The Lancet.

[31]  G H Guyatt,et al.  Guidelines for reading literature reviews. , 1988, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[32]  A. Detsky,et al.  Parenteral nutrition with branched-chain amino acids in hepatic encephalopathy. A meta-analysis. , 1989, Gastroenterology.

[33]  T C Chalmers,et al.  A method for assessing the quality of a randomized control trial. , 1981, Controlled clinical trials.

[34]  D. Henry,et al.  Effects of fibrinolytic inhibitors on mortality from upper gastrointestinal haemorrhage. , 1989, BMJ.

[35]  R Peto,et al.  Effect of intravenous streptokinase on acute myocardial infarction: pooled results from randomized trials. , 1982, The New England journal of medicine.

[36]  R. Peto,et al.  Effects of adjuvant tamoxifen and of cytotoxic therapy on mortality in early breast cancer. An overview of 61 randomized trials among 28,896 women. , 1989, The New England journal of medicine.

[37]  J. Baron,et al.  Effect of intravenous streptokinase on early mortality in patients with suspected acute myocardial infarction. A meta-analysis by anatomic location of infarction . , 1990, Annals of internal medicine.

[38]  K. McPherson,et al.  Secondary prevention of vascular disease by prolonged antiplatelet treatment , 1988, British medical journal.

[39]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.