THE INFLUENCE OF METHODOLOGIC QUALITY ON THE CONCLUSION OF A LANDMARK META-ANALYSIS ON THROMBOLYTIC THERAPY

Objective: We studied the influence of the methodologic quality of individual trials on the outcome of a landmark meta-analysis on thrombolytic therapy in acute myocardial infarction. From each study we extracted the number of patients in both groups who died in hospital or during follow-up. Methodologic quality was assessed using the Delphi list. We first recalculated pooled odds ratios (ORs) and 95% confidence intervals (CIs), on the studies found and compared them with the original results of Yusuf et al. Next we incorporated the results of quality assessment in five different ways in the calculation of the pooled ORs: a) component analysis; b) visual plot; c) quality score as a threshold score; d) quality score as a weighting factor; and e) cumulative pooling. Results and Conclusion: No correlation between quality scores and ORs was found. Studies with a proper description of the different quality components provided an estimate close to the true treatment effect. No major differences were found between the results of the five different methods of incorporating the quality scores into the final conclusion.

[1]  J. Gormsen,et al.  Biochemical evaluation of low dose of urokinase in acute myocardial infarction. A double-blind study. , 2009, Acta medica Scandinavica.

[2]  H. Mustaniemi,et al.  Fibrinolytic treatment in acute myocardial infarction. , 2009, Acta medica Scandinavica.

[3]  P. A. van den Brandt,et al.  The art of quality assessment of RCTs included in systematic reviews. , 2001, Journal of clinical epidemiology.

[4]  P. A. van den Brandt,et al.  IMPACT OF QUALITY ITEMS ON STUDY OUTCOME , 2000, International Journal of Technology Assessment in Health Care.

[5]  C. Adams,et al.  Influence of methodology on outcomes of randomised clozapine trials. , 2000, Pharmacopsychiatry.

[6]  M. Egger,et al.  The hazards of scoring the quality of clinical trials for meta-analysis. , 1999, JAMA.

[7]  W B Jonas,et al.  Impact of study quality on outcome in placebo-controlled trials of homeopathy. , 1999, Journal of clinical epidemiology.

[8]  H. Vet,et al.  The Delphi list: a criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. , 1998, Journal of clinical epidemiology.

[9]  A D Oxman,et al.  The unpredictability paradox: review of empirical comparisons of randomised and non-randomised clinical trials , 1998, BMJ.

[10]  D. Cook,et al.  Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? , 1998, The Lancet.

[11]  George Davey Smith,et al.  Meta-analysis: Principles and procedures , 1997, BMJ.

[12]  L M Bouter,et al.  Method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group for Spinal Disorders. , 1997, Spine.

[13]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[14]  Paul Knipschild,et al.  Systematic Reviews on the Basis of Methodological Criteria , 1997 .

[15]  L. Bouter,et al.  Spinal Manipulation for Low Back Pain: An Updated Systematic Review of Randomized Clinical Trials , 1996, Spine.

[16]  R. D. Bie,et al.  Methodology of systematic reviews: an introduction , 1996 .

[17]  L. Bouter,et al.  Spinal Manipulation and Mobilisation for Low Back Pain: A systematic review of randomised clinical trials , 1996 .

[18]  R. J. Hayes,et al.  Blinding and exclusions after allocation in randomised controlled trials: survey of published parallel group trials in obstetrics and gynaecology , 1996, BMJ.

[19]  A R Jadad,et al.  Assessing the Quality of Randomized Controlled Trials: Current Issues and Future Directions , 1996, International Journal of Technology Assessment in Health Care.

[20]  R. J. Hayes,et al.  Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. , 1995, JAMA.

[21]  L. Bouter,et al.  The efficacy of back schools: a review of randomized clinical trials. , 1994, Journal of clinical epidemiology.

[22]  L. Bouter,et al.  The efficacy of chiropractic manipulation for back pain: blinded review of relevant randomized clinical trials. , 1992, Journal of manipulative and physiological therapeutics.

[23]  F. Mosteller,et al.  A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. , 1992, JAMA.

[24]  C D Naylor,et al.  Incorporating variations in the quality of individual randomized trials into meta-analysis. , 1992, Journal of clinical epidemiology.

[25]  R. Haynes.  Clinical review articles. , 1992, BMJ.

[26]  Sarah Parish,et al.  Randomized trial of intravenous streptokinase, oral aspirin, both, or neither among 17,187 cases of suspected acute myocardial infarction: ISIS-2.ISIS-2 (Second International Study of Infarct Survival) Collaborative Group. , 1988, Journal of the American College of Cardiology.

[27]  C. Mulrow.  The medical review article: state of the science. , 1987, Annals of internal medicine.

[28]  J. Moses,et al.  Randomized double-blind trial of intravenous streptokinase for acute myocardial infarction. , 1986, The American journal of cardiology.

[29]  J. Gardin,et al.  A randomized controlled trial of intravenous streptokinase in evolving acute myocardial infarction. , 1986, American heart journal.

[30]  M. Simoons,et al.  IMPROVED SURVIVAL AFTER EARLY THROMBOLYSIS IN ACUTE MYOCARDIAL INFARCTION A Randomised Trial by the Interuniversity Cardiology Institute in The Netherlands , 1985, The Lancet.

[31]  R. Collins,et al.  Intravenous and intracoronary fibrinolytic therapy in acute myocardial infarction: overview of results on mortality, reinfarction and side-effects from 33 randomized controlled trials. , 1985, European heart journal.

[32]  J L Ritchie,et al.  The western Washington randomized trial of intracoronary streptokinase in acute myocardial infarction. A 12-month follow-up report. , 1985, The New England journal of medicine.

[33]  M. Verani,et al.  Intracoronary thrombolytic therapy in acute myocardial infarction: a prospective, randomized, controlled trial. , 1985, The American journal of cardiology.

[34]  K. Karsch,et al.  Effects of intracoronary streptokinase and intracoronary nitroglycerin infusion on coronary angiographic patterns and mortality in patients with acute myocardial infarction. , 1984, The New England journal of medicine.

[35]  J. Anderson,et al.  Long-term follow-up after intracoronary streptokinase for myocardial infarction: a randomized, controlled study. , 1984, American heart journal.

[36]  A. Ross,et al.  A randomized, angiographically controlled trial of intracoronary streptokinase in acute myocardial infarction. , 1984, The American journal of cardiology.

[37]  J L Ritchie,et al.  Western Washington randomized trial of intracoronary streptokinase in acute myocardial infarction. , 1983, The New England journal of medicine.

[38]  P. R. Frederick,et al.  A randomized trial of intracoronary streptokinase in the treatment of acute myocardial infarction. , 1983, The New England journal of medicine.

[39]  W. O’Neill,et al.  Intracoronary fibrinolytic therapy in acute myocardial infarction. Report of a prospective randomized trial. , 1983, The New England journal of medicine.

[40]  K. Kanmatsuse,et al.  [Intracoronary thrombolysis in acute myocardial infarction]. , 1982, Nihon Naika Gakkai zasshi. The Journal of the Japanese Society of Internal Medicine.

[41]  T C Chalmers,et al.  A method for assessing the quality of a randomized control trial. , 1981, Controlled clinical trials.

[42]  F. Ambrosch,et al.  [Results of the Austrian myocardial infarction study on the effects of streptokinase (author's transl)]. , 1977, Wiener klinische Wochenschrift.

[43]  H. Avenarius,et al.  [Investigations of the clinical course of acute myocardial infarction. I. The fibrinolytic treatment of acute myocardial infarction with streptokinase (author's transl)]. , 1977, Medizinische Klinik.

[44]  E. Raftery,et al.  Streptokinase in acute myocardial infarction: a controlled multicentre study in the United Kingdom. , 1976, British medical journal.

[45]  CONTROLLED TRIAL OF UROKINASE IN MYOCARDIAL INFARCTION A European Collaborative Study , 1975, The Lancet.

[46]  T. Simon,et al.  A pilot study of streptokinase therapy in acute myocardial infarction: observations on complications and relation to trial design. , 1974, American heart journal.

[47]  H. Kraft,et al.  Die Kurzzeitfibrinolyse beim akuten Myokardinfarkt , 1973 .

[48]  J. Hirsh,et al.  Australian multicentre trial of streptokinase in acute myocardial infarction. , 1973, The Medical journal of Australia.

[49]  P. Mannucci,et al.  Controlled trial of streptokinase and heparin in acute myocardial infarction. , 1971, Lancet.

[50]  M. Verstraete.  Streptokinase in Recent Myocardial Infarction: A Controlled Multicentre Trial , 1971, British medical journal.

[51]  D. Gebauer,et al.  [The fibrinolytic treatment in myocardial infarction]. , 1966, Medizinische Klinik.

[52]  J. Sokal,et al.  Controlled study of the treatment of coronary occlusion with urokinase-activated human plasmin , 1965 .

[53]  A. Fletcher,et al.  The maintenance of a sustained thrombolytic state in man. II. Clinical observations on patients with myocardial infarction and other thromboembolic disorders. , 1959, The Journal of clinical investigation.

[54]  M. Jenicek,et al.  Meta-analysis in medicine. Where we are and where we want to go. , 1989, Journal of clinical epidemiology.

[55]  H. König,et al.  [Short-term fibrinolytic treatment in acute myocardial infarction]. , 1973, Deutsche medizinische Wochenschrift.

[56]  A. Amery,et al.  Single-blind randomised multicentre trial comparing heparin and streptokinase treatment in recent myocardial infarction. , 1969, Acta medica Scandinavica. Supplementum.