Direct versus indirect comparisons: A summary of the evidence

Objectives: The aim of this study was to provide a comprehensive summary and interpretation of the current evidence on the use and validity of statistical methods to conduct indirect comparisons of treatment effects. Methods: A narrative review was conducted. Results: Well-conducted methodological studies provide good evidence that adjusted indirect comparisons can lead to results similar to those from direct comparisons. The internal validity of several statistical methods to conduct indirect comparisons, therefore, has been established. Meta-regression, logistic regression, or adjusted indirect comparisons should be the methods of first choice. Unadjusted indirect comparisons are always unacceptable. Deciding whether to combine direct and indirect evidence will be a matter of informed judgment based on the similarities and dissimilarities of populations and interventions. Unverifiable assumptions with respect to the similarity of compared studies and low power are serious limitations of indirect comparisons. Conclusions: In the absence of sufficient head-to-head evidence, adjusted indirect comparisons can be viewed as additional analytical tools to determine the comparative efficacy and effectiveness of competing interventions. Researchers who use indirect comparisons need to keep the limitations in mind.

[1]  J. M. Mullin,et al.  A double-blind multicenter trial comparing sertraline and fluoxetine in outpatients with major depression. , 1995, The Journal of clinical psychiatry.

[2]  K. Krishnan,et al.  An 8-week multicenter, parallel-group, double-blind, placebo-controlled study of sertraline in elderly outpatients with major depression. , 2003, The American journal of psychiatry.

[3]  S D Walter,et al.  The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. , 1997, Journal of clinical epidemiology.

[4]  ArifUllah Khan,et al.  Venlafaxine in depressed outpatients. , 1991, Psychopharmacology bulletin.

[5]  P. Wender,et al.  Sertraline, a selective inhibitor of serotonin uptake, for the treatment of outpatients with major depressive disorder. , 1988, Psychopharmacology bulletin.

[6]  S. Stahl,et al.  A double-blind, placebo-controlled study comparing the effects of sertraline versus amitriptyline in the treatment of major depression. , 1997, The Journal of clinical psychiatry.

[7]  Douglas G Altman,et al.  Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses , 2003, BMJ : British Medical Journal.

[8]  G. Lu,et al.  Combination of direct and indirect evidence in mixed treatment comparisons , 2004, Statistics in medicine.

[9]  Michele Tarsilla.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[10]  Peter C Gøtzsche,et al.  Lessons from and cautions about noninferiority and equivalence randomized trials. , 2006, JAMA.

[11]  M. Guazzelli,et al.  Increased remission rates with venlafaxine compared with fluoxetine in hospitalized patients with major depression and melancholia , 2000, International clinical psychopharmacology.

[12]  R. Shelton,et al.  Double-blind comparison of sertraline, imipramine, and placebo in the treatment of dysthymia: psychosocial outcomes. , 1997, The American journal of psychiatry.

[13]  J. Ioannidis,et al.  Indirect comparisons: the mesh and mess of clinical trials , 2006, The Lancet.

[14]  L. Gamito,et al.  Efficacy and tolerability of venlafaxine and fluoxetine in outpatients with major depression , 1998, European Neuropsychopharmacology.

[15]  D G Altman,et al.  Indirect comparison in evaluating relative efficacy illustrated by antimicrobial prophylaxis in colorectal surgery. , 2000, Controlled clinical trials.

[16]  Alain Martin,et al.  A double-blind comparison of venlafaxine and fluoxetine for treatment of major depression in outpatients , 1996, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[17]  M. Fava,et al.  Fluoxetine versus sertraline and paroxetine in major depressive disorder: changes in weight with long-term treatment. , 2000, The Journal of clinical psychiatry.

[18]  T. Lumley.  Network meta‐analysis for indirect treatment comparisons , 2002, Statistics in medicine.

[19]  D G Altman,et al.  Indirect comparisons of competing interventions. , 2005, Health technology assessment.

[20]  K. Behnke,et al.  Randomized, Double-Blind Comparison of Venlafaxine and Sertraline in Outpatients With Major Depressive Disorder , 2000 .

[21]  Stuart G Baker,et al.  The transitive fallacy for randomized trials: If A bests B and B bests C in separate trials, is A better than C? , 2002, BMC medical research methodology.

[22]  J. Mendels,et al.  Efficacy and safety of b.i.d. doses of venlafaxine in a dose-response study. , 1993, Psychopharmacology bulletin.

[23]  T M Itil,et al.  Antidepressant efficacy of sertraline: a double-blind, placebo- and amitriptyline-controlled, multicenter comparison study in outpatients with major depression. , 1990, The Journal of clinical psychiatry.

[24]  E. Katz,et al.  A double-blind placebo-controlled multicentre study of sertraline in the acute and continuation treatment of major depression , 1997, European Psychiatry.

[25]  K. Behnke,et al.  Randomized, double-blind comparison of venlafaxine and sertraline in outpatients with major depressive disorder. Venlafaxine 631 Study Group. , 2000, The Journal of clinical psychiatry.

[26]  L. Cunningham.  Once-Daily Venlafaxine Extended Release (XR) and Venlafaxine Immediate Release (IR) in Outpatients with Major Depression , 1997, Annals of clinical psychiatry : official journal of the American Academy of Clinical Psychiatrists.

[27]  P. Boyer,et al.  Clinical and economic comparison of sertraline and fluoxetine in the treatment of depression. A 6-month double-blind study in a primary-care setting in France. , 1998, PharmacoEconomics.

[28]  T. Burt,et al.  Randomized trial of sertraline versus venlafaxine XR in major depression: efficacy and discontinuation symptoms. , 2005, The Journal of clinical psychiatry.

[29]  M. Thase,et al.  A double-blind, placebo-controlled comparison of venlafaxine and fluoxetine treatment in depressed outpatients. , 2007, Journal of psychiatric research.

[30]  M. McDonagh,et al.  Drug Class Review: Proton Pump Inhibitors , 2009 .

[31]  M. Thase.  Efficacy and Tolerability of Once-Daily Venlafaxine Extended Release (XR) in Outpatients With Major Depression , 1997 .

[32]  R. Hays,et al.  Similar effectiveness of paroxetine, fluoxetine, and sertraline in primary care: a randomized trial. , 2001, JAMA.

[33]  A. Ravindran,et al.  Once-daily venlafaxine extended release (XR) compared with fluoxetine in outpatients with depression and anxiety. Venlafaxine XR 360 Study Group. , 1999, The Journal of clinical psychiatry.

[34]  K. Krishnan,et al.  A double-blind comparison of sertraline and fluoxetine in depressed elderly outpatients. , 2000, The Journal of clinical psychiatry.

[35]  P. Boyer,et al.  A double-blind comparison of sertraline and fluoxetine in the treatment of major depressive episode in outpatients , 1999, European Psychiatry.

[36]  Cunningham La.  Once-daily venlafaxine extended release (XR) and venlafaxine immediate release (IR) in outpatients with major depression. Venlafaxine XR 208 Study Group. , 1997 .

[37]  A R Feinstein,et al.  Claims of Equivalence in Medical Research: Are They Supported by the Evidence? , 2000, Annals of Internal Medicine.

[38]  A. Feiger,et al.  A double-blind, randomized, placebo-controlled trial of once-daily venlafaxine extended release (XR) and fluoxetine for the treatment of depression. , 1999, Journal of affective disorders.

[39]  Norma Pugh,et al.  Effect of Hypericum perforatum (St John's wort) in major depressive disorder: a randomized controlled trial. , 2002, JAMA.

[40]  M. Fava,et al.  Acute Efficacy of Fluoxetine Versus Sertraline and Paroxetine in Major Depressive Disorder Including Effects of Baseline Insomnia , 2002, Journal of clinical psychopharmacology.

[41]  P. Cosyns,et al.  A controlled comparison of sertraline and fluoxetine in acute and continuation treatment of major depression , 1995 .

[42]  Deborah M Caldwell,et al.  Simultaneous comparison of multiple treatments: combining direct and indirect evidence , 2005, BMJ : British Medical Journal.

[43]  P. Linkowski,et al.  Venlafaxine compared with fluoxetine in outpatients with depression and concomitant anxiety. , 2002, The international journal of neuropsychopharmacology.

[44]  J. A. Costa e Silva.  Randomized, double-blind comparison of venlafaxine and fluoxetine in outpatients with major depression. , 1998, The Journal of clinical psychiatry.

[45]  A. Schatzberg,et al.  A double-blind, placebo-controlled study of venlafaxine and fluoxetine in geriatric outpatients with major depression. , 2006, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.