Concordance between decision analysis and matching systematic review of randomized controlled trials in assessment of treatment comparisons: a systematic review

BackgroundSystematic review (SR) of randomized controlled trials (RCT) is the gold standard for informing treatment choice. Decision analyses (DA) also play an important role in informing health care decisions. It is unknown how often the results of DA and matching SR of RCTs are in concordance. We assessed whether the results of DA are in concordance with SR of RCTs matched on patient population, intervention, control, and outcomes.MethodsWe searched PubMed up to 2008 for DAs comparing at least two interventions followed by matching SRs of RCTs. Data were extracted on patient population, intervention, control, and outcomes from DAs and matching SRs of RCTs. Data extraction from DAs was done by one reviewer and from SR of RCTs by two independent reviewers.ResultsWe identified 28 DAs representing 37 comparisons for which we found matching SR of RCTs. Results of the DAs and SRs of RCTs were in concordance in 73% (27/37) of cases. The sensitivity analyses conducted in either DA or SR of RCTs did not impact the concordance. Use of single (4/37) versus multiple data source (33/37) in design of DA model was statistically significantly associated with concordance between DA and SR of RCTs.ConclusionsOur findings illustrate the high concordance of current DA models compared with SR of RCTs. It is shown previously that there is 50% concordance between DA and matching single RCT. Our study showing the concordance of 73% between DA and matching SR of RCTs underlines the importance of totality of evidence (i.e. SR of RCTs) in the design of DA models and in general medical decision-making.

[1]  J G Dolan.  Can decision analysis adequately represent clinical problems? , 1990, Journal of clinical epidemiology.

[2]  Monica Morrow,et al.  Outcome of axillary staging in early breast cancer: a meta-analysis , 2010, Breast Cancer Research and Treatment.

[3]  H. Brachinger,et al.  Decision analysis , 1997 .

[4]  J. Kassirer,et al.  Decision analysis: a progress report. , 1987, Annals of internal medicine.

[5]  J Cuzick,et al.  Overview of the main outcomes in breast-cancer prevention trials , 2003, The Lancet.

[6]  Sanjay Kaul,et al.  The impact of revascularization on mortality in patients with nonacute coronary artery disease. , 2009, The American journal of medicine.

[7]  Detsky As,et al.  Users' guides to the medical literature. VII. How to use a clinical decision analysis. B. What are the results and will they help me in caring for my patients? Evidence Based Medicine Working Group. , 1995, JAMA.

[8]  K. Chung,et al.  Decision Analysis in Plastic Surgery: A Primer , 2010, Plastic and reconstructive surgery.

[9]  Yan Xing,et al.  Decision analysis to assess the efficacy of routine sentinel lymphadenectomy in patients undergoing prophylactic mastectomy , 2007, Cancer.

[10]  W. Scott.  Users' Guides to the Medical Literature: VII. How to Use a Clinical Decision Analysis: B. What Are the Results and Will They Help Me In Caring for My Patients? , 1995 .

[11]  Jeremy D Goldhaber-Fiebert,et al.  Accounting for Biases When Linking Empirical Studies and Simulation Models , 2012, Medical decision making : an international journal of the Society for Medical Decision Making.

[12]  S G Pauker,et al.  Patient-specific decisions about hormone replacement therapy in postmenopausal women. , 1997, JAMA.

[13]  M Sculpher,et al.  Review of guidelines for good practice in decision-analytic modelling in health technology assessment. , 2004, Health technology assessment.

[14]  Harold Lehmann,et al.  Agreement of decision analyses and subsequent clinical studies in infectious diseases. , 2007, The American journal of medicine.

[15]  J J Deeks,et al.  Systematic reviews of published evidence: miracles or minefields? , 1998, Annals of oncology : official journal of the European Society for Medical Oncology.

[16]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[17]  F. Sonnenberg,et al.  Myocardial revascularization for chronic stable angina. Analysis of the role of percutaneous transluminal coronary angioplasty based on data available in 1989. , 1990, Annals of internal medicine.

[18]  M Sculpher,et al.  A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme. , 2004, Health technology assessment.

[19]  W. J. Conover,et al.  Practical Nonparametric Statistics , 1972 .

[20]  B. Sibbald,et al.  Why are randomised controlled trials important , 1998 .

[21]  James G. Dolant.  Can decision analysis adequately represent clinical problems , 1990 .

[22]  S G Pauker,et al.  Clinical application of decision analysis: a detailed illustration. , 1978, Seminars in nuclear medicine.

[23]  R F Nease,et al.  The decision to enter a randomized trial of tamoxifen for the prevention of breast cancer in healthy women: an analysis of the tradeoffs. , 1995, The American journal of medicine.

[24]  A S Detsky,et al.  Users' guides to the medical literature. VII. How to use a clinical decision analysis. B. What are the results and will they help me in caring for my patients? Evidence Based Medicine Working Group. , 1995, JAMA.

[25]  S. Golder,et al.  Good Practice Guidelines for Decision-Analytic Modelling in Health Technology Assessment , 2012, PharmacoEconomics.

[26]  B. Sibbald,et al.  Understanding controlled trials: Why are randomised controlled trials important? , 1998 .

[27]  Detsky As,et al.  Users' guides to the medical literature. VII. How to use a clinical decision analysis. A. Are the results of the study valid? Evidence-Based Medicine Working Group. , 1995, JAMA.

[28]  Milton C Weinstein,et al.  Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices--Modeling Studies. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[29]  J F Wilson,et al.  Breast-conserving therapy vs mastectomy in early-stage breast cancer: a meta-analysis of 10-year survival. , 1997, The cancer journal from Scientific American.

[30]  R Brian Haynes,et al.  Sensitive Clinical Queries retrieved relevant systematic reviews as well as primary studies: an analytic survey. , 2011, Journal of clinical epidemiology.

[31]  A. Fasoli.  [Clinical decision analysis]. , 1986, Annali italiani di medicina interna : organo ufficiale della Societa italiana di medicina interna.

[32]  A. Verbeek,et al.  Breast-conserving treatment or mastectomy in early breast cancer: a clinical decision analysis with special reference to the risk of local recurrence. , 1991, European journal of cancer.

[33]  A S Detsky,et al.  Users' guides to the medical literature. VII: How to use a clinical decision analysis : a are the results of the study valid ? , 1995 .

[34]  Danny Enepekides,et al.  Treatment of early-stage glottic cancer: meta-analysis comparison of laser excision versus radiotherapy. , 2009, Journal of otolaryngology - head & neck surgery = Le Journal d'oto-rhino-laryngologie et de chirurgie cervico-faciale.

[35]  Elena B. Elkin,et al.  Adjuvant Ovarian Suppression Versus Chemotherapy for Premenopausal, Hormone-responsive Breast Cancer: Quality of Life and Efficacy Tradeoffs , 2005, Breast Cancer Research and Treatment.

[36]  J Cuzick,et al.  Use of luteinising-hormone-releasing hormone agonists as adjuvant treatment in premenopausal patients with hormone-receptor-positive breast cancer: a meta-analysis of individual patient data from randomised adjuvant trials , 2007, The Lancet.

[37]  Susan S Salmond.  Randomized Controlled Trials: Methodological Concepts and Critique , 2008, Orthopedic nursing.

[38]  A. Verbeek,et al.  Radiotherapy or surgery for T2N0M0 glottic carcinoma? A decision-analytic approach. , 1989, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.