Chapter 10: Deciding Whether to Complement a Systematic Review of Medical Tests with Decision Modeling

Limited by what is reported in the literature, most systematic reviews of medical tests focus on “test accuracy” (or better, test performance), rather than on the impact of testing on patient outcomes. The link between testing, test results and patient outcomes is typically complex: even when testing has high accuracy, there is no guarantee that physicians will act according to test results, that patients will follow their orders, or that the intervention will yield a beneficial endpoint. Therefore, test performance is typically not sufficient for assessing the usefulness of medical tests. Modeling (in the form of decision or economic analysis) is a natural framework for linking test performance data to clinical outcomes. We propose that (some) modeling should be considered to facilitate the interpretation of summary test performance measures by connecting testing and patient outcomes. We discuss a simple algorithm for helping systematic reviewers think through this possibility, and illustrate it by means of an example.

[1]  Detsky As,et al.  Users' guides to the medical literature. VII. How to use a clinical decision analysis. A. Are the results of the study valid? Evidence-Based Medicine Working Group. , 1995, JAMA.

[2]  Mark Oppe,et al.  Expected value of perfect information: an empirical example of reducing decision uncertainty by conducting additional research. , 2006, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[3]  Joseph Lau,et al.  Decision-Analytic Modeling to Evaluate Benefits and Harms of Medical Tests: Uses and Limitations , 2009, Medical decision making : an international journal of the Society for Medical Decision Making.

[4]  M Sculpher,et al.  A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme. , 2004, Health technology assessment.

[5]  Sarah Lord,et al.  When Is Measuring Sensitivity and Specificity Sufficient To Evaluate a Diagnostic Test, and When Do We Need Randomized Trials? , 2006, Annals of Internal Medicine.

[6]  M Sculpher,et al.  Health Technology Assessment: Development and Future , 2009 .

[7]  Patrick M M Bossuyt,et al.  Using the Principles of Randomized Controlled Trial Design to Guide Test Evaluation , 2009, Medical decision making : an international journal of the Society for Medical Decision Making.

[8]  P. Glasziou,et al.  Evaluating new screening tests for breast cancer , 2006, BMJ : British Medical Journal.

[9]  A S Detsky,et al.  Users' guides to the medical literature. VII: How to use a clinical decision analysis : a are the results of the study valid ? , 1995 .

[10]  David J Samson,et al.  Challenges in Systematic Reviews of Diagnostic Technologies , 2005, Annals of Internal Medicine.

[11]  Amy B. Knudsen,et al.  Evaluating Test Strategies for Colorectal Cancer Screening—Age to Begin, Age to Stop, and Timing of Screening Intervals , 2009 .

[12]  T. Harr,et al.  Primary stenting versus primary balloon angioplasty for treating acute myocardial infarction. , 2005, The Cochrane database of systematic reviews.

[13]  E Goyder,et al.  A review and critique of modelling in prioritising and designing screening programmes. , 2007, Health technology assessment.

[14]  Amy B. Knudsen,et al.  Evaluating Test Strategies for Colorectal Cancer Screening: A Decision Analysis for the U.S. Preventive Services Task Force , 2008, Annals of Internal Medicine.

[15]  David O Meltzer,et al.  Minimal Modeling Approaches to Value of Information Analysis for Health Research , 2011, Medical decision making : an international journal of the Society for Medical Decision Making.

[16]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[17]  J G Fletcher,et al.  Optimization of CT colonography technique: prospective trial in 180 patients. , 2000, Radiology.

[18]  T. Trikalinos,et al.  Future Research Needs for the Comparison of Percutaneous Coronary Interventions with Bypass Graft Surgery in Nonacute Coronary Artery Disease , 2010 .

[19]  B. O'brien,et al.  Decision Analytic Modelling in the Economic Evaluation of Health Technologies , 2012, PharmacoEconomics.

[20]  Bernadette Mazurek Melnyk,et al.  Screening for colorectal cancer: U.S. Preventive Services Task Force recommendation statement. , 2008, Annals of internal medicine.

[21]  Milton C Weinstein,et al.  Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices--Modeling Studies. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[22]  Karl Claxton,et al.  Assessing Quality in Decision Analytic Cost-Effectiveness Models , 2000, PharmacoEconomics.

[23]  David B. Matchar,et al.  Chapter 1: Introduction to the Methods Guide for Medical Test Reviews , 2012, Journal of general internal medicine.

[24]  D. Rubens,et al.  Calf sonography for detecting deep venous thrombosis in symptomatic patients: Experience and review of the literature , 1999, Journal of clinical ultrasound : JCU.

[25]  Hendrik Koffijberg,et al.  Enhancing value of information analyses. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[26]  G. Samsa,et al.  Use of Positron Emission Tomography and Other Neuroimaging Techniques in the Diagnosis and Management of Alzheimer’s Disease and Dementia , 2001 .

[27]  Detsky As,et al.  Users' guides to the medical literature. VII. How to use a clinical decision analysis. B. What are the results and will they help me in caring for my patients? Evidence Based Medicine Working Group. , 1995, JAMA.

[28]  Kirsten McCaffery,et al.  Additional Patient Outcomes and Pathways in Evaluations of Testing , 2009, Medical decision making : an international journal of the Society for Medical Decision Making.

[29]  Bruce L. Miller,et al.  Appendix B: Practice parameter: Diagnosis of dementia (an evidence-based review): Report of the quality standards subcommittee of the American academy neurology , 2007 .

[30]  Ben Vandermeer,et al.  Chapter 8: Meta-analysis of Test Performance When There is a “Gold Standard” , 2012, Journal of General Internal Medicine.

[31]  B. Miller,et al.  CME Practice parameter : Diagnosis of dementia ( an evidence-based review ) Report of the Quality Standards Subcommittee of the American Academy of Neurology , 2001 .

[32]  A S Detsky,et al.  Users' guides to the medical literature. VII. How to use a clinical decision analysis. B. What are the results and will they help me in caring for my patients? Evidence Based Medicine Working Group. , 1995, JAMA.

[33]  S. Golder,et al.  Good Practice Guidelines for Decision-Analytic Modelling in Health Technology Assessment , 2012, PharmacoEconomics.

[34]  J D Habbema,et al.  Endoscopic colorectal cancer screening: a cost-saving analysis. , 2000, Journal of the National Cancer Institute.

[35]  Rob Boer,et al.  The MISCAN-COLON Simulation Model for the Evaluation of Colorectal Cancer Screening , 1999, Comput. Biomed. Res..

[36]  J D Habbema,et al.  The MISCAN simulation program for the evaluation of screening for disease. , 1985, Computer methods and programs in biomedicine.