Decision-making about healthcare related tests and diagnostic strategies : A review of methodological and practical challenges

OBJECTIVES In this first of a series of five articles, we provide an overview of how and why healthcare-related tests and diagnostic strategies are currently applied. We also describe how our findings can be integrated with existing frameworks for making decisions that guide the use of healthcare-related tests and diagnostic strategies. STUDY DESIGN AND SETTING We searched MEDLINE, references of identified articles, chapters in relevant textbooks, and identified articles citing classic literature on this topic. RESULTS We provide updated frameworks for the potential roles and applications of tests with suggested definitions and practical examples. We also discuss study designs that are commonly used to assess tests' performance and the effects of tests on people's health. These designs include diagnostic randomized controlled trials and retrospective validation. We describe the utility of these and other currently suggested designs, which questions they can answer and which ones they cannot. In addition, we summarize the challenges unique to decision-making resulting from the use of tests. CONCLUSION This overview highlights current challenges in the application of tests in decision-making in healthcare, provides clarifications, and informs the proposed solutions.

[1]  B. Hillman.  Noninterpretive skills for radiology residents. Critical thinking: deciding whether to incorporate the recommendations of radiology publications and presentations into practice. , 2000, AJR. American journal of roentgenology.

[2]  Paul Glasziou,et al.  Comparative accuracy: assessing new tests against existing diagnostic pathways , 2006, BMJ : British Medical Journal.

[3]  J. Knottnerus.  The Effects of Disease Verification and Referral on the Relationship Between Symptoms and Diseases , 1987, Medical decision making : an international journal of the Society for Medical Decision Making.

[4]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[5]  N. Day,et al.  Accuracy of a Commercial IgM ELISA for the Diagnosis of Human Leptospirosis in Thailand , 2012, The American journal of tropical medicine and hygiene.

[6]  Patrick M M Bossuyt,et al.  Diagnostic test accuracy may vary with prevalence: implications for evidence-based diagnosis. , 2009, Journal of clinical epidemiology.

[7]  P. Sandercock,et al.  Magnetic resonance imaging versus computed tomography for detection of acute vascular lesions in patients presenting with stroke symptoms ( Review , 2022 .

[8]  Dongsheng Tu,et al.  K-ras mutations and benefit from cetuximab in advanced colorectal cancer. , 2008, The New England journal of medicine.

[9]  S. Mboup,et al.  RNA versus DNA (NucliSENS EasyQ HIV-1 v1.2 versus Amplicor HIV-1 DNA Test v1.5) for Early Diagnosis of HIV-1 Infection in Infants in Senegal , 2011, Journal of Clinical Microbiology.

[10]  Johannes B. Reitsma,et al.  A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. , 2009, Journal of clinical epidemiology.

[11]  Gianni Virgili,et al.  Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy. , 2011, The Cochrane database of systematic reviews.

[12]  Gordon H. Guyatt,et al.  Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice; Users' Guides to the Medical Literature: Essentials of Evidence-Based Clinical Practice , 2003, BMJ : British Medical Journal.

[13]  Johannes B Reitsma,et al.  Galactomannan detection for invasive aspergillosis in immunocompromized patients. , 2008, The Cochrane database of systematic reviews.

[14]  P. Bossuyt,et al.  Evaluation of diagnostic tests when there is no gold standard. A review of methods. , 2007, Health technology assessment.

[15]  J. Knottnerus,et al.  Assessment of the accuracy of diagnostic tests: the cross-sectional study. , 2003, Journal of clinical epidemiology.

[16]  P. Bossuyt,et al.  Assessing the value of diagnostic tests: a framework for designing and evaluating trials , 2012, BMJ : British Medical Journal.

[17]  P. Bossuyt,et al.  Randomised comparisons of medical tests: sometimes invalid, not always efficient , 2000, The Lancet.

[18]  A Hadgu,et al.  Discrepant analysis: a biased and an unscientific method for estimating test sensitivity and specificity. , 1999, Journal of clinical epidemiology.

[19]  J André Knottnerus,et al.  Evidence base of clinical diagnosis Evaluation of diagnostic procedures , 2022 .

[20]  J. Rizzo,et al.  Understanding the medical and nonmedical value of diagnostic testing. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[21]  P. Bossuyt,et al.  Traditional health outcomes in the evaluation of diagnostic tests. , 1999, Academic radiology.

[22]  Johannes B Reitsma,et al.  Case-control and two-gate designs in diagnostic accuracy studies. , 2005, Clinical chemistry.

[23]  L. Martínez-Dolz,et al.  Utility of cardiac magnetic resonance imaging for the diagnosis of heart transplant rejection. , 2003, Transplantation proceedings.

[24]  Dongsheng Tu,et al.  Cetuximab for the treatment of colorectal cancer. , 2007, The New England journal of medicine.

[25]  Daniel J Sargent,et al.  Clinical trial designs for predictive marker validation in cancer treatment trials. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[26]  Jonathan J Deeks,et al.  Rapid diagnostic tests for diagnosing uncomplicated P. falciparum malaria in endemic countries. , 2011, The Cochrane database of systematic reviews.

[27]  Susan Mallett,et al.  QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies , 2011, Annals of Internal Medicine.

[28]  Andrew Hayen,et al.  Cardiac testing for coronary artery disease in potential kidney transplant recipients. , 2011, The Cochrane database of systematic reviews.

[29]  Dennis G. Fryback,et al.  The Efficacy of Diagnostic Imaging , 1991, Medical decision making : an international journal of the Society for Medical Decision Making.

[30]  Sarah Lord,et al.  When Is Measuring Sensitivity and Specificity Sufficient To Evaluate a Diagnostic Test, and When Do We Need Randomized Trials? , 2006, Annals of Internal Medicine.

[31]  Ellen Fineout-Overholt,et al.  Users' Guides to the Medical Literature , 2002 .

[32]  R. Peeling,et al.  A guide for diagnostic evaluations. , 2010, Nature reviews. Microbiology.

[33]  Emmanuel Simons,et al.  Physical examination for lumbar radiculopathy due to disc herniation in patients with low-back pain. , 2010, The Cochrane database of systematic reviews.

[34]  Johannes B Reitsma,et al.  Quality of reporting of diagnostic accuracy studies. , 2005, Radiology.

[35]  David Moher,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. , 2004, Family practice.

[36]  G. Gazelle,et al.  A framework for assessing the value of diagnostic imaging in the era of comparative effectiveness research. , 2011, Radiology.

[37]  Nikolaos A. Patsopoulos,et al.  A pragmatic view on pragmatic trials , 2011, Dialogues in clinical neuroscience.

[38]  G. Ascoli,et al.  Health technology assessment: principles, methods and current status , 2009, La radiologia medica.

[39]  Johannes B Reitsma,et al.  Galactomannan detection for invasive aspergillosis in immunocompromised patients. , 2015, The Cochrane database of systematic reviews.

[40]  J. Knottnerus,et al.  The Evidence Base of Clinical Diagnosis: Theory and Methods of Diagnostic Research , 2008 .

[41]  Daniel J Sargent,et al.  Clinical trial designs for predictive biomarker validation: theoretical considerations and practical challenges. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[42]  J. Lijmer,et al.  Various randomized designs can be used to evaluate medical tests. , 2009, Journal of clinical epidemiology.

[43]  Allen F. Shaughnessy,et al.  Clinical Epidemiology: A Basic Science for Clinical Medicine , 2007, BMJ : British Medical Journal.

[44]  J. Sch.  GRADE: grading quality of evidence and strength of recommendations for diagnostic tests and strategies , 2008, BMJ : British Medical Journal.

[45]  G. Holder,et al.  A comparison of pattern and multifocal electroretinography in the evaluation of age-related macular degeneration and its treatment with photodynamic therapy , 2006, Documenta Ophthalmologica.

[46]  G. Guyatt,et al.  The role of before-after studies of therapeutic impact in the evaluation of diagnostic technologies. , 1986, Journal of chronic diseases.

[47]  P. Glasziou,et al.  When Should a New Test Become the Current Reference Standard? , 2008, Annals of Internal Medicine.

[48]  Sabine Tejpar,et al.  KRAS status and efficacy in the first-line treatment of patients with metastatic colorectal cancer (mCRC) treated with FOLFIRI with or without cetuximab: The CRYSTAL experience , 2008 .

[49]  Patrick Bossuyt,et al.  Systematic Reviews of Diagnostic Test Accuracy , 2008, Annals of Internal Medicine.