Differentiating Small (≤1 cm) Focal Liver Lesions as Metastases or Cysts by means of Computed Tomography: A Case-Study to Illustrate a Fuzzy Logic-Based Method to Assess the Impact of Diagnostic Confidence on Radiological Diagnosis

Purpose. To quantify the impact of diagnostic confidence on radiological diagnosis with a fuzzy logic-based method. Materials and Methods. Twenty-two oncologic patients with 20 cysts and 30 metastases ≤1 cm in size found at 64-row computed tomography were included. Two readers (R1/R2) expressed diagnoses as a subjective level of confidence P(d) in malignancy within the interval [0,1] rather than on a “crisp” basis (malignant/benign); confidence in benignancy was 1 − p(d). When cross-tabulating data according to the standard of reference, 2 × 2 table cells resulted from the aggregation between p(d)/1 − p(d) and final diagnosis. We then assessed (i) readers diagnostic performance on a fuzzy and crisp basis; (ii) the “divergence” δ(F, C) (%) as a measure of how confidence impacted on crisp diagnosis. Results. Diagnoses expressed with lower confidence increased fuzzy false positives compared to crisp ones (from 0 to 0.2 for R1; from 1 to 2.4 for R2). Crisp/fuzzy accuracy was 94.0%/93.6% (R1) and 94.0/91.6% (R2). δ(F, C) (%) was larger in the case of the less experienced reader (R2) (up to +7.95% for specificity). According to simulations, δ(F, C) (%) was negative/positive depending on the level of confidence in incorrect diagnoses. Conclusion. Fuzzy evaluation shows a measurable effect of uncertainty on radiological diagnoses.

[1]  M. Giger,et al.  Cancerous breast lesions on dynamic contrast-enhanced MR images: computerized characterization for image-based prognostic markers. , 2010, Radiology.

[2]  C S Ng,et al.  Analysis of diagnostic confidence and diagnostic accuracy: a unified framework. , 2007, The British journal of radiology.

[3]  Nigel Harvey,et al.  Blackwell Handbook of Judgment and Decision Making , 2004 .

[4]  Eduardo Massad,et al.  ...and Beyond: Fuzzy Logic in Medical Diagnosis , 2008 .

[5]  Ralf Schulze,et al.  The efficacy of diagnostic imaging. , 2012, Dento maxillo facial radiology.

[6]  L. Kuncheva,et al.  Fuzzy diagnosis , 1999, Artif. Intell. Medicine.

[7]  Eduardo Massad,et al.  Fuzzy Rule-Based Models in Epidemiology , 2008 .

[8]  J Rousseau,et al.  Towards an accurate and robust method based on fuzzy logic principles for the reconstruction and quantification of large volumes from MR and CT images. , 2009, The British journal of radiology.

[9]  Lotfi A. Zadeh,et al.  A Theory of Approximate Reasoning , 1979 .

[10]  Jennifer K. Phillips,et al.  Expertise in Judgment and Decision Making: A Case for Training Intuitive Decision Skills , 2008 .

[11]  C. Palmer,et al.  Assessing diagnostic confidence: a comparative review of analytical methods. , 2008, Academic radiology.

[12]  Didier Dubois,et al.  The three semantics of fuzzy sets , 1997, Fuzzy Sets Syst..

[13]  Eduardo Massad,et al.  Basic Concepts of Fuzzy Sets Theory , 2008 .

[14]  A. Dixon,et al.  Measuring the effects of imaging: an evaluative framework. , 1995, Clinical radiology.

[15]  Fredric M. Wolf,et al.  Are Clinicians Correct When They Believe They are Correct? Implications for Medical Decision Support , 2001, MedInfo.

[16]  Raja Parasuraman,et al.  Fuzzy Signal Detection Theory: Basic Postulates and Formulas for Analyzing Human and Machine Performance , 2000, Hum. Factors.

[17]  Akebo Yamakami,et al.  Fuzzy Receiver Operating Characteristic Curve: An Option to Evaluate Diagnostic Tests , 2007, IEEE Transactions on Information Technology in Biomedicine.

[18]  L. Zadeh Fuzzy sets as a basis for a theory of possibility , 1999 .

[19]  Evangelos Triantaphyllou,et al.  Fuzzy logic in computer-aided breast cancer diagnosis: analysis of lobulation , 1997, Artif. Intell. Medicine.

[20]  C. Palmer,et al.  Analysis of diagnostic confidence: Application to data from a prospective randomized controlled trial of CT for acute abdominal pain , 2010, Acta radiologica.