Case-based lung image categorization and retrieval for interstitial lung diseases: clinical workflows

PurposeClinical workflows and user interfaces of image-based computer-aided diagnosis (CAD) for interstitial lung diseases in high-resolution computed tomography are introduced and discussed.MethodsThree use cases are implemented to assist students, radiologists, and physicians in the diagnosis workup of interstitial lung diseases.ResultsIn a first step, the proposed system shows a three-dimensional map of categorized lung tissue patterns with quantification of the diseases based on texture analysis of the lung parenchyma. Then, based on the proportions of abnormal and normal lung tissue as well as clinical data of the patients, retrieval of similar cases is enabled using a multimodal distance aggregating content-based image retrieval (CBIR) and text-based information search. The global system leads to a hybrid detection-CBIR-based CAD, where detection-based and CBIR-based CAD show to be complementary both on the user’s side and on the algorithmic side.ConclusionsThe proposed approach is in accordance with the classical workflow of clinicians searching for similar cases in textbooks and personal collections. The developed system enables objective and customizable inter-case similarity assessment, and the performance measures obtained with a leave-one-patient-out cross-validation (LOPO CV) are representative of a clinical usage of the system.

[1]  Henning Müller,et al.  3D lung image retrieval using localized features , 2011, Medical Imaging.

[2]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[3]  K. Doi,et al.  Quantitative computerized analysis of diffuse lung disease in high-resolution computed tomography. , 2003, Medical physics.

[4]  J G Mazoué,et al.  Diagnosis without doctors. , 1990, The Journal of medicine and philosophy.

[5]  Chii Tung Liu,et al.  A content-based medical teaching file assistant for CT lung image retrieval , 2000, ICECS 2000. 7th IEEE International Conference on Electronics, Circuits and Systems (Cat. No.00EX445).

[6]  Henning Müller,et al.  Fusing visual and clinical information for lung tissue classification in high-resolution computed tomography , 2010, Artif. Intell. Medicine.

[7]  P. Meyers,et al.  AUTOMATED COMPUTER ANALYSIS OF RADIOGRAPHIC IMAGES. , 1964, Radiology.

[8]  A. Baert,et al.  [High-resolution CT of the lung]. , 1991, Rontgenpraxis; Zeitschrift fur radiologische Technik.

[9]  Andrea F. Abate,et al.  A Visual Query-by-Example Image Database for Chest CT Images: Potential Role as a Decision and Educational Support Tool for Radiologists , 2004, Journal of Digital Imaging.

[10]  K. Doi,et al.  Computer-aided diagnosis in chest radiography: results of large-scale observer tests at the 1996-2001 RSNA scientific assemblies. , 2003, Radiographics : a review publication of the Radiological Society of North America, Inc.

[11]  A. Kak,et al.  Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. , 2003, Radiology.

[12]  Jinbo Bi,et al.  An adaptive knowledge-driven medical image search engine for interactive diffuse parenchymal lung disease quantification , 2009, Medical Imaging.

[13]  Robert M. Nishikawa,et al.  Current status and future directions of computer-aided diagnosis in mammography , 2007, Comput. Medical Imaging Graph..

[14]  B. van Ginneken,et al.  Computer-aided diagnosis in high resolution CT of the lungs. , 2003, Medical physics.

[15]  Nicholas Ayache,et al.  Medical Image Analysis: Progress over Two Decades and the Challenges Ahead , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.

[17]  H R Warner,et al.  Innovation review: Iliad--a medical diagnostic support program. , 1994, Topics in health information management.

[18]  Thomas Martin Deserno,et al.  Integration of CBIR in radiological routine in accordance with IHE , 2009, Medical Imaging.

[19]  Timothy M. Franz,et al.  Enhancement of clinicians' diagnostic reasoning by computer-based consultation: a multisite study of 2 systems. , 1999, JAMA.

[20]  Randolph A. Miller,et al.  Review: Medical Diagnostic Decision Support Systems - Past, Present, And Future: A Threaded Bibliography and Brief Commentary , 1994, J. Am. Medical Informatics Assoc..

[21]  Antoine Geissbühler,et al.  Building a reference multimedia database for interstitial lung diseases , 2012, Comput. Medical Imaging Graph..

[22]  Henning Müller,et al.  Fusion Techniques for Combining Textual and Visual Information Retrieval , 2010, ImageCLEF.

[23]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[24]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[25]  Hermann Ney,et al.  Statistical framework for model-based image retrieval in medical applications , 2003, J. Electronic Imaging.

[26]  E. Hoffman,et al.  Characterization of the interstitial lung diseases via density-based and texture-based analysis of computed tomography images of lung structure and function. , 2003, Academic radiology.

[27]  Marcelo Ossamu Honda,et al.  Implementação e avaliação de um sistema de gerenciamento de imagens médicas com suporte à recuperação baseada em conteúdo , 2008 .

[28]  Drummond Rennie,et al.  Comprar The Rational Clinical Examination: Evidence-Based Clinical Diagnosis | David Simel | 9780071590303 | Mcgraw-Hill Education , 2008 .

[29]  J B Lemaire,et al.  Effectiveness of the Quick Medical Reference as a diagnostic tool. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[30]  W. Scott Comulada,et al.  Breast cancer detection: radiologists’ performance using mammography with and without automated whole-breast ultrasound , 2010, European Radiology.

[31]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  T. Vomweg,et al.  Computer-Aided Diagnosis: Clinical Applications in the Breast , 2008 .

[33]  Carla E. Brodley,et al.  ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image Databases , 1999, Comput. Vis. Image Underst..

[34]  R. Salgado,et al.  Volume rendering in clinical practice. a pictorial review. , 2003, JBR-BTR : organe de la Societe royale belge de radiologie (SRBR) = orgaan van de Koninklijke Belgische Vereniging voor Radiologie.

[35]  H. Müller,et al.  Informatics in radiology (infoRAD): benefits of content-based visual data access in radiology. , 2005, Radiographics : a review publication of the Radiological Society of North America, Inc.

[36]  R. Engle,et al.  Attempts to Use Computers as Diagnostic Aids in Medical Decision Making: A Thirty-Year Experience , 2015, Perspectives in biology and medicine.

[37]  Paulo Mazzoncini de Azevedo Marques,et al.  Towards applying content-based image retrieval in the clinical routine , 2007, Future Gener. Comput. Syst..

[38]  P. Meyers,et al.  AUTOMATED COMPUTER ANALYSIS OF RADIOGRAPHIC IMAGES. , 1964, Archives of environmental health.

[39]  J. Concato Evidence-Based Medical Monitoring: From Principles to Practice , 2009, Annals of Internal Medicine.

[40]  Marcelo Ossamu Honda,et al.  Implementation and evaluation of a medical image management system with content-based retrieval support * , 2008 .

[41]  Giuseppe De Pietro,et al.  Toward a natural interface to virtual medical imaging environments , 2008, AVI '08.

[42]  Antoine Geissbühler,et al.  3D Case-Based Retrieval for Interstitial Lung Diseases , 2009, MCBR-CDS.

[43]  William B. Thompson,et al.  Computer Diagnosis of Pneumoconiosis , 1974, IEEE Trans. Syst. Man Cybern..