Content-based image retrieval for pulmonary computed tomography nodule images

Research studies have shown that advances in computed tomography (CT) technology allow better detection of pulmonary nodules by generating higher-resolution images. However, the new technology also generates many more individual transversal reconstructions, which as a result may affect the efficiency and accuracy of the radiologists interpreting these images. The goal of our research study is to build a content-based image retrieval (CBIR) system for pulmonary CT nodules. Currently, texture is used to quantify the image content, but any other image feature could be incorporated into the proposed system. Unfortunately, there is no texture model or similarity measure known to work best for encoding nodule texture properties or retrieving most similar nodules. Therefore, we investigated and evaluated several texture models and similarity measures with respect to nodule size, number of retrieved nodules, and radiologist agreement on the nodules' texture characteristic. The results were generated on 90 thoracic CT scans collected by the Lung Image Database Consortium (LIDC). Every case was annotated by up to four radiologists marking the contour of nodules and assigning nine characteristics (including texture) to each identified nodule. We found that Gabor texture descriptors produce the best retrieval results regardless of the nodule size, number of retrieved items or similarity metric. Furthermore, when analyzing the radiologists' agreement on the texture characteristic, we found that when just two radiologists agreed, the average precision increased from 88% to 96% for both Gabor and Markov texture features. Moreover, once three or four radiologists agreed the precision increased to nearly 100%.

[1]  A. Kak,et al.  Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. , 2003, Radiology.

[2]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  O. Miettinen,et al.  Early Lung Cancer Action Project: overall design and findings from baseline screening , 1999, The Lancet.

[4]  Carla E. Brodley,et al.  ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image Databases , 1999, Comput. Vis. Image Underst..

[5]  Johan Montagnat,et al.  Texture based medical image indexing and retrieval: application to cardiac imaging , 2004, MIR '04.

[6]  Jacob D. Furst,et al.  Wavelet-based texture classification of tissues in computed tomography , 2005, 18th IEEE Symposium on Computer-Based Medical Systems (CBMS'05).

[7]  D. Hansell,et al.  Obstructive lung diseases: texture classification for differentiation at CT. , 2003, Radiology.

[8]  U. G. Dailey.  Cancer,Facts and Figures about. , 2022, Journal of the National Medical Association.

[9]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[10]  Jia-Shung Wang,et al.  A content-based CT lung image retrieval system for assisting differential diagnosis images collection , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[11]  Joachim M. Buhmann,et al.  Non-parametric similarity measures for unsupervised texture segmentation and image retrieval , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Carla E. Brodley,et al.  Testing for human perceptual categories in a physician-in-the-loop CBIR system for medical imagery , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[14]  Seung-Moo Noh,et al.  Pulmonary nodule detection using chest CT images. , 2003, Acta radiologica.

[15]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[16]  DeLiang Wang,et al.  Texture segmentation using Gaussian-Markov random fields and neural oscillator networks , 2001, IEEE Trans. Neural Networks.

[17]  Carla E. Brodley,et al.  Local versus global features for content-based image retrieval , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[18]  Volkan Atalay,et al.  Unsupervised segmentation of gray level Markov model textures with hierarchical self organizing maps , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[19]  David A. Clausi,et al.  Designing Gabor filters for optimal texture separability , 2000, Pattern Recognit..

[20]  Hamid Abrishami Moghaddam,et al.  A New Segmentation Method for Lung HRCT Images , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[21]  Seung-Moo Noh,et al.  Pulmonary nodule detection using chest CT images , 2003 .

[22]  L. Rodney Long,et al.  Content-Based Image Retrieval for Large Biomedical Image Archives , 2004, MedInfo.

[23]  J. Furst,et al.  Pixel-Based Texture Classification of Tissues in Computed Tomography , 2006 .

[24]  C. Bouman.  Markov Random Fields and Stochastic Image Models , 1995 .

[25]  Kobus Barnard,et al.  Evaluating image retrieval , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  K. Doi,et al.  Usefulness of an artificial neural network for differentiating benign from malignant pulmonary nodules on high-resolution CT: evaluation with receiver operating characteristic analysis. , 2002, AJR. American journal of roentgenology.

[27]  Noboru Niki,et al.  Pulmonary Nodule Classification Based on Nodule Retrieval from 3-D Thoracic CT Image Database , 2004, MICCAI.

[28]  Ajai Jain,et al.  The Handbook of Pattern Recognition and Computer Vision , 1993 .

[29]  Tomasz Andrysiak,et al.  Image retrieval based on hierarchical Gabor filters , 2005 .

[30]  Richard C. Dubes,et al.  Performance evaluation for four classes of textural features , 1992, Pattern Recognit..

[31]  Carla E. Brodley,et al.  Unsupervised Feature Selection Applied to Content-Based Retrieval of Lung Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Lionel Brunie,et al.  Content-based and metadata retrieval in medical image database , 2002, Proceedings of 15th IEEE Symposium on Computer-Based Medical Systems (CBMS 2002).

[33]  Hermann Ney,et al.  Features for Image Retrieval: A Quantitative Comparison , 2004, DAGM-Symposium.

[34]  Michal Strzelecki,et al.  Texture Analysis Methods - A Review , 1998 .