Similar CT image retrieval method based on lesion nature and its three-dimensional distribution

In imaging diagnosis, radiologists refer to the CT images of the similar cases. However, it is a big burden for them to search such CT images from the huge numbers of CT images. To solve this problem, many retrieval methods of CT images have been developed. Most existing retrieval methods target cases in which lesions exist within a limited region of the lung. These methods retrieve similar cases by calculating the similarity to the region specified on a slice image of the query case, for example, solitary pulmonary nodules. However, radiologists diagnose not only such cases but also diffuse lung disease (DLD), where lesions exist throughout the lung. Radiologists diagnose DLDs by grasping the threedimensional (3D) distribution of lesion textures. However, the existing methods cannot retrieve similar DLDs. We propose a novel method that can retrieve morphologically similar cases based on the radiologist’s knowledge, how they diagnose DLDs. In the proposed method, we configure a 3D model for the central-peripheral region of a lung, represent the similarity for the 3D distribution of lesions as histograms, and then retrieve the cases of the similar histograms. We evaluate the average precision of the proposed method for DLD CT images. For the top 5 cases, the mean of the average precisions of the proposed method is 0.84 and is better than that of the method that only calculates the volume rate of the lesions in the lung (0.64). The proposed method retrieves similar DLDs based on 3D distribution of lesion textures and is expected to contribute to diagnosis support in clinical practice.

[1]  Marios Anthimopoulos,et al.  Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[2]  N. Müller,et al.  Diffuse Diseases of the Lung: A Team Approach , 1991 .

[3]  Rui Xu,et al.  A Sparse Representation Based Method to Classify Pulmonary Patterns of Diffuse Lung Diseases , 2015, Comput. Math. Methods Medicine.

[4]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[5]  Yamashita Youhei,et al.  Similar image search of diffuse lung diseases on 3D CT Images , 2014 .

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Yan Qiang,et al.  Rapid Retrieval of Lung Nodule CT Images Based on Hashing and Pruning Methods , 2016, BioMed research international.

[8]  Masahiro Endo,et al.  Content-based image-retrieval system in chest computed tomography for a solitary pulmonary nodule: method and preliminary experiments , 2012, International Journal of Computer Assisted Radiology and Surgery.

[9]  L. Kaur,et al.  Lung Nodule Retrieval by Integrating Local Binary Pattern with Template Matching , 2016 .

[10]  A. Kak,et al.  Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. , 2003, Radiology.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.