Bag of temporal co-occurrence words for retrieval of focal liver lesions using 3D multiphase contrast-enhanced CT images

Computer-aided diagnosis (CAD) systems have been verified to have the potential to assist radiologists in clinical diagnosis to detect and characterize focal liver lesions (FLLs) based on single- or multiphase contrast-enhanced computed tomography (CT) images. Features extracted from multiphase contrast-enhanced CT images carry more important diagnostic information i.e. enhancement pattern and demonstrate much stronger discriminative ability compared to those of single-phase CT images. In this paper, we propose a new method for multiphase image feature generation called the bag of temporal co-occurrence words (BoTCoW). A temporal co-occurrence image connecting intensity from multiphase images is constructed. Then the bag of visual word (BoVW) model is employed on the temporal co-occurrence images to extract temporal features. The proposed method effectively captures temporal enhancement information and demonstrates the distribution of the evolution patterns. The effectiveness of this method is validated in a retrieval system using 132 FLLs with confirmed pathology type. The preliminary results show that the proposed BoTCoW method outperforms the previously proposed temporal features and multiphase features based on the BoVW model.

[1]  Yen-Wei Chen,et al.  Non-rigid image registration with anatomical structure constraint for assessing locoregional therapy of hepatocellular carcinoma , 2015, Comput. Medical Imaging Graph..

[2]  Qianjin Feng,et al.  Content-Based Retrieval of Focal Liver Lesions Using Bag-of-Visual-Words Representations of Single- and Multiphase Contrast-Enhanced CT Images , 2012, Journal of Digital Imaging.

[3]  H. Greenspan,et al.  Automated retrieval of CT images of liver lesions on the basis of image similarity: method and preliminary results. , 2010, Radiology.

[4]  Hayit Greenspan,et al.  Content-Based Image Retrieval in Radiology: Current Status and Future Directions , 2010, Journal of Digital Imaging.

[5]  Yanling Chi,et al.  Content-based image retrieval of multiphase CT images for focal liver lesion characterization. , 2013, Medical physics.

[6]  Jian Wang,et al.  Combined Density, Texture and Shape Features of Multi-phase Contrast-Enhanced CT Images for CBIR of Focal Liver Lesions: A Preliminary Study , 2016 .

[7]  Hayit Greenspan,et al.  Improved Patch-Based Automated Liver Lesion Classification by Separate Analysis of the Interior and Boundary Regions , 2016, IEEE Journal of Biomedical and Health Informatics.

[8]  Michael S. Brown,et al.  Three-Dimensional Spatiotemporal Features for Fast Content-Based Retrieval of Focal Liver Lesions , 2014, IEEE Transactions on Biomedical Engineering.

[9]  Hayit Greenspan,et al.  Multi-phase liver lesions classification using relevant visual words based on mutual information , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[10]  Yang Gao,et al.  Extraction of Lesion-Partitioned Features and Retrieval of Contrast-Enhanced Liver Images , 2012, Comput. Math. Methods Medicine.

[11]  Yanling Chi,et al.  Three-Dimensional Spatio-Temporal Features for Fast Content-based Retrieval of Focal Liver Lesions , 2014 .

[12]  Yen-Wei Chen,et al.  Simultaneous Segmentation of Multiple Organs Using Random Walks , 2016, J. Inf. Process..