Content based medical image retrieval using topic and location model

BACKGROUND AND OBJECTIVE Retrieval of medical images from an anatomically diverse dataset is a challenging task. Objective of our present study is to analyse the automated medical image retrieval system incorporating topic and location probabilities to enhance the performance. MATERIALS AND METHODS In this paper, we present an automated medical image retrieval system using Topic and Location Model. The topic information is generated using Guided Latent Dirichlet Allocation (GuidedLDA) method. A novel Location Model is proposed to incorporate the spatial information of visual words. We also introduce a new metric called position weighted Precision (wPrecision) to measure the rank order of the retrieved images. RESULTS Experiments on two large medical image datasets - IRMA 2009 and Multimodal dataset - revealed that the proposed method outperforms existing medical image retrieval systems in terms of Precision and Mean Average Precision. The proposed method achieved better Mean Average Precision (86.74%) compared to the recent medical image retrieval systems using the Multimodal dataset with 7200 images. The proposed system achieved better Precision (97.5%) for top ten images compared to the recent medical image retrieval systems using IRMA 2009 dataset with 14,410 images. CONCLUSION Supplementing spatial details of visual words to the Topic Model enhances the retrieval efficiency of medical images from large repositories. Such automated medical image retrieval systems can be used to assist physician to retrieve medical images with better precision compared to the state-of-the-art retrieval systems.

[1]  David Dagan Feng,et al.  Content-Based Medical Image Retrieval: A Survey of Applications to Multidimensional and Multimodality Data , 2013, Journal of Digital Imaging.

[2]  Thomas Hofmann,et al.  Learning the Similarity of Documents: An Information-Geometric Approach to Document Retrieval and Categorization , 1999, NIPS.

[3]  Mei Chen,et al.  Dictionary pruning with visual word significance for medical image retrieval , 2016, Neurocomputing.

[4]  M. Grgic,et al.  Overview of the DICOM standard , 2008, 2008 50th International Symposium ELMAR.

[5]  Guy Cazuguel,et al.  FEEDBACK ON A PUBLICLY DISTRIBUTED IMAGE DATABASE: THE MESSIDOR DATABASE , 2014 .

[6]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[7]  Sidong Liu,et al.  Pairwise Latent Semantic Association for Similarity Computation in Medical Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[8]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[9]  Hayit Greenspan,et al.  Content-Based Image Retrieval in Radiology: Current Status and Future Directions , 2010, Journal of Digital Imaging.

[10]  C H Cao,et al.  The research on medical image classification algorithm based on PLSA-BOW model. , 2016, Technology and health care : official journal of the European Society for Engineering and Medicine.

[11]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[12]  Henning Müller,et al.  Medical image retrieval using bag of meaningful visual words: unsupervised visual vocabulary pruning with PLSA , 2013, MIIRH '13.

[13]  Michael Kohnen,et al.  The IRMA code for unique classification of medical images , 2003, SPIE Medical Imaging.

[14]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[15]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[16]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[17]  Hamid R. Tizhoosh,et al.  Autoencoding the retrieval relevance of medical images , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[18]  Hal Daumé,et al.  Incorporating Lexical Priors into Topic Models , 2012, EACL.

[19]  Degui Xiao,et al.  Medical Image Retrieval: A Multimodal Approach , 2014, Cancer informatics.

[20]  Zhiguo Jiang,et al.  Breast Histopathological Image Retrieval Based on Latent Dirichlet Allocation , 2017, IEEE Journal of Biomedical and Health Informatics.

[21]  Fabio A. González,et al.  A Visual Latent Semantic Approach for Automatic Analysis and Interpretation of Anaplastic Medulloblastoma Virtual Slides , 2012, MICCAI.

[22]  Muhammad Awais,et al.  Medical image retrieval using deep convolutional neural network , 2017, Neurocomputing.

[23]  T. Caliński,et al.  A dendrite method for cluster analysis , 1974 .

[24]  Grigorios Tsoumakas,et al.  A Comprehensive Study Over VLAD and Product Quantization in Large-Scale Image Retrieval , 2014, IEEE Transactions on Multimedia.

[25]  Michele Tansella,et al.  Brain Morphometry by Probabilistic Latent Semantic Analysis , 2010, MICCAI.

[26]  C. Krishna Mohan,et al.  Content based medical image retrieval using dictionary learning , 2015, Neurocomputing.

[27]  S. Dumais Latent Semantic Analysis. , 2005 .