Interactive radiographic image retrieval system

BACKGROUND AND OBJECTIVE Content based medical image retrieval (CBMIR) systems enable fast diagnosis through quantitative assessment of the visual information and is an active research topic over the past few decades. Most of the state-of-the-art CBMIR systems suffer from various problems: computationally expensive due to the usage of high dimensional feature vectors and complex classifier/clustering schemes. Inability to properly handle the "semantic gap" and the high intra-class versus inter-class variability problem of the medical image database (like radiographic image database). This yields an exigent demand for developing highly effective and computationally efficient retrieval system. METHODS We propose a novel interactive two-stage CBMIR system for diverse collection of medical radiographic images. Initially, Pulse Coupled Neural Network based shape features are used to find out the most probable (similar) image classes using a novel "similarity positional score" mechanism. This is followed by retrieval using Non-subsampled Contourlet Transform based texture features considering only the images of the pre-identified classes. Maximal information compression index is used for unsupervised feature selection to achieve better results. To reduce the semantic gap problem, the proposed system uses a novel fuzzy index based relevance feedback mechanism by incorporating subjectivity of human perception in an analytic manner. RESULTS Extensive experiments were carried out to evaluate the effectiveness of the proposed CBMIR system on a subset of Image Retrieval in Medical Applications (IRMA)-2009 database consisting of 10,902 labeled radiographic images of 57 different modalities. We obtained overall average precision of around 98% after only 2-3 iterations of relevance feedback mechanism. We assessed the results by comparisons with some of the state-of-the-art CBMIR systems for radiographic images. CONCLUSIONS Unlike most of the existing CBMIR systems, in the proposed two-stage hierarchical framework, main importance is given on constructing efficient and compact feature vector representation, search-space reduction and handling the "semantic gap" problem effectively, without compromising the retrieval performance. Experimental results and comparisons show that the proposed system performs efficiently in the radiographic medical image retrieval field.

[1]  Minh N. Do,et al.  The Nonsubsampled Contourlet Transform: Theory, Design, and Applications , 2006, IEEE Transactions on Image Processing.

[2]  Hong Zhao,et al.  A New Two-Step Method for Medical Image Retrieval , 2009, 2009 International Conference on Information Technology and Computer Science.

[3]  Bipin C. Desai,et al.  A Framework for Medical Image Retrieval Using Machine Learning and Statistical Similarity Matching Techniques With Relevance Feedback , 2007, IEEE Transactions on Information Technology in Biomedicine.

[4]  Chaoqun Hong,et al.  Hypergraph-based multi-example ranking with sparse representation for transductive learning image retrieval , 2013, Neurocomputing.

[5]  George R. Thoma,et al.  A Learning-Based Similarity Fusion and Filtering Approach for Biomedical Image Retrieval Using SVM Classification and Relevance Feedback , 2011, IEEE Transactions on Information Technology in Biomedicine.

[6]  Henning Müller,et al.  Evaluating performance of biomedical image retrieval systems - An overview of the medical image retrieval task at ImageCLEF 2004-2013 , 2015, Comput. Medical Imaging Graph..

[7]  Seong-Hoon Kim,et al.  X-ray Image Classification Using Random Forests with Local Wavelet-Based CS-Local Binary Patterns , 2011, Journal of Digital Imaging.

[8]  Hermann Ney,et al.  FIRE in ImageCLEF 2005: Combining Content-based Image Retrieval with Textual Information Retrieval , 2005, CLEF.

[9]  Hamid R. Tizhoosh,et al.  Generating binary tags for fast medical image retrieval based on convolutional nets and Radon Transform , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[10]  Khan M. Iftekharuddin,et al.  Mega voltage X-ray image segmentation and ambient noise removal , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[11]  Haralampos Karanikas,et al.  A Pattern Similarity Scheme for Medical Image Retrieval , 2009, IEEE Transactions on Information Technology in Biomedicine.

[12]  Kui Wu,et al.  Fuzzy relevance feedback in content-based image retrieval systems using radial basis function network , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[13]  Hayit Greenspan,et al.  Content-Based Image Retrieval in Radiology: Current Status and Future Directions , 2010, Journal of Digital Imaging.

[14]  M A García-Pérez.  The perceived image: efficient modelling of visual inhomogeneity. , 1992, Spatial vision.

[15]  Hayit Greenspan,et al.  X-ray Categorization and Retrieval on the Organ and Pathology Level, Using Patch-Based Visual Words , 2011, IEEE Transactions on Medical Imaging.

[16]  Djemel Ziou,et al.  Fusion-based shape descriptor for weld defect radiographic image retrieval , 2013 .

[17]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[18]  David Dagan Feng,et al.  Content-Based Medical Image Retrieval: A Survey of Applications to Multidimensional and Multimodality Data , 2013, Journal of Digital Imaging.

[19]  Agma J. M. Traina,et al.  Using an image-extended relational database to support content-based image retrieval in a PACS , 2005, Comput. Methods Programs Biomed..

[20]  Michael Kohnen,et al.  Content-based image retrieval in medical applications for picture archiving and communication systems , 2003, SPIE Medical Imaging.

[21]  Hossein Pourghassem,et al.  Medical X-ray Image Hierarchical Classification Using a Merging and Splitting Scheme in Feature Space , 2013, Journal of medical signals and sensors.

[22]  Michael Kohnen,et al.  Quality of DICOM header information for image categorization , 2002, SPIE Medical Imaging.

[23]  C. Krishna Mohan,et al.  Content based medical image retrieval using dictionary learning , 2015, Neurocomputing.

[24]  Haejun Lee,et al.  Medical Image Retrieval: Past and Present , 2012, Healthcare informatics research.

[25]  Yide Ma,et al.  A New Automatic Parameter Setting Method of a Simplified PCNN for Image Segmentation , 2011, IEEE Transactions on Neural Networks.

[26]  S. Das,et al.  Effective classification of radiographic medical images using LS-SVM and NSCT based retrieval system , 2012, 2012 5th International Conference on Computers and Devices for Communication (CODEC).

[27]  Jessica J. Fridrich,et al.  On detection of median filtering in digital images , 2010, Electronic Imaging.

[28]  Thomas Martin Deserno,et al.  Generic integration of content-based image retrieval in computer-aided diagnosis , 2012, Comput. Methods Programs Biomed..

[29]  Antoine Geissbühler,et al.  Erratum to "A review of content-based image retrieval systems in medical applications - Clinical benefits and future directions" [I. J. Medical Informatics 73 (1) (2004) 1-23] , 2009, Int. J. Medical Informatics.

[30]  Hossein Pourghassem,et al.  Content-based medical image classification using a new hierarchical merging scheme , 2008, Comput. Medical Imaging Graph..

[31]  Edward Steven Jimenez,et al.  Exploring the feasibility of traditional image querying tasks for industrial radiographs , 2015, SPIE Optical Engineering + Applications.

[32]  John L. Johnson,et al.  PCNN models and applications , 1999, IEEE Trans. Neural Networks.

[33]  Hossein Pourghassem,et al.  Optimal Query-Based Relevance Feedback in Medical Image Retrieval Using Score Fusion-Based Classification , 2014, Journal of Digital Imaging.

[34]  Gwénolé Quellec,et al.  Wavelet optimization for content-based image retrieval in medical databases , 2010, Medical Image Anal..

[35]  Sankar K. Pal,et al.  Fuzzy Mathematical Approach to Pattern Recognition , 1986 .

[36]  Hayit Greenspan,et al.  Medical Image Categorization and Retrieval for PACS Using the GMM-KL Framework , 2007, IEEE Transactions on Information Technology in Biomedicine.

[37]  Lei Huang,et al.  MIAPS: A web-based system for remotely accessing and presenting medical images , 2014, Comput. Methods Programs Biomed..

[38]  C. A. Murthy,et al.  Unsupervised Feature Selection Using Feature Similarity , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[40]  Hermann Ney,et al.  Statistical framework for model-based image retrieval in medical applications , 2003, J. Electronic Imaging.

[41]  Dah-Jye Lee,et al.  Using relevance feedback with short-term memory for content-based spine X-ray image retrieval , 2009, Neurocomputing.

[42]  Bipin C. Desai,et al.  Medical image retrieval with probabilistic multi-class support vector machine classifiers and adaptive similarity fusion , 2008, Comput. Medical Imaging Graph..

[43]  Malay Kumar Kundu,et al.  An efficient radiographic Image Retrieval system using Convolutional Neural Network , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[44]  Hermann Ney,et al.  Automatic categorization of medical images for content-based retrieval and data mining. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.