Content based radiology image retrieval using a fuzzy rule based scalable composite descriptor

The rapid advances made in the field of radiology, the increased frequency in which oncological diseases appear, as well as the demand for regular medical checks, led to the creation of a large database of radiology images in every hospital or medical center. There is now an imperative need to create an effective method for the indexing and retrieval of these images. This paper proposes a new method of content based radiology medical image retrieval. The description of images relies on a Fuzzy Rule Based Compact Composite Descriptor (CCD), which includes global image features capturing both brightness and texture characteristics in a 1D Histogram. Furthermore, the proposed descriptor includes the spatial distribution of the information it describes. The most important feature of the proposed descriptor is that its size adapts according to the storage capabilities of the application that uses it. Experiments carried out on a large group of images show that even at 48 bytes per image, the proposed descriptor demonstrates a high level of accuracy in its results. To evaluate the performance of the proposed feature, the mean average precision was used.

[1]  Hermann Ney,et al.  Features for image retrieval: an experimental comparison , 2008, Information Retrieval.

[2]  Yiannis S. Boutalis,et al.  CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval , 2008, ICVS.

[3]  Yiannis S. Boutalis,et al.  FCTH: Fuzzy Color and Texture Histogram - A Low Level Feature for Accurate Image Retrieval , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[4]  Zhongfei Zhang,et al.  Automatic medical image annotation and retrieval , 2008, Neurocomputing.

[5]  Marco Eichelberg,et al.  Digital Imaging and Communications in Medicine , 2010 .

[6]  Eros Comunello,et al.  Analyzing DICOM and non-DICOM Features in Content-Based Medical Image Retrieval: A Multi-Layer Approach , 2006, 19th IEEE Symposium on Computer-Based Medical Systems (CBMS'06).

[7]  Thomas Martin Deserno,et al.  Similarity of Medical Images Computed from Global Feature Vectors for Content-Based Retrieval , 2004, KES.

[8]  Dorin Comaniciu,et al.  Bimodal system for interactive indexing and retrieval of pathology images , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[9]  Yiannis S. Boutalis,et al.  A hybrid scheme for fast and accurate image retrieval based on color descriptors , 2007 .

[10]  Oleg S. Pianykh,et al.  Digital Imaging and Communications in Medicine : A Practical Introduction and Survival Guide , 2008 .

[11]  Antonios Gasteratos,et al.  Fast centre- surround contrast modification , 2008 .

[12]  SerratosaFrancesc,et al.  Signatures versus histograms , 2006 .

[13]  Nikos Papamarkos,et al.  Color image retrieval using a fractal signature extraction technique , 2002 .

[14]  Przemyslaw Prusinkiewicz,et al.  Lindenmayer Systems, Fractals, and Plants , 1989, Lecture Notes in Biomathematics.

[15]  Joachim M. Buhmann,et al.  Empirical evaluation of dissimilarity measures for color and texture , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  Mathias Lux,et al.  Img(Rummager): An Interactive Content Based Image Retrieval System , 2009, 2009 Second International Workshop on Similarity Search and Applications.

[17]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[18]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[19]  Fabio A. González,et al.  Design of a Medical Image Database with Content-Based Retrieval Capabilities , 2007, PSIVT.

[20]  Mathias Lux,et al.  Lire: lucene image retrieval: an extensible java CBIR library , 2008, ACM Multimedia.

[21]  Yiannis S. Boutalis,et al.  img(Anaktisi): A Web Content Based Image Retrieval System , 2009, 2009 Second International Workshop on Similarity Search and Applications.

[22]  Johan Montagnat,et al.  Texture based medical image indexing and retrieval: application to cardiac imaging , 2004, MIR '04.

[23]  Ricky K. Taira,et al.  Knowledge-Based Image Retrieval with Spatial and Temporal Constructs , 1998, IEEE Trans. Knowl. Data Eng..

[24]  Hermann Ney,et al.  FIRE in ImageCLEF 2005: Combining Content-based Image Retrieval with Textual Information Retrieval , 2005, CLEF.

[25]  Thomas Martin Deserno,et al.  Content-Based Retrieval of Medical Images by Combining Global Features , 2005, CLEF.

[26]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[27]  Hermann Ney,et al.  Comparison of global features for categorization of medical images , 2004, SPIE Medical Imaging.

[28]  James S. Duncan,et al.  Medical Image Analysis , 1999, IEEE Pulse.

[29]  Olivier Buisson,et al.  Z-grid-based probabilistic retrieval for scaling up content-based copy detection , 2007, CIVR '07.

[30]  Dorin Comaniciu,et al.  Bimodal system for interactive indexing and retrieval of pathology images , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[31]  Yiannis S. Boutalis,et al.  Content based medical image indexing and retrieval using a fuzzy compact Composite Descriptor , 2009 .

[32]  Hong Yan,et al.  Fuzzy Algorithms: With Applications to Image Processing and Pattern Recognition , 1996, Advances in Fuzzy Systems - Applications and Theory.

[33]  Christos Faloutsos,et al.  Fast and Effective Retrieval of Medical Tumor Shapes , 1998, IEEE Trans. Knowl. Data Eng..

[34]  D. Peck.  Digital Imaging and Communications in Medicine (DICOM): A Practical Introduction and Survival Guide , 2009, Journal of Nuclear Medicine.

[35]  Byung-Tae Chun,et al.  An effective method for combining multiple features of image retrieval , 1999, Proceedings of IEEE. IEEE Region 10 Conference. TENCON 99. 'Multimedia Technology for Asia-Pacific Information Infrastructure' (Cat. No.99CH37030).

[36]  Karl-Heinz Küfer,et al.  Content-based medical image retrieval (CBMIR): an intelligent retrieval system for handling multiple organs of interest , 2004, Proceedings. 17th IEEE Symposium on Computer-Based Medical Systems.

[37]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[38]  H. Sagan.  Space-filling curves , 1994 .

[39]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[40]  Claudio Gutierrez,et al.  Survey of graph database models , 2008, CSUR.

[41]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[43]  Thomas Martin Deserno,et al.  Automatic medical image annotation in ImageCLEF 2007: Overview, results, and discussion , 2008, Pattern Recognit. Lett..

[44]  C. Won,et al.  Efficient Use of MPEG‐7 Edge Histogram Descriptor , 2002 .

[45]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[46]  Alberto Sanfeliu,et al.  Signatures versus histograms: Definitions, distances and algorithms , 2006, Pattern Recognit..

[47]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .