Improving Performance of Medical Images Retrieval by Combining Textual and Visual Information

This paper studies the combination of textual and visual information in a database of medical records in order to improve the performance of the multi-modal information retrieval system. The proposed model consists of two subsystems: a content-based information retrieval subsystem that performs the image retrieval and a textual information retrieval subsystem that performs the textual retrieval. The images and text are independently retrieved and then the partial resulting lists are mixed. A study of different weighting schemes has been accomplished and analyzed. The results obtained show that the proper integration of textual information improves conventional multi-modal systems.

[1]  Thomas Martin Deserno,et al.  The CLEF 2005 Cross-Language Image Retrieval Track , 2005, CLEF.

[2]  Edward A. Fox,et al.  Combination of Multiple Searches , 1993, TREC.

[3]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[4]  Romaric Besançon,et al.  Using Text and Image Retrieval Systems. Lic2m experiments at ImageCLEF 2006 , 2006, CLEF.

[5]  Mark Sanderson,et al.  The CLEF 2004 Cross-Language Image Retrieval Track , 2004, CLEF.

[6]  L. A. Ureña-López,et al.  SINAI at ImageCLEF 2007 , 2007 .

[7]  Miguel Ángel García Cumbreras,et al.  SINAI at ImageCLEF 2005 , 2005, CLEF.

[8]  Paul Over,et al.  TRECVID 2006 Overview , 2006, TRECVID.

[9]  Gareth J. F. Jones,et al.  Dublin City University at CLEF 2006: Experiments for the ImageCLEF Photo Collection Standard Ad Hoc Task , 2006, CLEF.

[10]  Eugene Kim,et al.  Overview of the ImageCLEFmed 2006 Medical Retrieval and Annotation Tasks , 2006, CLEF.

[11]  Thierry Declerck,et al.  Contribution of NLP to the Content Indexing of Multimedia Documents , 2004, CIVR.

[12]  Thierry Pun,et al.  Content-based query of image databases: inspirations from text retrieval , 2000, Pattern Recognit. Lett..

[13]  Thomas Martin Deserno,et al.  The CLEF 2005 Cross-Language Image Retrieval Track , 2003, CLEF.

[14]  Maximilian Eibl,et al.  ImageCLEF 2006 Experiments at the Chemnitz Technical University , 2006, CLEF.

[15]  Bipin C. Desai,et al.  CINDI at ImageCLEF 2006: Image Retrieval & Annotation Tasks for the General Photographic and Medical Image Collections , 2006, CLEF.