Medical Visual Information Retrieval: State of the Art and Challenges Ahead

Today's medical institutions produce enormous amounts of data on patients, including multimedia data, which is increasingly produced in digital form. These data in their clinical context contain much information and experience that is currently not being used up to its full potential. Through the digital form the data has become accessible for automatic analysis and treatment for a variety of applications. At the same time, the variety of images produced can be confusing even for trained specialists causing an information overload exists for many medical doctors. This suggests that content-based image retrieval can be a valuable tool for helping manage these data and access the right information at the right time. This article gives a short state of the art of content-based medical image retrieval followed by a description of the medGIFT project on image retrieval with its main components. Then, several challenges are used to illustrate areas where much more work is currently needed to advance biomedical image retrieval. This shows that we have now progresses beyond the phase, where medical doctors transfer a database to computer scientists to only evaluate their algorithms. We conclude that visual information retrieval can have a real impact in the medical field if the techniques can adapt to this rapidly changing field and get integrated into the workflow in radiology and other medical fields.

[1]  Eugene Kim,et al.  Overview of the ImageCLEFmed 2006 Medical Retrieval and Medical Annotation Tasks , 2006, CLEF.

[2]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Carla E. Brodley,et al.  ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image Databases , 1999, Comput. Vis. Image Underst..

[4]  Hans Burkhardt,et al.  Image classification using cluster cooccurrence matrices of local relational features , 2006, MIR '06.

[5]  Li Yang-bing.  Content based image retrieval in PACS , 2006 .

[6]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[7]  Patrick Ruch,et al.  Model Formulation: Advancing Biomedical Image Retrieval: Development and Analysis of a Test Collection , 2006, J. Am. Medical Informatics Assoc..

[8]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[9]  T M Lehmann,et al.  Content-based Image Retrieval in Medical Applications , 2004, Methods of Information in Medicine.

[10]  Paul Over,et al.  TRECVID: evaluating the effectiveness of information retrieval tasks on digital video , 2004, MULTIMEDIA '04.

[11]  Paulo Mazzoncini de Azevedo Marques,et al.  Towards applying content-based image retrieval in the clinical routine , 2007, Future Gener. Comput. Syst..

[12]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[13]  Rudolf Hanka,et al.  A review of intelligent content-based indexing and browsing of medical images , 1999 .

[14]  R. Manmatha,et al.  Automatic image annotation and retrieval using cross-media relevance models , 2003, SIGIR.

[15]  Antoine Geissbühler,et al.  Image-based diagnostic aid for interstitial lung disease with secondary data integration , 2007, SPIE Medical Imaging.

[16]  Ronald M. Summers,et al.  Sharing images , 2003, Nature Methods.

[17]  A. Kak,et al.  Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. , 2003, Radiology.

[18]  Henry J. Lowe,et al.  Towards knowledge-based retrieval of medical images. The role of semantic indexing, image content representation and knowledge-based retrieval , 1998, AMIA.

[19]  Christos Faloutsos,et al.  Fast and Effective Retrieval of Medical Tumor Shapes , 1998, IEEE Trans. Knowl. Data Eng..

[20]  Wesley E. Snyder,et al.  Content-Based Image Retrieval in PACS , 1999 .

[21]  Henning Müllera,et al.  Health care professionals ’ image use and search behaviour , 2006 .