Multi-modal Information Retrieval for Content-based Medical Image and Video Data Mining

Image based medical diagnosis plays an important role in improving the quality of health-care industry. Content based image retrieval (CBIR) has been successfully implemented in medical fields to help physicians in training and surgery. Many radiological and pathological images and videos are generated by hospitals, universities and medical centers with sophisticated image acquisition devices. Images and Videos that help senior or junior physician to practice medical surgery become more and more popular and easier to access through different ways. To help learn the process of a surgery or even make decisions is one of the main objectives of the content based image and video retrieval system. In this paper, a contented-based multimodal medical video retrieval system (CBMVR) for medical image and video databases is addressed. Some key issues are discussed. A new feature representation method named Artificial Potential Field (APF) is addressed which is specially useful in symmetrical imaging feature extraction. Experimental results show that, with this CBMVR, both the senior and junior physicians can benefit from the mass data of medical images and videos.

[1]  David Dagan Feng,et al.  Content-based retrieval of dynamic PET functional images , 2000, IEEE Transactions on Information Technology in Biomedicine.

[2]  Tomaso Poggio,et al.  Generalization in vision and motor control , 2004, Nature.

[3]  R De Dominicis,et al.  Integrating content-based retrieval in a medical image reference database. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[4]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[5]  Yanxi Liu,et al.  Robust midsagittal plane extraction from normal and pathological 3-D neuroradiology images , 2001, IEEE Transactions on Medical Imaging.

[6]  S C Orphanoudakis,et al.  I2C: a system for the indexing, storage, and retrieval of medical images by content. , 1994, Medical informatics = Medecine et informatique.

[7]  B. Vasudev,et al.  Spatiotemporal sequence matching for efficient video copy detection , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[9]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[10]  Jérome Fournier,et al.  Exploration and search-by-similarity in CBIR , 2003, 16th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI 2003).

[11]  Thierry Pun,et al.  Content-based query of image databases: inspirations from text retrieval , 2000, Pattern Recognit. Lett..

[12]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..