A review of intelligent content-based indexing and browsing of medical images

Physicians are beginning to be able to gain access, through the Internet, to the world’s collections of multimedia medical information such as MRI (magnetic resonance imaging) and CT (computer tomography) image archives, videos of surgical operations and medical lectures, textual patient records and media annotations. New techniques and tools are needed to represent, index, store and retrieve digital content efficiently across large collections. In this review, we trace the development of visual information systems for healthcare and medicine from Picture Archiving and Communications Systems (PACS) to the recent advances in content-based image retrieval, whereby images are retrieved based on their visual content similarity - that is, colour, texture, and shape. Medical images, unlike consumer-oriented images, pose additional challenges to content-based image retrieval, in that visual features of normal and pathological images are typically separated by only subtle differences in visual appearance. Intelligent image retrieval and browsing therefore requires a combination of prior knowledge of the medical domain, image content and image annotation analysis. To this end, we also overview the I-Browse project, conducted jointly by the Clinical School of the University of Cambridge and the City University of Hong Kong, which aims to develop techniques which enable a physician to search over image archives through a combination of semantic and iconic contents.

[1]  D. Yun,et al.  Holographic image archive. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[2]  A. Deruyver,et al.  “True” three dimensional image labeling: semantic graph and arc consistency , 1995 .

[3]  Alexa T. McCray,et al.  The Image Engine HPCC project. A medical digital library system using agent-based technology to create an integrated view of the electronic medical record , 1996, Proceedings of the Third Forum on Research and Technology Advances in Digital Libraries,.

[4]  Don R. Hush,et al.  Query by image example: The CANDID approach , 1995 .

[5]  H.-G. Stark,et al.  Image indexing and content-based access to databases of medical images with wavelets , 1995, Optics + Photonics.

[6]  A. Tchounikine.  Creation and content-based retrieval in a radiological documentary record , 1997, Proceedings of the Third Basque International Workshop on Information Technology - BIWIT'97 - Data Management Systems.

[7]  H K Huang,et al.  Design methods and architectural issues of integrated medical image data base systems. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[8]  Rudolf Hanka,et al.  System architecture for integrating semantic and iconic content for intelligent browsing of medical images , 1998, Medical Imaging.

[9]  Thomas C. Henderson,et al.  Arc and Path Consistency Revisited , 1986, Artif. Intell..

[10]  Ramesh Jain,et al.  Storage and Retrieval for Image and Video Databases III , 1995 .

[11]  S S Cross,et al.  FRACTALS IN PATHOLOGY , 1997, The Journal of pathology.

[12]  S K Chang.  Active index for content-based medical image retrieval. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[13]  S C Orphanoudakis,et al.  I2Cnet: Content-based similarity search in geographically distributed repositories of medical images. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[14]  Euripides G. M. Petrakis,et al.  Similarity Searching in Medical Image Databases , 1997, IEEE Trans. Knowl. Data Eng..

[15]  Alberto Del Bimbo,et al.  Iconic Retrievial by Contents from Databases of Cardiological Sequences , 1997, VDB.

[16]  Y. K. Tang,et al.  Intelligent retrieval of medical images from the Internet , 1996, Medical Imaging.

[17]  E H Shortliffe,et al.  Biomedical imaging and the evolution of medical informatics. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[18]  Ron D. Appel,et al.  In-house access to PACS images and related data through World Wide Web , 1996 .

[19]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[20]  R De Dominicis,et al.  Integrating content-based retrieval in a medical image reference database. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[21]  H. Tagare,et al.  Medical image collection indexing: shape-based retrieval using KD-trees. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[22]  A Toga,et al.  A 3D medical image database management system. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[23]  Michael Unser,et al.  Wavelet Applications in Signal and Image Processing III , 1994 .

[24]  Michael H. Goldbaum,et al.  Content-based retrieval of ophthalmological images , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[25]  John Impagliazzo,et al.  Wavelet image compression algorithm for side-scan sonar and teleradiology , 1995, Defense, Security, and Sensing.

[26]  L. Rodney Long,et al.  Distributed data collection for a database of radiological image interpretations , 1997, Electronic Imaging.

[27]  Jeffrey E. Boyd,et al.  Automated diagnosis and image understanding with object extraction, object classification, and inferencing in retinal images , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[28]  Marco Fruscione,et al.  PARCS: Parallel Picture Archiving and Communication System , 1994, HPCN.

[29]  E. Gelsema,et al.  Estimation of fractal dimension in radiographs. , 1996, Medical physics.

[30]  Nihat M. Bilgutay,et al.  Multiresolution techniques for ultrasonic imaging , 1994, 1994 Proceedings of IEEE Ultrasonics Symposium.

[31]  Lewis E. Berman,et al.  A client/server system for Internet access to biomedical text/image databanks. , 1996, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[32]  A. Flory,et al.  Semantic interrogation for a radiological documentary record , 1997, Proceedings of Computer Based Medical Systems.

[33]  Arthur Petrosian,et al.  The analysis of EEG texture content for seizure prediction , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.