Evaluation of shape indexing methods for content-based retrieval of x-ray images

Efficient content-based image retrieval of biomedical images is a challenging problem of growing research interest. Feature representation algorithms used in indexing medical images on the pathology of interest have to address conflicting goals of reducing feature dimensionality while retaining important and often subtle biomedical features. At the Lister Hill National Center for Biomedical Communications, a R&D division of the National Library of Medicine, we are developing a content-based image retrieval system for digitized images of a collection of 17,000 cervical and lumbar x-rays taken as a part of the second National Health and Nutrition Examination Survey (NHANES II). Shape is the only feature that effectively describes various pathologies identified by medical experts as being consistently and reliably found in the image collection. In order to determine if the state of the art in shape representation methods is suitable for this application, we have evaluated representative algorithms selected from the literature. The algorithms were tested on a subset of 250 vertebral shapes. In this paper we present the requirements of an ideal algorithm, define the evaluation criteria, and present the results and our analysis of the evaluation. We observe that while the shape methods perform well on visual inspection of the overall shape boundaries, they fall short in meeting the needs of determining similarity between the vertebral shapes based on the pathology.

[1]  L. Rodney Long,et al.  A Biomedical Information System for Combined Content-Based Retrieval of Spine X-Ray Images, Associated Text Information , 2002, ICVGIP.

[2]  L. Rodney Long,et al.  Landmarking and feature localization in spine x-rays , 2001, J. Electronic Imaging.

[3]  Michael S. Lew,et al.  IRUS: image retrieval using shape , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[4]  George R. Thoma,et al.  Method of content-based image retrieval for a spinal x-ray image database , 2002, SPIE Medical Imaging.

[5]  Moncef Gabbouj,et al.  Wavelet-based corner detection technique using optimal scale , 2002, Pattern Recognit. Lett..

[6]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[7]  Esther M. Arkin,et al.  An efficiently computable metric for comparing polygonal shapes , 1991, SODA '90.

[8]  Ehud Rivlin,et al.  Invariant-Based Shape Retrieval in Pictorial Databases , 1998, Comput. Vis. Image Underst..

[9]  Anil K. Jain,et al.  Shape-Based Retrieval: A Case Study With Trademark Image Databases , 1998, Pattern Recognit..

[10]  Ramesh C. Jain,et al.  A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video , 2002, Pattern Recognit..

[11]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[12]  L. Rodney Long,et al.  Indexing of image content in spine x rays , 1999, Electronic Imaging.

[13]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[14]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[15]  Anil K. Jain,et al.  Object Matching Using Deformable Templates , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Rajiv Mehrotra,et al.  Similar-Shape Retrieval in Shape Data Management , 1995, Computer.

[17]  Farzin Mokhtarian,et al.  A Theory of Multiscale, Curvature-Based Shape Representation for Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Edward K. Wong,et al.  Content-based image retrieval by scale-space object boundary shape representation , 1999, Electronic Imaging.

[19]  Farzin Mokhtarian Scale-based description and recognition of planar curves , 1984 .

[20]  Hans-Peter Kriegel,et al.  State-of-the-Art in Content-Based Image and Video Retrieval , 2001, Computational Imaging and Vision.

[21]  Paul L. Rosin,et al.  Comparison of the effectiveness of alternative feature sets in shape retrieval of multicomponent images , 2001, IS&T/SPIE Electronic Imaging.

[22]  Longin Jan Latecki,et al.  Shape Description and Search for Similar Objects in Image Databases , 1999, State-of-the-Art in Content-Based Image and Video Retrieval.

[23]  L. Rodney Long,et al.  Feature indexing in a database of digitized x rays , 2001, IS&T/SPIE Electronic Imaging.

[24]  Thomas Martin Deserno,et al.  Content-based image retrieval in medical applications: a novel multistep approach , 1999, Electronic Imaging.

[25]  A. Murat Tekalp,et al.  Shape similarity matching for query-by-example , 1998, Pattern Recognit..

[26]  Alberto Del Bimbo,et al.  Shape indexing by multi-scale representation , 1999, Image Vis. Comput..