A classification based similarity metric for 3D image retrieval

We present a principled method of obtaining a weighted similarity metric for 3D image retrieval, firmly rooted in Bayes decision theory. The basic idea is to determine a set of most discriminative features by evaluating how well they perform on the task of classifying images according to predefined semantic categories. We propose this indirect method as a rigorous way to solve the difficult feature selection problem that comes up in most content based image retrieval tasks. The method is applied to normal and pathological neuroradiological CT images, where we take advantage of the fact that normal human brains present an approximate bilateral symmetry which is often absent in pathological brains. The quantitative evaluation of the retrieval system shows promising results.

[1]  Michael J. Swain,et al.  Interactive indexing into image databases , 1993, Electronic Imaging.

[2]  Christos Davatzikos,et al.  Spatial Transformation and Registration of Brain Images Using Elastically Deformable Models , 1997, Comput. Vis. Image Underst..

[3]  Peter E. Hart,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[4]  Takeo Kanade,et al.  Content-based 3D neuroradiologic image retrieval: preliminary results , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[5]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[6]  Yanxi Liu,et al.  Automatic bilateral symmetry (midsagittal) plane extraction from pathological 3D neuroradiological images , 1998, Medical Imaging.

[7]  Hiroshi Murase,et al.  Learning and recognition of 3D objects from appearance , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[8]  Vijay V. Raghavan,et al.  Content-Based Image Retrieval Systems - Guest Editors' Introduction , 1995, Computer.

[9]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[10]  Andrew W. Moore,et al.  Efficient Locally Weighted Polynomial Regression Predictions , 1997, ICML.

[11]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[12]  Daniel N. Hill,et al.  An Empirical Investigation of Brute Force to choose Features, Smoothers and Function Approximators , 1992 .

[13]  G. Marchal,et al.  Multi-modal volume registration by maximization of mutual information , 1997 .

[14]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[15]  Omid Omidvar,et al.  Neural Networks and Pattern Recognition , 1997 .

[16]  Anil K. Jain,et al.  Neural networks and pattern recognition , 1994 .