Automatic Matching Tool Selection Using Relevance Feedback In Mars

For a given visual feature, due to the diversity of human's subjective judgment, a visual information retrieval system that supports a single pre xed similarity measure will result in poor retrieval performance. To address this problem, this paper proposes the concept of similarity matching toolkit which consists of different similarity measures simulating human's perceptions of the given feature from di erent aspects. The toolkit supports a feedback-driven tool selection mechanism which adapts to the similarity measure that best ts the user's perception. To illustrate the advantage of the proposed toolkit approach, we apply it to shape-based image retrieval. The paper describes a shape matching toolkit consisting of four transformation-invariant and computationally e cient matching tools and describes how relevance feedback can be used for automatic tool selection. Experimental results validate the exibility of the matching toolkit and show the e ectiveness of the relevance feedback for shape matching tool selection.

[1]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[2]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[4]  Thomas S. Huang,et al.  Modified Fourier Descriptors for Shape Representation - A Practical Approach , 1996 .

[5]  Michael F. Barnsley,et al.  Fractals everywhere , 1988 .

[6]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[7]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[8]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[9]  Thomas S. Huang,et al.  Supporting similarity queries in MARS , 1997, MULTIMEDIA '97.

[10]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..