Shape-Based Retrieval: A Case Study With Trademark Image Databases

Abstract Retrieval efficiency and accuracy are two important issues in designing a content-based database retrieval system. We propose a method for trademark image database retrieval based on object shape information that would supplement traditional text-based retrieval systems. This system achieves both the desired efficiency and accuracy using a two-stage hierarchy: in the first stage, simple and easily computable shape features are used to quickly browse through the database to generate a moderate number of plausible retrievals when a query is presented; in the second stage, the candidates from the first stage are screened using a deformable template matching process to discard spurious matches. We have tested the algorithm using hand drawn queries on a trademark database containing 1100 images. Each retrieval takes a reasonable amount of computation time (∼4–5 s on a Sun Space 20 workstation). The topmost image retrieved by the system agrees with that obtained by human subjects, but there are significant differences between the ranking of the top-10 images retrieved by our system and the ranking of those selected by the human subjects. This demonstrates the need for developing shape features that are better able to capture human perceptual similarity of shapes. An improved heuristic has been suggested for more accurate retrievals. The proposed scheme matches filled-in query images against filled-in images from the database, thus using only the gross details in the image. Experiments with database images used as query images have shown that matching on the filled-in database extracts more images within the top-20 retrievals that have similar content. We believe that developing an automatic retrieval algorithm which matches human performance is an extremely difficult and challenging task. However, considering the substantial amount of time and effort needed for a manual retrieval from a large image database, an automatic shape-based retrieval technique can significantly simplify the retrieval task.

[1]  Thomas S. Huang,et al.  Image registration by matching relational structures , 1982, Pattern Recognit..

[2]  Aditya Vailaya,et al.  Shape-based Image Retrieval , 1996 .

[3]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Gian Antonio Mian,et al.  Trademark shapes description by string-matching techniques , 1994, Pattern Recognit..

[5]  Raimondo Schettini.  Multicolored object recognition and location , 1994, Pattern Recognit. Lett..

[6]  Rosalind W. Picard,et al.  Interactive Learning Using a "Society of Models" , 2017, CVPR 1996.

[7]  U. Grenander,et al.  Structural Image Restoration through Deformable Templates , 1991 .

[8]  T ZahnCharles,et al.  Fourier Descriptors for Plane Closed Curves , 1972 .

[9]  Anil K. Jain,et al.  Object Matching Using Deformable Templates , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  A. Rosenfeld,et al.  Some Experiments in Point Pattern Matching , 1978 .

[12]  Wayne Niblack,et al.  A pseudo-distance measure for 2D shapes based on turning angle , 1995, Proceedings., International Conference on Image Processing.

[13]  P. W. Huang,et al.  Using 2D C+-strings as spatial knowledge representation for image database systems , 1994, Pattern Recognit..

[14]  Larry S. Davis,et al.  Shape Matching Using Relaxation Techniques , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[16]  Babu M. Mehtre,et al.  STAR-A System for Trademark Archival and Retrieval , 1995 .

[17]  John Juyang Weng.  SHOSLIF: A Framework for Sensor-Based Learning for High-Dimensional Complex Systems , 1995 .

[18]  Tom Minka,et al.  Interactive learning with a "Society of Models" , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Anil K. Jain,et al.  Image retrieval using color and shape , 1996, Pattern Recognit..

[20]  Yuntao Cui,et al.  Learning-based hand sign recognition using SHOSLIF-M , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[22]  Chitra Dorai,et al.  Practicing vision: Integration, evaluation and applications , 1997, Pattern Recognit..