Visual image retrieval by elastic deformation of object sketches

We present a method for image retrieval based on sketches of object shapes. In our method, the shape is drawn by the user, and instantiated as an elastic template. The template is then deformed to match as well as possible the objects in the images. The degree of match achieved, and the elastic deformation energy spent to achieve such a match are used as a measure of the similarity between the template and the image object. Images can be ranked according to the matching of their objects with the sketch, and the top ranking ones can be presented to the user for browsing. The elastic matching is integrated with arrangements to provide for scale invariance, to take into account rotations and spatial relationships between objects for multiple-object queries.<<ETX>>

[1]  Richard Durbin,et al.  An analogue approach to the travelling salesman problem using an elastic net method , 1987, Nature.

[2]  P. Laurent,et al.  A general method for the construction of interpolating or smoothing spline-functions , 1968 .

[3]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Shi-Kuo Chang,et al.  An Intelligent Image Database System , 1988, IEEE Trans. Software Eng..

[5]  A. N. Tikhonov,et al.  REGULARIZATION OF INCORRECTLY POSED PROBLEMS , 1963 .

[6]  Toshikazu Kato,et al.  Query by Visual Example - Content based Image Retrieval , 1992, EDBT.

[7]  SUH-YIN LEE,et al.  Spatial reasoning and similarity retrieval of images using 2D C-string knowledge representation , 1992, Pattern Recognit..

[8]  Shi-Kuo Chang,et al.  Picture Indexing and Abstraction Techniques for Pictorial Databases , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Naoki Shibata,et al.  Media-based navigation for hypermedia systems , 1993, Hypertext.

[10]  Ching Y. Suen,et al.  Historical review of OCR research and development , 1992, Proc. IEEE.

[11]  Suh-Yin Lee,et al.  2D C-string: A new spatial knowledge representation for image database systems , 1990, Pattern Recognit..

[12]  M. Ohlsson.  Extensions and explorations of the elastic arms algorithm , 1993 .

[13]  Toshikazu Kato,et al.  Database architecture for content-based image retrieval , 1992, Electronic Imaging.