Image database retrieval of rotated objects by user sketch

The paper describes the authors' image retrieval system, which enables the user to search a grey-scale image database intuitively by presenting simple sketches. The database contains 120 different isolated objects (mostly hand tools) with arbitrary orientation. Each of these images is represented by a hidden Markov model (HMM) which has been modified in order to obtain rotation and scale invariance. Thus, no labeling of the content or the relation angle of the object is needed when adding new images to the database. This is particularly important when using query by sketch due to the skew which occurs naturally in human handwriting and in drawings. The retrieved images can be ranked according to the similarity with the query sketch using the output probabilities of the HMMs. Furthermore, the use of HMMs allows efficient pruning and thus a fast retrieval even with large databases. Experiments with the demonstration system showed good retrieval results with several users.

[1]  Alberto Del Bimbo,et al.  Visual Image Retrieval by Elastic Matching of User Sketches , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Shih-Fu Chang,et al.  Image and video search engine for the World Wide Web , 1997, Electronic Imaging.

[3]  Gerhard Rigoll,et al.  New improved feature extraction methods for real-time high performance image sequence recognition , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Simone Santini,et al.  Similarity queries in image databases , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Richard Rose,et al.  A hidden Markov model based keyword recognition system , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[6]  A. Kosmala,et al.  A New Approach To Content-Based Video Indexing Using Hidden Markov Models , 1997 .

[7]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[8]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[9]  F. Jelinek,et al.  Continuous speech recognition by statistical methods , 1976, Proceedings of the IEEE.

[10]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[11]  Shi-Nine Yang,et al.  Color image retrieval based on hidden Markov models , 1997, IEEE Trans. Image Process..

[12]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[13]  Jerome R. Bellegarda,et al.  On-line handwriting recognition using continuous parameter hidden Markov models , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.