Retrieval of overlapping and touching objects using hidden Markov models

A content-based image retrieval system for overlapping and touching objects based on hidden Markov models is introduced. In a first step, unsupervised clustering in color and position space is performed in order to separate the objects. The clusters are handed over to the feature extraction, which is basically a polar subsampling, and finally rotation invariant Markov models are trained on those features. After presenting a query object, the HMMs which represent the individual clusters in the images are matched against the feature sequence calculated on the query image. Those database elements whose corresponding Markov models generated the highest similarity scores are retrieved. Three different clustering techniques, namely k-means clustering, LBG-algorithm and EM-algorithm are evaluated. Retrieval efficiencies up to 56.25% have been achieved on this challenging task.

[1]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  A. Ardeshir Goshtasby,et al.  Description and Discrimination of Planar Shapes Using Shape Matrices , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  G. Rigoll,et al.  Improved stochastic modeling of shapes for content-based image retrieval , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[4]  G. Rigoll,et al.  Image database retrieval of rotated objects by user sketch , 1998, Proceedings. IEEE Workshop on Content-Based Access of Image and Video Libraries (Cat. No.98EX173).

[5]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[6]  Mohan S. Kankanhalli,et al.  Shape Measures for Content Based Image Retrieval: A Comparison , 1997, Inf. Process. Manag..

[7]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[8]  Ching Y. Suen,et al.  Discrimination of planar shapes using shape matrices , 1989, IEEE Trans. Syst. Man Cybern..

[9]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.