An Intelligent Content-based Image Retrieval System Based on Color, Shape and Spatial Relations

Content-based multimedia information retrieval is an interesting but difficult area of research. Current approaches include the use of color, texture, and shape information. In this paper, we present a hybrid approach, which incorporates color, shape and spatial relations among objects in a picture, and has been used to retrieve images from nearly 5000 pictures. A revised color scheme and its indexing technique are used to improve the efficiency of retrieval, based on our clustering method and color sensation. A seed filling-like mechanism is used to extract shape and spatial relations from objects. A qualitative approach is applied to similarity comparison of spatial differences. The system is also implemented with a friendly GUI, which allows sketch images as well as relevance feedback to improve the accuracy of retrieval. Our experience shows that the system is able to retrieve image information efficiently based on the proposed approach.

[1]  C.-C. Jay Kuo,et al.  Wavelet descriptor of planar curves: theory and applications , 1996, IEEE Trans. Image Process..

[2]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[3]  Kurt Rothermel,et al.  TIEMPO: temporal modeling and authoring of interactive multimedia , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[4]  Herbert Freeman,et al.  Computer Processing of Line-Drawing Images , 1974, CSUR.

[5]  Timos K. Sellis,et al.  Spatio-temporal composition in multimedia applications , 1996, Proceedings International Workshop on Multimedia Software Development.

[6]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Trans. Syst. Man Cybern..

[7]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[8]  James Dowe,et al.  Content-based retrieval in multimedia imaging , 1993, Electronic Imaging.

[9]  Jun Shen,et al.  An optimal linear operator for step edge detection , 1992, CVGIP Graph. Model. Image Process..

[10]  Anne H. H. Ngu,et al.  Picture Similarity Retrieval Using 2D Projection Interval Representation , 1996, IEEE Trans. Knowl. Data Eng..

[11]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Robert C. Bolles,et al.  Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching , 1977, IJCAI.

[13]  Raj Acharya,et al.  Color clustering techniques for color-content-based image retrieval from image databases , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[14]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[15]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Multimedia Systems.

[16]  Y. N. Lakshman,et al.  Computing invariants using elimination methods , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[17]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[18]  Esther M. Arkin,et al.  An efficiently computable metric for comparing polygonal shapes , 1991, SODA '90.

[19]  Peter Alshuth,et al.  IRIS - Image retrieval for images and videos , 1996 .

[20]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Xiaobo Li,et al.  2D-h trees: an index scheme for content-based retrieval of images in multimedia systems , 1997, 1997 IEEE International Conference on Intelligent Processing Systems (Cat. No.97TH8335).

[23]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[24]  Timothy K. Shih,et al.  The algebra of spatio-temporal intervals , 1998, Proceedings Twelfth International Conference on Information Networking (ICOIN-12).