Retrieval of images by spatial and object similarities

In the last several decades it has become an important basis to retrieve images from image databases (IDBs) by the semantic information held in the image objects and the spatial patterns formed by these objects. In this paper, we propose a new method for similarity retrieval of symbolic images by both the attributes and the spatial relationships of the contained objects. The proposed method CPM (common pattern method) retains the common spatial patterns of two images in new data structures CP_DAG (common pattern directed acyclic graph) and performs the similarity calculation efficiently in practice. The conducted experiments use both a synthetic dataset and an existing image database. The experimental results show that CPM outperforms LCS_Clique, SIM"R, SIM"D"T"C, and 2D Be-string for average efficiency and effectiveness. CPM also has steady efficiency while the number of image objects and the object symbol duplication rates increase.

[1]  D. S. Guru,et al.  An invariant scheme for exact match retrieval of symbolic images based upon principal component analysis , 2004, Pattern Recognit. Lett..

[2]  D. J. Guan,et al.  Computational complexity of similarity retrieval in a pictorial database , 2000, Inf. Process. Lett..

[3]  William I. Grosky,et al.  Indexing and retrieval of images by spatial constraints , 2003, J. Vis. Commun. Image Represent..

[4]  Euripides G. M. Petrakis,et al.  ImageMap: An Image Indexing Method Based on Spatial Similarity , 2002, IEEE Trans. Knowl. Data Eng..

[5]  Aleksandra Mojsilovic,et al.  Adaptive perceptual color-texture image segmentation , 2005, IEEE Transactions on Image Processing.

[6]  Po-Whei Huang,et al.  Design of a two-stage content-based image retrieval system using texture similarity , 2004, Inf. Process. Manag..

[7]  Sam Yuan Sung,et al.  Iconic pictorial retrieval using multiple attributes and spatial relationships , 2006, Knowl. Based Syst..

[8]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[9]  Jianying Hu,et al.  Extraction of perceptually important colors and similarity measurement for image matching , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[10]  B. S. Manjunath,et al.  An efficient color representation for image retrieval , 2001, IEEE Trans. Image Process..

[11]  Tzong-Chen Wu,et al.  An exact match retrieval scheme based upon principal component analysis , 1995, Pattern Recognit. Lett..

[12]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Vijay V. Raghavan,et al.  Design and evaluation of algorithms for image retrieval by spatial similarity , 1995, TOIS.

[15]  Ying-Hong Wang.  Image indexing and similarity retrieval based on spatial relationship model , 2003, Inf. Sci..

[16]  Nikolas P. Galatsanos,et al.  A similarity learning approach to content-based image retrieval: application to digital mammography , 2004, IEEE Transactions on Medical Imaging.

[17]  Suh-Yin Lee,et al.  Similarity retrieval of iconic image database , 1989, Pattern Recognit..

[18]  Jianying Hu,et al.  Extraction of perceptually important colors and similarity measurement for image matching, retrieval and analysis , 2002, IEEE Trans. Image Process..

[19]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[20]  Guoping Qiu.  Color image indexing using BTC , 2003, IEEE Trans. Image Process..

[21]  James Ze Wang,et al.  Content-based image retrieval: approaches and trends of the new age , 2005, MIR '05.

[22]  Friedbert Jochum,et al.  The LIVE-project: retrieval experiments based on evaluation viewpoints , 1985, SIGIR '85.

[23]  Suh-Yin Lee,et al.  2D C-string: A new spatial knowledge representation for image database systems , 1990, Pattern Recognit..

[24]  Euripides G. M. Petrakis,et al.  Shape retrieval based on dynamic programming , 2000, IEEE Trans. Image Process..

[25]  Euripides G. M. Petrakis,et al.  Design and evaluation of spatial similarity approaches for image retrieval , 2002, Image Vis. Comput..

[26]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[27]  Chin-Chen Chang,et al.  Color image retrieval technique based on color features and image bitmap , 2007, Inf. Process. Manag..

[28]  David Zhang,et al.  Texture-based palmprint retrieval using a layered search scheme for personal identification , 2005, IEEE Transactions on Multimedia.

[29]  Dong-Sik Jang,et al.  Expert system for color image retrieval , 2005, Expert Syst. Appl..

[30]  Ebroul Izquierdo,et al.  An Object- and User-Driven System for Semantic-Based Image Annotation and Retrieval , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  P. Nagabhushan,et al.  Archival and retrieval of symbolic images: An invariant scheme based on triangular spatial relationship , 2003, Pattern Recognit. Lett..

[33]  Thrasyvoulos N. Pappas,et al.  A PERCEPTUAL APPROACH FOR SEMANTIC IMAGE RETRIEVAL , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[34]  Essam A. El-Kwae,et al.  A robust framework for content-based retrieval by spatial similarity in image databases , 1999, TOIS.

[35]  D. S. Guru,et al.  An Effective and Efficient Exact Match Retrieval Scheme for Symbolic Image Database Systems Based on Spatial Reasoning: A Logarithmic Search Time Approach , 2006, IEEE Transactions on Knowledge and Data Engineering.

[36]  Suh-Yin Lee,et al.  Retrieval of similar pictures on pictorial databases , 1991, Pattern Recognit..

[37]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[38]  King-Sun Fu,et al.  A graph distance measure for image analysis , 1984, IEEE Transactions on Systems, Man, and Cybernetics.