A comparative study on the local-pyramid approach for Content-Based Image Retrieval

The local-pyramid approach for image representation and feature extraction is studied for the Content-Based Image Retrieval (CBIR). Lazebnik's pyramid matching kernels and the K-means clustering is used. The SIFT descriptor is deployed for feature extraction from the images, resulting in an efficient image representation scheme and reduction of the computational complexity. Histogram intersection is used to compute the similarity between the query image and the database images. The local-pyramid approach with a 3-level pyramid and a dictionary size of 100 achieves an average precision of 86.5% in retrieving images from the benchmark database, COREL 1K, and 77.35% for that with random image database.

[1]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Arif Ghafoor,et al.  Semantic Modeling and Knowledge Representation in Multimedia Databases , 1999, IEEE Trans. Knowl. Data Eng..

[3]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[4]  Zheru Chi,et al.  Fuzzy integral for leaf image retrieval , 2002, 2002 IEEE World Congress on Computational Intelligence. 2002 IEEE International Conference on Fuzzy Systems. FUZZ-IEEE'02. Proceedings (Cat. No.02CH37291).

[5]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[6]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[7]  Toshikazu Kato,et al.  Query by Visual Example - Content based Image Retrieval , 1992, EDBT.

[8]  Yihong Gong,et al.  An image database system with content capturing and fast image indexing abilities , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[9]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Jagdish Chandra Patra,et al.  Content-based image retrieval using orthogonal moments heuristically , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[11]  Avinash C. Kak,et al.  Content-based image retrieval from large medical databases , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[12]  Hao Liu.  In-Flight Entertainment System: State of the Art and Research Directions , 2007 .

[13]  Stevan Rudinac,et al.  Global Image Search vs. Regional Search in CBIR Systems , 2007, Eighth International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS '07).

[14]  Ivica Dimitrovski,et al.  Content based image retrieval in medical applications: an improvement of the two-level architecture , 2009, IEEE EUROCON 2009.

[15]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[16]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Ivor W. Tsang,et al.  Visual Event Recognition in Videos by Learning from Web Data , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Sun-Yuan Kung,et al.  Feature-based registration of confocal fluorescence endomicroscopy images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[20]  James Ze Wang,et al.  PARAgrab: a comprehensive architecture for web image management and multimodal querying , 2006, VLDB.

[21]  Mihai Datcu,et al.  Interactive learning and probabilistic retrieval in remote sensing image archives , 2000, IEEE Trans. Geosci. Remote. Sens..

[22]  Miroslaw Pawlak,et al.  On Image Analysis by Moments , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Mingjing Li,et al.  Automated annotation of human faces in family albums , 2003, MULTIMEDIA '03.

[24]  Shaoping Ma,et al.  Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning , 2003, IEEE Trans. Image Process..

[25]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[26]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Trevor Darrell,et al.  The pyramid match kernel: discriminative classification with sets of image features , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[28]  Yoshitomo Yaginuma,et al.  Multipurpose interface for still/moving image retrieval , 1994, Optics & Photonics.

[29]  Sharad Mehrotra,et al.  Relevance feedback techniques in the MARS image retrieval system , 2003, Multimedia Systems.

[30]  Gio Wiederhold,et al.  Digital libraries, value, and productivity , 1995, CACM.

[31]  Raveendran Paramesran,et al.  Content-based image retrieval using Legendre chromaticity distribution moments , 2006 .

[32]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[33]  Ming Ji,et al.  A Local Feature Based Robust Image Retrieval Algorithm , 2009, 2009 2nd International Congress on Image and Signal Processing.

[34]  Mansour Jamzad,et al.  Content based image retrieval using the knowledge of texture, color and binary tree structure , 2009, 2009 Canadian Conference on Electrical and Computer Engineering.

[35]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[36]  King-Sun Fu,et al.  Query-by-Pictorial-Example , 1980, IEEE Trans. Software Eng..

[37]  Arbee L. P. Chen,et al.  Content-based image retrieval by feature point matching , 2001, IS&T/SPIE Electronic Imaging.

[38]  Seah Hock Soon,et al.  Binary SIPPER plankton image classification using random subspace , 2010, Neurocomputing.

[39]  Trevor Darrell,et al.  Pyramid Match Kernels: Discriminative Classification with Sets of Image Features (version 2) , 2006 .

[40]  Stevan Rudinac,et al.  Comparison of CBIR Systems with Different Number of Feature Vector Components , 2007 .

[41]  Feng Zhao,et al.  Registration of in vivo fluorescence endomicroscopy images based on feature detection. , 2010, Advances in experimental medicine and biology.

[42]  Michael Stonebraker,et al.  Chabot: Retrieval from a Relational Database of Images , 1995, Computer.

[43]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[44]  James Ze Wang,et al.  Real-Time Computerized Annotation of Pictures , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.