Image retrieval using wavelet-based salient points

Content-based image retrieval (CBIR) has become one of the most active research areas in the past few years. Most of the attention from the research has been focused on indexing techniques based on global feature distributions. However, these global distributions have limited discriminating power because they are unable to capture local image information. The use of interest points in content-based image retrieval allow image index to represent local properties of the image. Classic corner detectors can be used for this purpose. However, they have drawbacks when applied to various natural images for image retrieval, because visual features need not be corners and corners may gather in small regions. In this paper, we present a salient point detector. The detector is based on wavelet transform to detect global variations as well as local ones. The wavelet-based salient points are evaluated for image retrieval with a retrieval system using color and texture features. The results show that salient points with Gabor feature perform better than the other point detectors from the literature and the randomly chosen points. Significant improvements are achieved in terms of retrieval accuracy, computational complexity when compared to the global feature approaches.

[1]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Han Wang,et al.  Analysis of gray level corner detection , 1999, Pattern Recognit. Lett..

[3]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[4]  Harry Wechsler,et al.  Segmentation of Textured Images and Gestalt Organization Using Spatial/Spatial-Frequency Representations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[6]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[7]  B. S. Manjunath,et al.  Texture features and learning similarity , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Cordelia Schmid,et al.  Comparing and evaluating interest points , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  C.-C. Jay Kuo,et al.  Texture analysis and classification with tree-structured wavelet transform , 1993, IEEE Trans. Image Process..

[10]  Qi Tian,et al.  Combine user defined region-of-interest and spatial layout for image retrieval , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[11]  Luc Van Gool,et al.  Content-Based Image Retrieval Based on Local Affinely Invariant Regions , 1999, VISUAL.

[12]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[13]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[14]  HongJiang Zhang,et al.  Scheme for visual feature-based image indexing , 1995, Electronic Imaging.

[15]  S. Mallat.  VI – Wavelet zoom , 1999 .

[16]  Chin-Hsing Chen,et al.  Wavelet transformation for gray-level corner detection , 1995, Pattern Recognit..

[17]  Jacob Beck,et al.  Spatial frequency channels and perceptual grouping in texture segregation , 1987, Comput. Vis. Graph. Image Process..

[18]  Shih-Fu Chang,et al.  Visual information retrieval from large distributed online repositories , 1997, CACM.

[19]  Jan Flusser,et al.  Robust detection of significant points in multiframe images , 1999, Pattern Recognit. Lett..

[20]  Nozha Boujemaa,et al.  Object-based queries using color points of interest , 2001, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001).

[21]  J. M. Hans du Buf,et al.  A review of recent texture segmentation and feature extraction techniques , 1993 .

[22]  N. Sebe,et al.  Color indexing using wavelet-based salient points , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[23]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[24]  Thomas S. Huang,et al.  Optimizing learning in image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[25]  Chin-Hsing Chen,et al.  Multiscale corner detection by using wavelet transform , 1995, IEEE Trans. Image Process..

[26]  I. Daubechies.  Orthonormal bases of compactly supported wavelets , 1988 .

[27]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[28]  B. S. Manjunath,et al.  A texture descriptor for browsing and similarity retrieval , 2000, Signal Process. Image Commun..

[29]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[30]  B. S. Manjunath,et al.  EdgeFlow: a technique for boundary detection and image segmentation , 2000, IEEE Trans. Image Process..

[31]  Qi Tian,et al.  Update relevant image weights for content-based image retrieval using support vector machines , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[32]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[33]  Richard C. Dubes,et al.  Performance evaluation for four classes of textural features , 1992, Pattern Recognit..

[34]  Han Wang,et al.  Gray Level Corner Detection , 1998, MVA.

[35]  Juyang Weng,et al.  Hierarchical Discriminant Analysis for Image Retrieval , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  S. Mallat.  A wavelet tour of signal processing , 1998 .

[39]  Markus A. Stricker,et al.  Spectral covariance and fuzzy regions for image indexing , 1997, Machine Vision and Applications.

[40]  Mark Hedley,et al.  Fast corner detection , 1998, Image Vis. Comput..

[41]  P. Laguna,et al.  Signal Processing , 2002, Yearbook of Medical Informatics.

[42]  Luc Van Gool,et al.  Texture analysis Anno 1983 , 1985, Comput. Vis. Graph. Image Process..

[43]  Touradj Ebrahimi,et al.  Image Retrieval Based on Structural Content , 1999 .

[44]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Stéphane Mallat,et al.  Characterization of Signals from Multiscale Edges , 2011, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Martin D. Levine,et al.  Finding a small number of regions in an image using low-level features , 2002, Pattern Recognit..

[47]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[48]  Shih-Fu Chang,et al.  Transform features for texture classification and discrimination in large image databases , 1994, Proceedings of 1st International Conference on Image Processing.

[49]  Nicu Sebe,et al.  Content-based image retrieval using wavelet-based salient points , 2000, IS&T/SPIE Electronic Imaging.

[50]  Qi Tian,et al.  Incorporate discriminant analysis with EM algorithm in image retrieval , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[51]  Simone Santini,et al.  Similarity Measures , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Jean-Michel Jolion,et al.  Detection of Interest Points for Image Indexation , 1999, VISUAL.

[54]  StrickerMarkus,et al.  Spectral covariance and fuzzy regions for image indexing , 1997 .

[55]  Nicu Sebe,et al.  Wavelet-based salient points for image retrieval , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[56]  J.G. Daugman,et al.  Entropy reduction and decorrelation in visual coding by oriented neural receptive fields , 1989, IEEE Transactions on Biomedical Engineering.

[57]  Paul D. Gader,et al.  Image content retrieval from image databases using feature integration by Choquet integral , 1998, Electronic Imaging.