Global and Local Image Descriptors for Content Based Image Retrieval and Object Recognition

This article develops two descriptors global and local for colored images. The first allows to do image retrieval while the second is applied to object recognition. First we combine color and texture attributes in a unique framework. Our approach is based on the physical properties of light bouncing from a scene. Furthermore, it is claimed that the distribution of Gabor filter outputs can also be provided by a Rayleigh. Filter.Thus, we deduce the RayleighGaussian framework from the Gabor-Gaussian one. Then we compute a descriptor based on statistical measures performed on Rayleigh-Gaussian features. Secondly, we propose a new detection function for interest points and a new characterization of such points. The detection function extends the Harris Laplace method. Our function extracts features invariant to rotation and scale from color images. We use the second moment as a basis of corner decision. Around each feature point we compute a texture descriptor using the Gabor filter. As an evaluation of this new class of interest points, we have implemented a recognition method of 3D objects by indexing a data base on object views; this method is similar to the Lowe method, except that that SIFT features and descriptors are replaced by the ones proposed in our approach.

[1]  J. Daugman Two-dimensional spectral analysis of cortical receptive field profiles , 1980, Vision Research.

[2]  Andrew Y. Ng,et al.  Integrating Visual and Range Data for Robotic Object Detection , 2008, ECCV 2008.

[3]  Arnold W. M. Smeulders,et al.  Color Invariant Edge Detection , 1999, Scale-Space.

[4]  J. Koenderink,et al.  Representation of local geometry in the visual system , 1987, Biological Cybernetics.

[5]  Arnold W. M. Smeulders,et al.  Color Invariance , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Alexei A. Efros,et al.  Putting Objects in Perspective , 2006, CVPR.

[7]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Chia-Hung Yeh,et al.  Iteration-free clustering algorithm for nonstationary image database , 2003, IEEE Trans. Multim..

[9]  Dennis F. Dunn,et al.  Optimal Gabor filters for texture segmentation , 1995, IEEE Trans. Image Process..

[10]  Rachid Deriche,et al.  Differential invariants for color images , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[11]  Dong-Sik Jang,et al.  Expert system for color image retrieval , 2005, Expert Syst. Appl..

[12]  Arnold W. M. Smeulders,et al.  Color texture measurement and segmentation , 2005, Signal Process..

[13]  Allen R. Hanson,et al.  On multi-scale differential features and their representations for image retrieval and recognition , 2003 .

[14]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[15]  Quoc V. Le,et al.  High-accuracy 3D sensing for mobile manipulation: Improving object detection and door opening , 2009, 2009 IEEE International Conference on Robotics and Automation.

[16]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  J. Koenderink The structure of images , 2004, Biological Cybernetics.

[18]  B. S. Manjunath,et al.  On the Rayleigh nature of Gabor filter outputs , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[19]  Arnold W. M. Smeulders,et al.  Color and Scale: The Spatial Structure of Color Images , 2000, ECCV.

[20]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[21]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[22]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[23]  Prashant Parikh A Theory of Communication , 2010 .