Image Retrieval Based on Micro-structure Descriptor

This paper presents a simple yet efficient image retrieval approach by proposing a new image feature detector and descriptor, namely the micro-structure descriptor (MSD). The micro-structures are defined based on an edge orientation similarity, and the MSD is built based on the underlying colors in micro-structures with similar edge orientation. With micro-structures serving as a bridge, the MSD extracts features by simulating human early visual processing and it effectively integrates color, texture, shape and color layout information as a whole for image retrieval. The proposed MSD algorithm has high indexing performance and low dimensionality. Specifically, it has only 72 dimensions for full color images, and hence it is very efficient for image retrieval. The proposed method is extensively tested on Corel datasets with 15,000 natural images. The results demonstrate that it is much more efficient and effective than representative feature descriptors, such as Gabor features and multi-textons histogram, for image retrieval.

[1]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[2]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[3]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[4]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[5]  Lin Chen.  The topological approach to perceptual organization , 2005 .

[6]  R. O’Reilly.  The What and How of prefrontal cortical organization , 2010, Trends in Neurosciences.

[7]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[8]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  R. Desimone.  Visual attention mediated by biased competition in extrastriate visual cortex. , 1998, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[10]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[11]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[12]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[13]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[14]  Peter Wai-Ming Tsang,et al.  Edge detection on object color , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[15]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  W. H. Tsang,et al.  Edge gradient method on object color , 1996, Proceedings of Digital Processing Applications (TENCON '96).

[17]  Jiebo Luo,et al.  Color object detection using spatial-color joint probability functions , 2004, IEEE Transactions on Image Processing.

[18]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[19]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[20]  Tony Lindeberg,et al.  Detecting salient blob-like image structures and their scales with a scale-space primal sketch: A method for focus-of-attention , 1993, International Journal of Computer Vision.

[21]  Nicu Sebe,et al.  Context-Based Object-Class Recognition and Retrieval by Generalized Correlograms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[24]  Jingyu Yang,et al.  Image retrieval based on the texton co-occurrence matrix , 2008, Pattern Recognit..

[25]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[26]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[28]  Leslie G. Ungerleider,et al.  Object vision and spatial vision: two cortical pathways , 1983, Trends in Neurosciences.

[29]  Raveendran Paramesran,et al.  Image Analysis Using Hahn Moments , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  B. Julesz,et al.  Texton gradients: The texton theory revisited , 2004, Biological Cybernetics.

[31]  Prabir Kumar Biswas,et al.  Texture image retrieval using rotated wavelet filters , 2007, Pattern Recognit. Lett..

[32]  L Chen,et al.  Topological structure in visual perception. , 1982, Science.

[33]  Charles R. Giardina,et al.  Elliptic Fourier features of a closed contour , 1982, Comput. Graph. Image Process..

[34]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[35]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[36]  Christoph Palm,et al.  Color texture classification by integrative Co-occurrence matrices , 2004, Pattern Recognit..

[37]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[39]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[40]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.