Improved image retrieval using fast Colour-texture features with varying weighted similarity measure and random forests

Content-based image retrieval (CBIR) retrieves images from image database based on the visual similarity of query image. For the implementation of CBIR, feature extraction plays a significant role, where colour feature is quite remarkable. But, due to achromatic surfaces or unevenly colored, the role of texture is also important. This paper introduced an efficient and fast CBIR system, which is based on the combination of computationally light weighted colour and texture features viz. chromaticity moment, colour percentile, and local binary pattern. For searching, this paper proposes inverse variance based varying weighted similarity measure (low for high variance feature and high for low variance feature), which reduces the effect of redundancy by assigning the priority to each feature, and effectively retrieves relevant images. In addition, this paper also proposes query image classification and retrieval model by filtering out irrelevant class images using Random Forests (RF) classifier, which recovers the class of a query image based on distinct learning (supervised) of various decision trees. This successful ensemble classification of query images reduces the semantic gap, searching space, and enhances the retrieval performance. Extensive experimental analyses on benchmark databases confirm the usefulness and effectiveness of this work.

[1]  P.S. Hiremath,et al.  Content Based Image Retrieval Using Color, Texture and Shape Features , 2007, 15th International Conference on Advanced Computing and Communications (ADCOM 2007).

[2]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[3]  Hamid A. Jalab,et al.  Image retrieval system based on color layout descriptor and Gabor filters , 2011, 2011 IEEE Conference on Open Systems.

[4]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[5]  Tae-Sun Choi,et al.  Embedding neural networks for semantic association in content based image retrieval , 2014, Multimedia Tools and Applications.

[6]  Manesh Kokare,et al.  Colour and Texture Features for Content Based Image Retrieval , 2006, International Conference on Computer Graphics, Imaging and Visualisation (CGIV'06).

[7]  Anil K. Jain,et al.  Image classification for content-based indexing , 2001, IEEE Trans. Image Process..

[8]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[9]  Kai-Kuang Ma,et al.  Rotation-invariant and scale-invariant Gabor features for texture image retrieval , 2007, Image Vis. Comput..

[10]  S. Panchanathan,et al.  Image Indexing Using Moments and Wavelets , 1996, 1996. Digest of Technical Papers., International Conference on Consumer Electronics.

[11]  C. Won,et al.  Efficient Use of MPEG‐7 Edge Histogram Descriptor , 2002 .

[12]  Christoph Palm,et al.  Color texture classification by integrative Co-occurrence matrices , 2004, Pattern Recognit..

[13]  Jianzhong Wang,et al.  A novel image retrieval method based on hybrid information descriptors , 2014, J. Vis. Commun. Image Represent..

[14]  Tinku Acharya,et al.  Image Processing: Principles and Applications , 2005, J. Electronic Imaging.

[15]  Lu Liu,et al.  Content-based image retrieval using color and texture fused features , 2011, Math. Comput. Model..

[16]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[17]  Reda Alhajj,et al.  Efficient content-based image retrieval using Multiple Support Vector Machines Ensemble , 2012, Expert Syst. Appl..

[18]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Lei Zhang,et al.  Image retrieval based on micro-structure descriptor , 2011, Pattern Recognit..

[20]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[21]  Rajeev Srivastava,et al.  Design & performance analysis of content based image retrieval system based on image classification usingvarious feature sets , 2015, 2015 International Conference on Futuristic Trends on Computational Analysis and Knowledge Management (ABLAZE).

[22]  Jae Won Lee,et al.  Content-based image classification using a neural network , 2004, Pattern Recognit. Lett..

[23]  Antonios Gasteratos,et al.  Evaluation of shape descriptors for shape-based image retrieval , 2011 .

[24]  Aman Pal,et al.  Fusion framework for effective color image retrieval , 2014, J. Vis. Commun. Image Represent..

[25]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[27]  Ji Wan,et al.  Deep Learning for Content-Based Image Retrieval: A Comprehensive Study , 2014, ACM Multimedia.

[28]  Huadong Sun,et al.  Content Based Image Retrieval Scheme using Color, Texture and Shape Features , 2016 .

[29]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[30]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[31]  Paul Southam,et al.  Theoretical and experimental comparison of different approaches for color texture classification , 2011, J. Electronic Imaging.

[32]  Yu-Jin Zhang,et al.  Image Classification and Retrieval with Mining Technologies , 2009 .

[33]  Xiao-Jun Wu,et al.  Content Based Image Retrieval by combining color, texture and CENTRIST , 2013 .

[34]  Rong-Tai Chen,et al.  A smart content-based image retrieval system based on color and texture feature , 2009, Image Vis. Comput..

[35]  Mohsen Ebrahimi Moghaddam,et al.  A content-based image retrieval system based on Color Ton Distribution descriptors , 2013, Signal, Image and Video Processing.

[36]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[37]  Georgios S. Paschos,et al.  Image Content-Based Retrieval Using Chromaticity Moments , 2003, IEEE Trans. Knowl. Data Eng..

[38]  M. D. Ingole,et al.  Content based image retrieval using hybrid features and various distance metric , 2018, Journal of Electrical Systems and Information Technology.