An efficient image retrieval based on an integration of HSV, RLBP, and CENTRIST features using ensemble classifier learning

Recently, we have been witnessing a tremendous rise in digital image quantities, which in return calls for an adjustment and management system to fulfill user’s queries in the shortest time with maximum accuracy. In this regard, Content-Based Image Retrieval (CBIR) approaches have gained unprecedented attention. In CBIR systems, image search is based on their actual contents instead of textual annotations. Due to the fact that users do not think of low-level image features such as color, texture, structure, and shape and are looking for high-level image features or semantic features while querying images, the performance of image retrieval systems becomes weak. On the one hand, the huge amount of extracted features and the complexity of feature spaces are considered as two main challenges in image retrieval study area. Therefore, this article trying to extract the key features of the image in order to increase the accuracy and speed of image recovery over big data. This study combines two feature extraction techniques namely Census Transform Histogram (CENTRIST) and Rotated Local Binary Pattern (RLBP) following by Kernel Principal Component Analysis (PCA) method to reduce the dimensional feature space. In fact, after feature extraction phase we utilize Adaboost M2 classifying method on the train data to learn the different classes of images that are existed in the database. Furthermore, instead of using RGB color space, images are transformed to HSV color space. The reason for using the HSV color space instead of the RGB one is the fact that it is closer to human perception. Performance evaluations of the proposed method are conducted on the Corel-1 K and UW datasets. Simulation results indicate that proposed method performs better than other methods.

[1]  Raphaël Marée,et al.  Content-based Image Retrieval by Indexing Random Subwindows with Randomized Trees , 2007, IPSJ Trans. Comput. Vis. Appl..

[2]  Chuen-Horng Lin,et al.  Study of image retrieval and classification based on adaptive features using genetic algorithm feature selection , 2014, Expert Syst. Appl..

[3]  Bahgat A. Abdel Latef,et al.  Using Genetic Algorithm to Improve Information Retrieval Systems , 2008 .

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Nicu Sebe,et al.  Joint Attributes and Event Analysis for Multimedia Event Detection , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Ramin Zabih,et al.  Non-parametric Local Transforms for Computing Visual Correspondence , 1994, ECCV.

[7]  Leslie G. Ungerleider,et al.  The neural basis of biased competition in human visual cortex , 2001, Neuropsychologia.

[8]  Jia Kebin,et al.  AN EFFECTIVE METHOD OF IMAHE RETRIEVAL BASED ON MODIFIED FUZZY C-MEANS CLUSTERING SCHEME , 2006, 2006 8th international Conference on Signal Processing.

[9]  Deyu Wang,et al.  Cognitive-inspired class-statistic matching with triple-constrain for camera free 3D object retrieval , 2019, Future Gener. Comput. Syst..

[10]  Wei Gao,et al.  Content Based Image Retrieval Using Local Directional Pattern and Color Histogram , 2014 .

[11]  Gholam Ali Montazer,et al.  A new image feature descriptor for content based image retrieval using scale invariant feature transform and local derivative pattern , 2017 .

[12]  Lawrence O. Hall,et al.  Classification of progression free survival with nasopharyngeal carcinoma tumors , 2016, SPIE Medical Imaging.

[13]  Mutasem K. Alsmadi,et al.  An efficient similarity measure for content based image retrieval using memetic algorithm , 2017 .

[14]  Fuhui Long,et al.  Fundamentals of Content-Based Image Retrieval , 2003 .

[15]  Andrew Trotman,et al.  Sound and complete relevance assessment for XML retrieval , 2008, TOIS.

[16]  Etienne E. Kerre,et al.  Color Image Retrieval using Fuzzy Similarity Measures and Fuzzy Partitions , 2007, 2007 IEEE International Conference on Image Processing.

[17]  Nilanjan Dey,et al.  Principal component analysis in medical image processing: a study , 2015 .

[18]  Subrahmanyam Murala,et al.  Local Tetra Patterns: A New Feature Descriptor for Content-Based Image Retrieval , 2012, IEEE Transactions on Image Processing.

[19]  Lei Zhang,et al.  Image retrieval based on micro-structure descriptor , 2011, Pattern Recognit..

[20]  Ying Liu,et al.  Region-based image retrieval with high-level semantics using decision tree learning , 2008, Pattern Recognit..

[21]  Kidiyo Kpalma,et al.  Region-based image retrieval using shape-adaptive DCT , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[22]  Spyros Liapis,et al.  Color and texture image retrieval using chromaticity histograms and wavelet frames , 2004, IEEE Transactions on Multimedia.

[23]  Lin Li,et al.  Nonlinear Dynamic Soft Sensor Modeling With Supervised Long Short-Term Memory Network , 2020, IEEE Transactions on Industrial Informatics.

[24]  Ghalem Belalem,et al.  PCA as Dimensionality Reduction for Large-Scale Image Retrieval Systems , 2017, Int. J. Ambient Comput. Intell..

[25]  Qinghai Wu,et al.  Image retrieval method based on deep learning semantic feature extraction and regularization softmax , 2019, Multimedia Tools and Applications.

[26]  Xiaohui Yang,et al.  Adaptive region matching for region-based image retrieval by constructing region importance index , 2014, IET Comput. Vis..

[27]  Paul Scheunders,et al.  Statistical texture characterization from discrete wavelet representations , 1999, IEEE Trans. Image Process..

[28]  Yesubai Rubavathi Charles,et al.  A novel local mesh color texture pattern for image retrieval system , 2016 .

[29]  Yun Q. Shi,et al.  A privacy-preserving content-based image retrieval method in cloud environment , 2017, J. Vis. Commun. Image Represent..

[30]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[31]  Nicu Sebe,et al.  Wavelet-based salient points for image retrieval , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[32]  Jiebo Luo,et al.  A Generalized Temporal Context Model for Semantic Scene Classification , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[33]  Ligang Zhang,et al.  Synchronous prediction of arousal and valence using LSTM network for affective video content analysis , 2017, 2017 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[34]  David Dagan Feng,et al.  Content-Based Medical Image Retrieval: A Survey of Applications to Multidimensional and Multimodality Data , 2013, Journal of Digital Imaging.

[35]  M. D. Ingole,et al.  Content based image retrieval using hybrid features and various distance metric , 2018, Journal of Electrical Systems and Information Technology.

[36]  Chuen-Horng Lin,et al.  Image Retrieval System Based on Adaptive Color Histogram and Texture Features , 2011, Comput. J..

[37]  Aboul Ella Hassanien,et al.  Applications of Intelligent Optimization in Biology and Medicine - Current Trends and Open Problems , 2015, Applications of Intelligent Optimization in Biology and Medicine.

[38]  Jung Bum Oh,et al.  Content-Based Image Retrieval Based on Scale-Space Theory (Special Section of Papers Selected from ITC-CSCC '98) , 1999 .

[39]  Jing-Yu Yang,et al.  Content-based image retrieval using color difference histogram , 2013, Pattern Recognit..

[40]  Karen O. Egiazarian,et al.  Dominant Rotated Local Binary Patterns (DRLBP) for texture classification , 2016, Pattern Recognit. Lett..

[41]  Rong-Tai Chen,et al.  A smart content-based image retrieval system based on color and texture feature , 2009, Image Vis. Comput..

[42]  Kebin Jia,et al.  AN EFFECTIVE METHOD OF IMAHE RETRIEVAL BASED ON MODIFIED FUZZY C-MEANS CLUSTERING SCHEME , 2006 .

[43]  Matti Pietikäinen,et al.  RLBP: Robust Local Binary Pattern , 2013, BMVC.

[44]  Claudio Gutierrez,et al.  Survey of graph database models , 2008, CSUR.

[45]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[46]  Mohammed Alshehri,et al.  A Content-Based Image Retrieval Method Using Neural Network-Based Prediction Technique , 2019, Arabian Journal for Science and Engineering.

[47]  M. Natarajan,et al.  An efficient content based image retrieval using enhanced multi-trend structure descriptor , 2020, SN Applied Sciences.

[48]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[49]  Nilanjan Dey,et al.  Feature Detectors and Motion Detection in Video Processing , 2017 .

[50]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[51]  Pietro Perona,et al.  Grouping and dimensionality reduction by locally linear embedding , 2001, NIPS.

[52]  D. Hubel,et al.  Anatomy and physiology of a color system in the primate visual cortex , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[53]  Abby Goodrum,et al.  Image Information Retrieval: An Overview of Current Research , 2000, Informing Sci. Int. J. an Emerg. Transdiscipl..

[54]  Raphaël Marée,et al.  Content-based Image Retrieval by Indexing Random Subwindows with Randomized Trees , 2009, IPSJ Trans. Comput. Vis. Appl..

[55]  Wei-Ta Chu,et al.  Color CENTRIST: a color descriptor for scene categorization , 2012, ICMR.

[56]  Sung Wook Baik,et al.  Saliency-weighted graphs for efficient visual content description and their applications in real-time image retrieval systems , 2017, Journal of Real-Time Image Processing.

[57]  O. A. Vatamanu,et al.  Content-Based Image Retrieval using Local Binary Pattern, Intensity Histogram and Color Coherence Vector , 2013, 2013 E-Health and Bioengineering Conference (EHB).

[58]  Young Shik Moon,et al.  Content-Based Image Retrieval Based on Scale-Space Theory , 1998 .

[59]  James Ze Wang,et al.  A scalable integrated region-based image retrieval system , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[60]  Xi Zhang,et al.  Feature integration analysis of bag-of-features model for image retrieval , 2013, Neurocomputing.

[61]  Zhenyu He,et al.  Texture image retrieval based on non-tensor product wavelet filter banks , 2009, Signal Process..

[62]  Matti Pietikäinen,et al.  Block-Based Methods for Image Retrieval Using Local Binary Patterns , 2005, SCIA.

[63]  Ernest Valveny,et al.  Learning Cross-Modal Deep Embeddings for Multi-Object Image Retrieval using Text and Sketch , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[64]  Ali Douik,et al.  Content based image retrieval using local and global features descriptor , 2016, 2016 2nd International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[65]  Xingyuan Wang,et al.  A novel method for image retrieval based on structure elements' descriptor , 2013, J. Vis. Commun. Image Represent..

[66]  Baltasar Beferull-Lozano,et al.  Rotation-Invariant Texture Retrieval via Signature Alignment Based on Steerable Sub-Gaussian Modeling , 2008, IEEE Transactions on Image Processing.

[67]  Michael Stonebraker,et al.  Chabot: Retrieval from a Relational Database of Images , 1995, Computer.

[68]  Lu Liu,et al.  Content-based image retrieval using color and texture fused features , 2011, Math. Comput. Model..

[69]  Kidiyo Kpalma,et al.  Region-based image retrieval in the compressed domain using shape-adaptive DCT , 2015, Multimedia Tools and Applications.

[70]  James M. Rehg,et al.  CENTRIST: A Visual Descriptor for Scene Categorization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  Shalini Batra,et al.  An efficient bi-layer content based image retrieval system , 2020, Multimedia Tools and Applications.

[72]  Weihua Gui,et al.  A novel deep learning based fault diagnosis approach for chemical process with extended deep belief network. , 2019, ISA transactions.

[73]  Biao Huang,et al.  Hierarchical Quality-Relevant Feature Representation for Soft Sensor Modeling: A Novel Deep Learning Strategy , 2020, IEEE Transactions on Industrial Informatics.

[74]  Mohan S. Kankanhalli,et al.  MMALFM , 2018, ACM Trans. Inf. Syst..

[75]  Jing-Yu Yang,et al.  Content-based image retrieval using computational visual attention model , 2015, Pattern Recognit..

[76]  Kai-Kuang Ma,et al.  Rotation-invariant and scale-invariant Gabor features for texture image retrieval , 2007, Image Vis. Comput..

[77]  Theodore A. Laliotis,et al.  Microprocessors present and future , 1974, Computer.

[78]  Zhao Hongwei,et al.  Image retrieval based on weighted blocks and color feature , 2011, 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (MEC).

[79]  Xiaodong Liu,et al.  Image retrieval based on effective feature extraction and diffusion process , 2018, Multimedia Tools and Applications.

[80]  Rong Jin,et al.  Semisupervised SVM batch mode active learning with applications to image retrieval , 2009, TOIS.

[81]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[82]  Yi Yang,et al.  Bi-Level Semantic Representation Analysis for Multimedia Event Detection , 2017, IEEE Transactions on Cybernetics.

[83]  Aman Pal,et al.  Fusion framework for effective color image retrieval , 2014, J. Vis. Commun. Image Represent..

[84]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[85]  Jun Xu,et al.  Fusing Heterogeneous Features From Stacked Sparse Autoencoder for Histopathological Image Analysis , 2016, IEEE Journal of Biomedical and Health Informatics.

[86]  Lei Zhang,et al.  Contents lists available at ScienceDirect Pattern Recognition , 2022 .

[87]  Sung Wook Baik,et al.  Integrating salient colors with rotational invariant texture features for image representation in retrieval systems , 2017, Multimedia Tools and Applications.

[88]  Nuno Vasconcelos,et al.  From Pixels to Semantic Spaces: Advances in Content-Based Image Retrieval , 2007, Computer.

[89]  Sung Wook Baik,et al.  Multi-scale local structure patterns histogram for describing visual contents in social image retrieval systems , 2016, Multimedia Tools and Applications.