Multi-objective whale optimization algorithm for content-based image retrieval

In the recent years, there are massive digital images collections in many fields of our life, which led the technology to find methods to search and retrieve these images efficiently. The content-based is one of the popular methods used to retrieve images, which depends on the color, texture and shape descriptors to extract features from images. However, the performance of the content-based image retrieval methods depends on the size of features that are extracted from images and the classification accuracy. Therefore, this problem is considered as a multi-objective and there are several methods that used to manipulate it such as NSGA-II and NSMOPSO. However, these methods have drawbacks such as their time and space complexity are large since they used traditional non-dominated sorting methods. In this paper, a new non-dominated sorting based on multi-objective whale optimization algorithm is proposed for content-based image retrieval (NSMOWOA). The proposed method avoids the drawbacks in other non-dominated sorting multi-objective methods that have been used for content-based image retrieval through reducing the space and time complexity. The results of the NSMOWOA showed a good performance in content-based image retrieval problem in terms of recall and precision.

[1]  Asha Gowda Karegowda,et al.  Enhancing CBIR Performance Using Evolutionary Algorithm-Assisted Significant Feature Selection: A Filter Approach , 2016 .

[2]  M. Esmel ElAlami,et al.  A novel image retrieval model based on the most relevant features , 2011, Knowl. Based Syst..

[3]  Svetlana Lazebnik,et al.  Multi-scale Orderless Pooling of Deep Convolutional Activation Features , 2014, ECCV.

[4]  Aboul Ella Hassanien,et al.  An improved social spider optimization algorithm based on rough sets for solving minimum number attribute reduction problem , 2016, Neural Computing and Applications.

[5]  Yonghong Tian,et al.  CNN vs. SIFT for Image Retrieval: Alternative or Complementary? , 2016, ACM Multimedia.

[6]  Ian Burns,et al.  Measuring texture classification algorithms , 1997, Pattern Recognit. Lett..

[7]  Petros Daras,et al.  MSIDX: Multi-Sort Indexing for Efficient Content-Based Image Search and Retrieval , 2013, IEEE Transactions on Multimedia.

[8]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[9]  Kamal Jamshidi,et al.  A semantic model for general purpose content-based image retrieval systems , 2014, Comput. Electr. Eng..

[10]  Husniza Husni,et al.  Efficient, Compact, and Dominant Color Correlogram Descriptors for Content-based Image Retrieval , 2013 .

[11]  K. E. Steele,et al.  REVIEW PAPER , 2010, Veterinary pathology.

[12]  Chee Peng Lim,et al.  A multi-objective evolutionary algorithm-based ensemble optimizer for feature selection and classification with neural network models , 2014, Neurocomputing.

[13]  W. Du,et al.  Multi-objective differential evolution with ranking-based mutation operator and its application in chemical process optimization , 2014 .

[14]  Ali Kaveh,et al.  Enhanced whale optimization algorithm for sizing optimization of skeletal structures , 2017 .

[15]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[16]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[17]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Gadadhar Sahoo,et al.  Comparison of Content Based Image Retrieval Systems Using Wavelet and Curvelet Transform , 2012 .

[19]  M. El-Sayed Waheed,et al.  Mixture of Generalized Gamma Density-Based Score Function for Fastica , 2011 .

[20]  B. Surendiran,et al.  Dimensionality reduction using Principal Component Analysis for network intrusion detection , 2016 .

[21]  Sushmita Mitra,et al.  Multi-objective optimization of shared nearest neighbor similarity for feature selection , 2015, Appl. Soft Comput..

[22]  Francesc J. Ferri,et al.  A hybrid multi-objective optimization algorithm for content based image retrieval , 2013, Appl. Soft Comput..

[23]  Julie M. David,et al.  CONTENT BASED IMAGE RETRIEVAL : A REVIEW , 2014 .

[24]  Dong Yue,et al.  Multi-view low-rank dictionary learning for image classification , 2016, Pattern Recognit..

[25]  E. Dougherty,et al.  Gray-scale morphological granulometric texture classification , 1994 .

[26]  Chun-Wei Tsai,et al.  A non-dominated sorting firefly algorithm for multi-objective optimization , 2014, 2014 14th International Conference on Intelligent Systems Design and Applications.

[27]  S. Sivanagaraju,et al.  Multi-objective optimization in the presence of practical constraints using non-dominated sorting hybrid cuckoo search algorithm , 2015 .

[28]  Mohan M. Trivedi,et al.  Segmentation of a high-resolution urban scene using texture operators , 1984, Comput. Vis. Graph. Image Process..

[29]  Mohamed Abd El Aziz,et al.  Nonnegative matrix factorization based on projected hybrid conjugate gradient algorithm , 2015, Signal Image Video Process..

[30]  Ram Bilas Pachori,et al.  Histogram refinement for texture descriptor based image retrieval , 2017, Signal Process. Image Commun..

[31]  G. Wiselin Jiji,et al.  Content-based image retrieval techniques for the analysis of dermatological lesions using particle swarm optimization technique , 2015, Appl. Soft Comput..

[32]  Esther de Ves,et al.  Selecting the structuring element for morphological texture classification , 2006, Pattern Analysis and Applications.

[33]  Mengjie Zhang,et al.  A multi-objective artificial bee colony approach to feature selection using fuzzy mutual information , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[34]  Hamid A. Jalab,et al.  Image retrieval system based on color layout descriptor and Gabor filters , 2011, 2011 IEEE Conference on Open Systems.

[35]  Aboul Ella Hassanien,et al.  Chaotic multi-verse optimizer-based feature selection , 2017, Neural Computing and Applications.

[36]  Juan Domingo,et al.  Combining similarity measures in content-based image retrieval , 2008, Pattern Recognit. Lett..

[37]  Shengyao Wang,et al.  An enhanced non-dominated sorting based fruit fly optimization algorithm for solving environmental economic dispatch problem , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[38]  Qinghua Hu,et al.  Heterogeneous Feature Selection With Multi-Modal Deep Neural Networks and Sparse Group LASSO , 2015, IEEE Transactions on Multimedia.

[39]  Guoping Qiu.  Color image indexing using BTC , 2003, IEEE Trans. Image Process..

[40]  Muhammad Marwan Muhammad Fuad.  Applying Non-dominated Sorting Genetic Algorithm II to Multi-objective Optimization of a Weighted Multi-metric Distance for Performing Data Mining Tasks , 2015, EvoApplications.

[41]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[42]  Cong Jin,et al.  Automatic image annotation using feature selection based on improving quantum particle swarm optimization , 2015, Signal Process..

[43]  Aboul Ella Hassanien,et al.  Whale Optimization Algorithm and Moth-Flame Optimization for multilevel thresholding image segmentation , 2017, Expert Syst. Appl..

[44]  Hossein Nezamabadi-pour,et al.  A simultaneous feature adaptation and feature selection method for content-based image retrieval systems , 2013, Knowl. Based Syst..

[45]  Rajendra Prasad Mahapatra,et al.  The Whale Optimization Algorithm and Its Implementation in MATLAB , 2018 .

[46]  Jing-Ming Guo,et al.  Effective Image Retrieval System Using Dot-Diffused Block Truncation Coding Features , 2015, IEEE Transactions on Multimedia.

[47]  Mahdi Rezaei,et al.  Image retrieval based on texture and color method in BTC-VQ compressed domain , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[48]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[49]  Bin Zheng,et al.  Optimization of breast mass classification using sequential forward floating selection (SFFS) and a support vector machine (SVM) model , 2014, International Journal of Computer Assisted Radiology and Surgery.

[50]  Joydeep Mukherjee,et al.  Image Similarity Measure using Color Histogram , Color Coherence Vector , and Sobel Method , 2013 .

[51]  Aboul Ella Hassanien,et al.  Modified cuckoo search algorithm with rough sets for feature selection , 2018, Neural Computing and Applications.

[52]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[54]  Hamid Abrishami Moghaddam,et al.  A Novel Evolutionary Approach for Optimizing Content-Based Image Indexing Algorithms , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[55]  Chih-Chin Lai,et al.  A User-Oriented Image Retrieval System Based on Interactive Genetic Algorithm , 2011, IEEE Transactions on Instrumentation and Measurement.

[56]  Rassoul Amirfattahi,et al.  Local derivative radial patterns: A new texture descriptor for content-based image retrieval , 2017, Signal Process..

[57]  Xinge You,et al.  A Blind Watermarking Scheme Using New Nontensor Product Wavelet Filter Banks , 2010, IEEE Transactions on Image Processing.

[58]  Waseem Ahmad,et al.  Content Based Image Retrieval: A Review Paper , 2014 .

[59]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[60]  A. R. Baig,et al.  Multi-Objective Feature Subset Selection using Non-dominated Sorting Genetic Algorithm , 2015 .

[61]  Cherukuri Santhan Kumar,et al.  A Novel Global MPP Tracking of Photovoltaic System based on Whale Optimization Algorithm , 2016 .

[62]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[63]  Antoine Geissbühler,et al.  Erratum to "A review of content-based image retrieval systems in medical applications - Clinical benefits and future directions" [I. J. Medical Informatics 73 (1) (2004) 1-23] , 2009, Int. J. Medical Informatics.

[64]  P. Singh,et al.  Content Based Image Retrieval using Discrete Wavelet Transform and Edge Histogram Descriptor , 2013, 2013 International Conference on Information Systems and Computer Networks.

[65]  Tong Zhang,et al.  Improved Local Coordinate Coding using Local Tangents , 2010, ICML.

[66]  Qi Tian,et al.  Exploiting Hierarchical Activations of Neural Network for Image Retrieval , 2016, ACM Multimedia.

[67]  Pengfei Duan,et al.  A Hybrid Method of Sine Cosine Algorithm and Differential Evolution for Feature Selection , 2017, ICONIP.

[68]  Francesc J. Ferri,et al.  A NSGA Based Approach for Content Based Image Retrieval , 2013, CIARP.

[69]  Ji Wan,et al.  Deep Learning for Content-Based Image Retrieval: A Comprehensive Study , 2014, ACM Multimedia.

[70]  Ye Tian,et al.  An Efficient Approach to Nondominated Sorting for Evolutionary Multiobjective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[71]  Guillermo Ayala,et al.  Spatial Size Distributions: Applications to Shape and Texture Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[73]  Fa-Xin Yu,et al.  Colour image retrieval using pattern co-occurrence matrices based on BTC and VQ , 2011 .

[74]  Jing-Yu Yang,et al.  Content-based image retrieval using computational visual attention model , 2015, Pattern Recognit..

[75]  Francesco G. B. De Natale,et al.  Content-Based Image Retrieval by Feature Adaptation and Relevance Feedback , 2007, IEEE Transactions on Multimedia.

[76]  Baijian Yang,et al.  Big Data Dimension Reduction Using PCA , 2016, 2016 IEEE International Conference on Smart Cloud (SmartCloud).

[77]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[78]  Nam Chul Kim,et al.  Content-Based Image Retrieval Using Multiresolution Color and Texture Features , 2008, IEEE Transactions on Multimedia.

[79]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[80]  Hasan Demirel,et al.  Application of NSGA-II to feature selection for facial expression recognition , 2011, Comput. Electr. Eng..

[81]  Wang Wenyan,et al.  The Research on Video Retrieval Based on Content for Industrial Applications , 2012 .

[82]  Rama Chellappa,et al.  Classification of textures using Gaussian Markov random fields , 1985, IEEE Trans. Acoust. Speech Signal Process..

[83]  Ronan Sicre,et al.  Particular object retrieval with integral max-pooling of CNN activations , 2015, ICLR.

[84]  Xiaodong Li,et al.  A Non-dominated Sorting Particle Swarm Optimizer for Multiobjective Optimization , 2003, GECCO.

[85]  Jian Zhuang,et al.  Multi-objective unsupervised feature selection algorithm utilizing redundancy measure and negative epsilon-dominance for fault diagnosis , 2014, Neurocomputing.

[86]  Deepak Shete,et al.  Content Based Image Retrieval : Review , 2012 .

[87]  9th International Symposium on Signal Processing and Its Applications, ISSPA 2007, Sharjah, United Arab Emirates, February 12-15, 2007 , 2007, ISSPA.

[88]  Dr. C. Chandrasekar,et al.  Feature Selection Using ABC forthe Lung CT Scan Images , 2014 .