Intelligent Image Retrieval Based on Multi-swarm of Particle Swarm Optimization and Relevance Feedback

In recent years, Convolutional Neural Networks (CNNs) have promoted greatly the development of image retrieval, intelligent image retrieval still faces challenges. An intrinsic challenge in intelligent image retrieval exists the intention gap between the real intention of the users and the representation of users’ query, besides the well-known semantic gap. To address these problems, we propose a novel method that incorporates a relevance feedback (RF) method with an evolutionary stochastic algorithm, called multi-swarm of particle swarm optimization (MPSO), as a way to grasp the users’ perception of relevance through optimized iterative learning. One main component of our method, MPSO, can effectively prevent the retrieval system from falling into local optimal and dispose of those redundant particles, which can improve the diversity of particles. Moreover, we also present a simple but effective similarity ranking algorithm to increase retrieval speed, which can consider synthetically not only the fitness of each query point in feature space, but also the similarity of the image sequence corresponding to each query point. Extensive experiments on three publicly available datasets demonstrate that our method significantly improves the precision, recall as well as the user experience.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Krishna M P Akshay,et al.  A Novel Based Decision Tree for Content Based Image Retrieval: An Optimal Classification Approach , 2018, 2018 International Conference on Communication and Signal Processing (ICCSP).

[3]  Giorgos Tolias,et al.  Fine-Tuning CNN Image Retrieval with No Human Annotation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Qi Tian,et al.  SIFT Meets CNN: A Decade Survey of Instance Retrieval , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Djemel Ziou,et al.  Image retrieval based on feature weighting and relevance feedback , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[6]  Yuanxiang Li,et al.  Interactive differential evolution for user-oriented image retrieval system , 2016, Soft Comput..

[7]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Francesco G. B. De Natale,et al.  Content-Based Image Retrieval by Feature Adaptation and Relevance Feedback , 2007, IEEE Transactions on Multimedia.

[9]  Aboul Ella Hassanien,et al.  Multi-objective whale optimization algorithm for content-based image retrieval , 2018, Multimedia Tools and Applications.

[10]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[11]  Paolo Rocca,et al.  Content-based image retrieval by a semi-supervised Particle Swarm Optimization , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[12]  Tao Jiang,et al.  Environmental microorganism image retrieval using multiple colour channels fusion and particle swarm optimisation , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[13]  Philip S. Yu,et al.  Efficient Relevance Feedback for Content-Based Image Retrieval by Mining User Navigation Patterns , 2011, IEEE Transactions on Knowledge and Data Engineering.

[14]  Qi Tian,et al.  Update relevant image weights for content-based image retrieval using support vector machines , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[15]  Kosin Chamnongthai,et al.  Fusion of color histogram and LBP-based features for texture image retrieval and classification , 2017, Inf. Sci..

[16]  V. Seenivasagam,et al.  Different relevance feedback techniques in CBIR: A survey and comparative study , 2012, 2012 International Conference on Computing, Electronics and Electrical Technologies (ICCEET).

[17]  Mznah Al-Rodhaan,et al.  Content-based image retrieval using PSO and k-means clustering algorithm , 2015, Arabian Journal of Geosciences.

[18]  Ebroul Izquierdo,et al.  An Object- and User-Driven System for Semantic-Based Image Annotation and Retrieval , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Guangchun Luo,et al.  A Hybrid PSO and SVM Algorithm for Content Based Image Retrieval , 2016, ICCSA.

[20]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[21]  Yimin Wu,et al.  A feature re-weighting approach for relevance feedback in image retrieval , 2002, Proceedings. International Conference on Image Processing.