A new SVM-based relevance feedback image retrieval using probabilistic feature and weighted kernel function

By using PCA and AGMM, probabilistic features are extracted and used for fast image retrieval.By using improved Relief algorithm, all training sample' weight values are computed and utilized for feedback.SVM kernel function is optimized dynamically according to the feedback samples' weight values. Relevance feedback (RF) is an effective approach to bridge the gap between low-level visual features and high-level semantic meanings in content-based image retrieval (CBIR). The support vector machine (SVM) based RF mechanisms have been used in different fields of image retrieval, but they often treat all positive and negative feedback samples equally, which will inevitably degrade the effectiveness of SVM-based RF approaches for CBIR. In fact, positive and negative feedback samples, different positive feedback samples, and different negative feedback samples all always have distinct properties. Moreover, each feedback interaction process is usually tedious and time-consuming because of complex visual features, so if too many times of iteration of feedback are asked, users may be impatient to interact with the CBIR system. To overcome the above limitations, we propose a new SVM-based RF approach using probabilistic feature and weighted kernel function in this paper. Firstly, the probabilistic features of each image are extracted by using principal components analysis (PCA) and the adapted Gaussian mixture models (AGMM) based dimension reduction, and the similarity is computed by employing Kullback-Leibler divergence. Secondly, the positive feedback samples and negative feedback samples are marked, and all feedback samples' weight values are computed by utilizing the samples-based Relief feature weighting. Finally, the SVM kernel function is modified dynamically according to the feedback samples' weight values. Extensive simulations on large databases show that the proposed algorithm is significantly more effective than the state-of-the-art approaches.

[1]  Y. Rui,et al.  Learning to Rank Using User Clicks and Visual Features for Image Retrieval , 2015, IEEE Transactions on Cybernetics.

[2]  Hong Shen,et al.  Learning a hybrid similarity measure for image retrieval , 2013, Pattern Recognit..

[3]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[4]  Yuru Pei,et al.  Enhanced Random Forest with Image/Patch-Level Learning for Image Understanding , 2014, 2014 22nd International Conference on Pattern Recognition.

[5]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[6]  Seiji Yamada,et al.  Semisupervised Query Expansion with Minimal Feedback , 2007, IEEE Transactions on Knowledge and Data Engineering.

[7]  Weisi Lin,et al.  Geometric Optimum Experimental Design for Collaborative Image Retrieval , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Kien A. Hua,et al.  Fast Query Point Movement Techniques for Large CBIR Systems , 2009, IEEE Transactions on Knowledge and Data Engineering.

[9]  Dacheng Tao,et al.  Large-Margin Multi-Label Causal Feature Learning , 2015, AAAI.

[10]  Mark J. Huiskes,et al.  Performance evaluation of relevance feedback methods , 2008, CIVR '08.

[11]  Djamel Bouchaffra,et al.  Genetic-based EM algorithm for learning Gaussian mixture models , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  George R. Thoma,et al.  A query expansion framework in image retrieval domain based on local and global analysis , 2011, Inf. Process. Manag..

[13]  Meng Wang,et al.  Active learning in multimedia annotation and retrieval: A survey , 2011, TIST.

[14]  Mingyue Ding,et al.  Interactive relevance feedback mechanism for image retrieval using rough set , 2006, Knowl. Based Syst..

[15]  Shang-Hong Lai,et al.  Improved AdaBoost-based image retrieval with relevance feedback via paired feature learning , 2005, Multimedia Systems.

[16]  Deok-Hwan Kim,et al.  A new region filtering and region weighting approach to relevance feedback in content-based image retrieval , 2008, J. Syst. Softw..

[17]  Rujie Liu,et al.  SVM-based active feedback in image retrieval using clustering and unlabeled data , 2008, Pattern Recognit..

[18]  Aladdin M. Ariyaeeinia,et al.  Efficient Speaker Change Detection Using Adapted Gaussian Mixture Models , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Dacheng Tao,et al.  Large-Margin Multi-ViewInformation Bottleneck , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Michael Isard,et al.  Total Recall: Automatic Query Expansion with a Generative Feature Model for Object Retrieval , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Qi Tian,et al.  Multimedia search reranking: A literature survey , 2014, CSUR.

[24]  Shiri Gordon,et al.  An efficient image similarity measure based on approximations of KL-divergence between two gaussian mixtures , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  A. Likas,et al.  Relevance feedback approach for image retrieval combining support vector machines and adapted Gaussian mixture models , 2011, IET Image Processing.

[26]  Hakan A. Çirpan,et al.  A set of new Chebyshev kernel functions for support vector machine pattern classification , 2011, Pattern Recognit..

[27]  Wei Wang,et al.  A Semi-Supervised Active Learning FSVM for Content Based Image Retrieval , 2013 .

[28]  Nikos Papamarkos,et al.  Image retrieval systems based on compact shape descriptor and relevance feedback information , 2011, J. Vis. Commun. Image Represent..

[29]  Xiangyang Wang,et al.  An image retrieval scheme with relevance feedback using feature reconstruction and SVM reclassification , 2014, Neurocomputing.

[30]  Qi Tian,et al.  Discriminant-EM algorithm with application to image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[31]  George R. Thoma,et al.  A Learning-Based Similarity Fusion and Filtering Approach for Biomedical Image Retrieval Using SVM Classification and Relevance Feedback , 2011, IEEE Transactions on Information Technology in Biomedicine.

[32]  Jun Yu,et al.  Exploiting Click Constraints and Multi-view Features for Image Re-ranking , 2014, IEEE Transactions on Multimedia.

[33]  Yijun Sun,et al.  Iterative RELIEF for Feature Weighting: Algorithms, Theories, and Applications , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Lin-Shan Lee,et al.  Enhanced Spoken Term Detection Using Support Vector Machines and Weighted Pseudo Examples , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[35]  Claudio Carpineto,et al.  A Survey of Automatic Query Expansion in Information Retrieval , 2012, CSUR.

[36]  Shyi-Ming Chen,et al.  A new query reweighting method for document retrieval based on genetic algorithms , 2006, IEEE Transactions on Evolutionary Computation.

[37]  M. de Rijke,et al.  Exploiting External Collections for Query Expansion , 2012, TWEB.

[38]  Bo Zhang,et al.  Support vector machine learning for image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[39]  Timothy A. Gonsalves,et al.  Inference Based Query Expansion Using User's Real Time Implicit Feedback , 2010, IC3K.

[40]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[41]  Philip S. Yu,et al.  Efficient Relevance Feedback for Content-Based Image Retrieval by Mining User Navigation Patterns , 2011, IEEE Transactions on Knowledge and Data Engineering.

[42]  Jean-Marc Ogier,et al.  Cluster-based relevance feedback for CBIR: a combination of query point movement and query expansion , 2012, J. Ambient Intell. Humaniz. Comput..

[43]  Jun Yu,et al.  Click Prediction for Web Image Reranking Using Multimodal Sparse Coding , 2014, IEEE Transactions on Image Processing.

[44]  Petros Daras,et al.  Gaze-Based Relevance Feedback for Realizing Region-Based Image Retrieval , 2014, IEEE Transactions on Multimedia.

[45]  Saeed Jalili,et al.  PSSP with dynamic weighted kernel fusion based on SVM-PHGS , 2012, Knowl. Based Syst..

[46]  Jing Li,et al.  Relevance Feedback in Content-Based Image Retrieval: A Survey , 2013, Handbook on Neural Information Processing.

[47]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[48]  Claudio Gutierrez,et al.  Survey of graph database models , 2008, CSUR.

[49]  Adam L. Kaczmarek,et al.  Interactive Query Expansion With the Use of Clustering-by-Directions Algorithm , 2011, IEEE Transactions on Industrial Electronics.