Active Learning Methods for Interactive Image Retrieval

Active learning methods have been considered with increased interest in the statistical learning community. Initially developed within a classification framework, a lot of extension are now being proposed to handle multimedia applications. This paper provides algorithms within a statistical framework to extend active learning for online content-based image retrieval (CBIR). The classification framework is presented with experiments to compare several powerful classification techniques in this information retrieval context. Focusing on interactive methods, active learning strategy is then described. The limitations of this approach for CBIR are emphasized before presenting our new active selection process RETIN. First, as any active method is sensitive to the boundary estimation between classes, the RETIN strategy carries out a boundary correction to make the retrieval process more robust. Second, the criterion of generalization error to optimize the active learning selection is modified to better represent the CBIR objective of database ranking. Third, a batch processing of images is proposed. Our strategy leads to a fast and efficient active learning scheme to retrieve sets of online images (query concept). Experiments on large databases show that the RETIN method performs well in comparison to several other active strategies.

[1]  Matthieu Cord,et al.  RETIN AL: an active learning strategy for image category retrieval , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[2]  Donald Geman,et al.  A Stochastic Feedback Model for Image Retrieval , 1999 .

[3]  Matthieu Cord,et al.  Stochastic exploration and active learning for image retrieval , 2007, Image Vis. Comput..

[4]  Matthieu Cord,et al.  Back-propagation algorithm for relevance feedback in image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[6]  David A. Cohn,et al.  Improving generalization with active learning , 1994, Machine Learning.

[7]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[8]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[9]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[10]  P. Gros,et al.  Recherche approximative de plus proches voisins Application à la reconnaissance d'images par descripteurs locaux , 2003 .

[11]  Robert M. Haralick,et al.  A weighted distance approach to relevance feedback , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[12]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2003, ICTAI.

[13]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[14]  Klaus Brinker,et al.  Incorporating Diversity in Active Learning with Support Vector Machines , 2003, ICML.

[15]  Edward Y. Chang,et al.  Statistical learning for effective visual information retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[16]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[17]  Bir Bhanu,et al.  Integrating relevance feedback techniques for image retrieval using reinforcement learning , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[19]  Michael Lindenbaum,et al.  Selective Sampling for Nearest Neighbor Classifiers , 1999, Machine Learning.

[20]  Matthieu Cord,et al.  A comparison of active classification methods for content-based image retrieval , 2004, CVDB '04.

[21]  Bir Bhanu,et al.  Probabilistic Feature Relevance Learning for Content-Based Image Retrieval , 1999, Comput. Vis. Image Underst..

[22]  Andrew McCallum,et al.  Toward Optimal Active Learning through Sampling Estimation of Error Reduction , 2001, ICML.

[23]  Matthieu Cord,et al.  Interactive Exploration for Image Retrieval , 2005, EURASIP J. Adv. Signal Process..

[24]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[25]  David D. Lewis,et al.  Heterogeneous Uncertainty Sampling for Supervised Learning , 1994, ICML.

[26]  Jong-Min Park On-line learning by active sampling using orthogonal decision support vectors , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[27]  Patrick Gros,et al.  Approximate searches: k-neighbors + precision , 2003, CIKM '03.

[28]  Bir Bhanu,et al.  Active concept learning in image databases , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Vapnik,et al.  SVMs for Histogram Based Image Classification , 1999 .

[30]  Nikolaos D. Doulamis,et al.  A recursive optimal relevance feedback scheme for content based image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[31]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[32]  Nuno Vasconcelos,et al.  Bayesian models for visual information retrieval , 2000 .

[33]  Matthieu Cord,et al.  Discriminative Classification vs Modeling Methods in CBIR , 2004 .

[34]  T.S. Huang,et al.  A relevance feedback architecture for content-based multimedia information retrieval systems , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[35]  Vijay V. Raghavan,et al.  Content-Based Image Retrieval Systems - Guest Editors' Introduction , 1995, Computer.

[36]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[37]  Murat Kunt,et al.  Content-based retrieval from image databases: current solutions and future directions , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[38]  Thomas S. Huang,et al.  One-class SVM for learning in image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[39]  Christophe Ambroise,et al.  Feature selection for semisupervised learning applied to image retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).