Concept-dependent image annotation via existence-based multiple-instance learning

Conventional multiple-instance learning (MIL) algorithms for image annotation usually neglect concept dependence (i.e., the relationship between positive and negative concepts) and feature selection (i.e., which feature modality is suitable for a specific concept) problems, which have significant influence on the annotation performance. In this paper, we propose a novel concept-dependent algorithm for image annotation, named existence-based MIL (EBMIL), aiming at solving the above two problems in one scheme. In our EBMIL scheme, we give a new MIL formulation, named existence-based MIL, to explore the concept dependence in image annotation. Moreover, we give an optimization procedure in EBMIL, which is able to select different feature modalities for each concept under MIL settings. EBMIL achieves promising experimental results on the benchmark of COREL dataset with comparison to typical MIL algorithms.

[1]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[2]  Bernhard Pfahringer,et al.  A Two-Level Learning Method for Generalized Multi-instance Problems , 2003, ECML.

[3]  Tao Mei,et al.  Concurrent Multiple Instance Learning for Image Categorization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Yixin Chen,et al.  Image Categorization by Learning and Reasoning with Regions , 2004, J. Mach. Learn. Res..

[5]  Zhi-Hua Zhou,et al.  Solving multi-instance problems with classifier ensemble based on constructive clustering , 2007, Knowledge and Information Systems.

[6]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[7]  Xin Xu,et al.  Logistic Regression and Boosting for Labeled Bags of Instances , 2004, PAKDD.

[8]  I. Jolliffe.  Principal Component Analysis , 2002 .

[9]  John R. Smith,et al.  On the detection of semantic concepts at TRECVID , 2004, MULTIMEDIA '04.

[10]  Oded Maron,et al.  Multiple-Instance Learning for Natural Scene Classification , 1998, ICML.

[11]  Zhi-Hua Zhou,et al.  Improve Multi-Instance Neural Networks through Feature Selection , 2004, Neural Processing Letters.

[12]  B. S. Manjunath,et al.  Unsupervised Segmentation of Color-Texture Regions in Images and Video , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Yixin Chen,et al.  MILES: Multiple-Instance Learning via Embedded Instance Selection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Meng Wang,et al.  A Novel Multiple Instance Learning Approach for Image Retrieval Based on Adaboost Feature Selection , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[15]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[16]  Yixin Chen,et al.  A sparse support vector machine approach to region-based image categorization , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).