Multiple Instance Learning for Automatic Image Annotation

Most traditional approaches for automatic image annotation cannot provide reliable annotations at the object level because it could be very expensive to obtain large amounts of labeled object-level images associated to individual regions. To reduce the cost for manually annotating at the object level, multiple instance learning, which can leverage loosely-labeled training images for object classifier training, has become a popular research topic in the multimedia research community. One bottleneck for supporting multiple instance learning is the computational cost on searching and identifying positive instances in the positive bags. In this paper, a novel two-stage multiple instance learning algorithm is developed for automatic image annotation. The affinity propagation(AP) clustering technique is performed on the instances both in the positive bags and the negative bags to identify the candidates of the positive instances and initialize the maximum searching of Diverse Density likelihood in the first stage. In the second stage, the most positive instances are then selected out in each bag to simply the computing procedure of Diverse Density likelihood. Our experiments on two well-known image sets have provided very positive results.

[1]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[2]  Ramesh C. Jain,et al.  Image annotation by kNN-sparse graph-based label propagation over noisily tagged web images , 2011, TIST.

[3]  Rong Yan,et al.  Multiple instance learning for labeling faces in broadcasting news video , 2005, MULTIMEDIA '05.

[4]  Tomás Lozano-Pérez,et al.  A Framework for Multiple-Instance Learning , 1997, NIPS.

[5]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[6]  Tat-Seng Chua,et al.  NUS-WIDE: a real-world web image database from National University of Singapore , 2009, CIVR '09.

[7]  Thomas Hofmann,et al.  Support Vector Machines for Multiple-Instance Learning , 2002, NIPS.

[8]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[9]  Yixin Chen,et al.  MILES: Multiple-Instance Learning via Embedded Instance Selection , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Changsheng Xu,et al.  Weakly Supervised Graph Propagation Towards Collective Image Parsing , 2012, IEEE Transactions on Multimedia.

[11]  G. Qiu Indexing chromatic and achromatic patterns for content-based colour image retrieval , 2002, Pattern Recognit..

[12]  Neil D. Lawrence,et al.  Missing Data in Kernel PCA , 2006, ECML.

[13]  Jianping Fan,et al.  Leveraging loosely-tagged images and inter-object correlations for tag recommendation , 2010, ACM Multimedia.

[14]  Mohammad H. Poursaeidi,et al.  Robust support vector machines for multiple instance learning , 2012, Annals of Operations Research.

[15]  Tao Mei,et al.  Concurrent Multiple Instance Learning for Image Categorization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Qi Zhang,et al.  EM-DD: An Improved Multiple-Instance Learning Technique , 2001, NIPS.

[17]  Kristen Grauman,et al.  Keywords to visual categories: Multiple-instance learning forweakly supervised object categorization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Paul A. Viola,et al.  Multiple Instance Boosting for Object Detection , 2005, NIPS.

[19]  Dong Wang,et al.  Multiple-Instance Learning Via Random Walk , 2006, ECML.

[20]  Jun Wang,et al.  Solving the Multiple-Instance Problem: A Lazy Learning Approach , 2000, ICML.

[21]  B. S. Manjunath,et al.  Color image segmentation , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).