Efficient semi-supervised annotation with Proxy-based Local Consistency Propagation

Semi-supervised learning methods can largely leverage the image annotation problem using both labeled and unlabeled data, especially when the labeled information is quite limited. However, most of them suffer the expensive computation stemming from the batch learning on large training dataset. In this paper we proposed a highly efficient semi-supervised annotation approach with the partial label propagation based on the graph representation. Specifically, the label information is first propagated from labeled samples to the unlabeled ones, and then spreads only among unlabeled ones like a spreading activation network. Our approach takes advantage of the decomposed formulation to achieve a fast incremental learning instead of the expensive batch one without accuracy loss. Extensive evaluations over two large datasets demonstrate the superior performance of the proposed method and its significant efficiency.

[1]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[2]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[3]  Shih-Fu Chang,et al.  Graph construction and b-matching for semi-supervised learning , 2009, ICML '09.

[4]  Changsheng Xu,et al.  A Generic Framework for Video Annotation via Semi-Supervised Learning , 2012, IEEE Transactions on Multimedia.

[5]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..

[6]  Hamid R. Rabiee,et al.  Isograph: Neighbourhood Graph Construction Based on Geodesic Distance for Semi-supervised Learning , 2011, 2011 IEEE 11th International Conference on Data Mining.

[7]  Meng Wang,et al.  Structure-sensitive manifold ranking for video concept detection , 2007, ACM Multimedia.

[8]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[9]  Ramesh C. Jain,et al.  Image annotation by kNN-sparse graph-based label propagation over noisily tagged web images , 2011, TIST.

[10]  Ming Li,et al.  Online Manifold Regularization: A New Learning Setting and Empirical Study , 2008, ECML/PKDD.

[11]  Jeff Shrager,et al.  Observation of Phase Transitions in Spreading Activation Networks , 1987, Science.

[12]  Shih-Fu Chang,et al.  Compact hashing for mixed image-keyword query over multi-label images , 2012, ICMR '12.

[13]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[14]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[15]  Xiaobo Zhou,et al.  Active microscopic cellular image annotation by superposable graph transduction with imbalanced labels , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Xiaojin Zhu,et al.  Some new directions in graph-based semi-supervised learning , 2009, 2009 IEEE International Conference on Multimedia and Expo.