Online semi-supervised annotation via proxy-based local consistency propagation

Abstract In this paper, we propose a novel label propagation algorithm named Proxy-based Local Consistency Propagation (PLCP), in which the label information is first propagated from labeled examples to the unlabeled ones, and then spreads only among unlabeled ones mutually until a steady state is reached. To meet the requirements of efficiency in many real-world image annotation applications, we propose an online semi-supervised annotation framework where the new examples can be predicted and used to update the model. Specifically, we extend PLCP to work under an inductive setting and propose an incremental model updating method that can incorporate the new examples including labeled and unlabeled examples. The comprehensive experiments on MNIST, CIFAR-10 and PIE datasets show that our proposed PLCP achieves superior performance compared with the baselines, and our proposed incremental model updating method can achieve significant promotion in efficiency, with the nearly identical accuracy compared to re-training.

[1]  Ling Huang,et al.  Online Semi-Supervised Learning on Quantized Graphs , 2010, UAI.

[2]  Changsheng Xu,et al.  A Generic Framework for Video Annotation via Semi-Supervised Learning , 2012, IEEE Transactions on Multimedia.

[3]  Ming Li,et al.  Online Manifold Regularization: A New Learning Setting and Empirical Study , 2008, ECML/PKDD.

[4]  Yau-Hwang Kuo,et al.  Learning collaborative decision-making parameters for multimodal emotion recognition , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[6]  Shai Shalev-Shwartz,et al.  Online Learning and Online Convex Optimization , 2012, Found. Trends Mach. Learn..

[7]  Changsheng Xu,et al.  Weakly Supervised Graph Propagation Towards Collective Image Parsing , 2012, IEEE Transactions on Multimedia.

[8]  Nenghai Yu,et al.  Non-negative low rank and sparse graph for semi-supervised learning , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Lei Huang,et al.  Efficient semi-supervised annotation with Proxy-based Local Consistency Propagation , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[10]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[11]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[12]  Meng Wang,et al.  Structure-sensitive manifold ranking for video concept detection , 2007, ACM Multimedia.

[13]  Rongrong Ji,et al.  Visual Reranking through Weakly Supervised Multi-graph Learning , 2013, 2013 IEEE International Conference on Computer Vision.

[14]  Nicolas Le Roux,et al.  Efficient Non-Parametric Function Induction in Semi-Supervised Learning , 2004, AISTATS.

[15]  Jun Yu,et al.  Graph based transductive learning for cartoon correspondence construction , 2012, Neurocomputing.

[16]  Shih-Fu Chang,et al.  Graph construction and b-matching for semi-supervised learning , 2009, ICML '09.

[17]  Xiaobo Zhou,et al.  Active microscopic cellular image annotation by superposable graph transduction with imbalanced labels , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Jeff Shrager,et al.  Observation of Phase Transitions in Spreading Activation Networks , 1987, Science.

[19]  Ran He,et al.  Nonnegative sparse coding for discriminative semi-supervised learning , 2011, CVPR 2011.

[20]  Hamid R. Rabiee,et al.  Isograph: Neighbourhood Graph Construction Based on Geodesic Distance for Semi-supervised Learning , 2011, 2011 IEEE 11th International Conference on Data Mining.

[21]  Jun-Ming Xu,et al.  OASIS: Online Active Semi-Supervised Learning , 2011, AAAI.

[22]  Gustavo Carneiro,et al.  Graph-based methods for the automatic annotation and retrieval of art prints , 2011, ICMR.

[23]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[24]  Xiaojin Zhu,et al.  Some new directions in graph-based semi-supervised learning , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[25]  Ramesh C. Jain,et al.  Image annotation by kNN-sparse graph-based label propagation over noisily tagged web images , 2011, TIST.

[26]  Martial Hebert,et al.  Semi-Supervised Self-Training of Object Detection Models , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[27]  Xian-Sheng Hua,et al.  Ensemble Manifold Regularization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2008, IEEE Trans. Knowl. Data Eng..

[29]  Wei Liu,et al.  Large Graph Construction for Scalable Semi-Supervised Learning , 2010, ICML.

[30]  Bingbing Ni,et al.  Learning a Propagable Graph for Semisupervised Learning: Classification and Regression , 2012, IEEE Transactions on Knowledge and Data Engineering.

[31]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[32]  Feiping Nie,et al.  Unsupervised and semi-supervised learning via ℓ1-norm graph , 2011, 2011 International Conference on Computer Vision.

[33]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[34]  Ronald L. Rivest,et al.  Introduction to Algorithms, third edition , 2009 .

[35]  Shih-Fu Chang,et al.  Mixed image-keyword query adaptive hashing over multilabel images , 2014, TOMCCAP.

[36]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[37]  Shuicheng Yan,et al.  Hidden-Concept Driven Multilabel Image Annotation and Label Ranking , 2012, IEEE Transactions on Multimedia.

[38]  Shih-Fu Chang,et al.  Hash Bit Selection: A Unified Solution for Selection Problems in Hashing , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Horst Bischof,et al.  On-line semi-supervised multiple-instance boosting , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Gustavo Carneiro,et al.  Incremental on-line semi-supervised learning for segmenting the left ventricle of the heart from ultrasound data , 2011, 2011 International Conference on Computer Vision.

[41]  Shih-Fu Chang,et al.  Semi-Supervised Hashing for Large-Scale Search , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[43]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[44]  Xianchao Zhang,et al.  Graph-Based Semi-supervised Learning with Adaptive Similarity Estimation , 2010, 2010 IEEE International Conference on Data Mining.

[45]  Zhiwu Lu,et al.  Multi-modal constraint propagation for heterogeneous image clustering , 2011, ACM Multimedia.