Image classifier learning from noisy labels via generalized graph smoothness priors

When collecting samples via crowd-sourcing for semi-supervised learning, often labels that designate events of interest are assigned unreliably, resulting in label noise. In this paper, we propose a robust method for graph-based image classifier learning given noisy labels, leveraging on recent advances in graph signal processing. In particular, we formulate a graph-signal restoration problem, where the objective includes a fidelity term to minimize the lo-norm between the observed labels and a reconstructed graph-signal, and generalized graph smoothness priors, where we assume that the reconstructed signal and its gradient are both smooth with respect to a graph. The optimization problem can be efficiently solved via an iterative reweighted least square (IRLS) algorithm. Simulation results show that for two image datasets with varying amounts of label noise, our proposed algorithm outperforms both regular SVM and a noisy-label learning approach in the literature noticeably.

[1]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[2]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[3]  Sunil K. Narang,et al.  Signal processing techniques for interpolation in graph structured data , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Xianming Liu,et al.  Inter-block consistent soft decoding of JPEG images with sparsity and graph-signal smoothness priors , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[5]  Derek Greene,et al.  The Interaction Between Supervised Learning and Crowdsourcing , 2010 .

[6]  Yichen Wang,et al.  Detecting Emotions in Social Media: A Constrained Optimization Approach , 2015, IJCAI.

[7]  Antonio Ortega,et al.  Active semi-supervised learning using sampling theory for graph signals , 2014, KDD.

[8]  Jason Baldridge,et al.  Twitter Polarity Classification with Label Propagation over Lexical Links and the Follower Graph , 2011, ULNLP@EMNLP.

[9]  Oscar C. Au,et al.  Image bit-depth enhancement via maximum-a-posteriori estimation of graph AC component , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[10]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[11]  Sunil K. Narang,et al.  Localized iterative methods for interpolation in graph structured data , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[12]  Oscar C. Au,et al.  Optimal graph laplacian regularization for natural image denoising , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  José M. F. Moura,et al.  Signal Recovery on Graphs: Variation Minimization , 2014, IEEE Transactions on Signal Processing.

[14]  Kristian Bredies,et al.  A TGV-Based Framework for Variational Image Decompression, Zooming, and Reconstruction. Part I: Analytics , 2015, SIAM J. Imaging Sci..

[15]  Oscar C. Au,et al.  Redefining self-similarity in natural images for denoising using graph signal gradient , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[16]  Oscar C. Au,et al.  Depth map denoising using graph-based transform and group sparsity , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[17]  Chun Chen,et al.  Active Learning Based on Locally Linear Reconstruction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Benoît Frénay,et al.  Special issue on advances in learning with label noise , 2015, Neurocomputing.

[19]  Jeff A. Bilmes,et al.  Label Selection on Graphs , 2009, NIPS.

[20]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.