Active Framework by Sparsity Exploitation for Constructing a Training Set

This paper addresses the problem of actively constructing a training set for the linear model with sparse structure. This problem usually occurs in the scenario that no nonlinear mappings give similar performance for large-scale learning data, but it has to train a linear model quickly. In this paper, an active framework is proposed to reduce the time expense further in constructing the training set. The training examples are iteratively selected by matching partial components and their weights given by the classifier in pairs, in order to exploit model’s sparsity to precisely separate out more informative examples from others in a short time. The proposed framework is evaluated on a group of classification tasks, including the texts and images.

[1]  Cees Snoek,et al.  Active Transfer Learning with Zero-Shot Priors: Reusing Past Datasets for Future Tasks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Kristen Grauman,et al.  Look-Ahead Before You Leap: End-to-End Active Recognition by Forecasting the Effect of Motion , 2016, ECCV.

[3]  Andrew W. Fitzgibbon,et al.  PiCoDes: Learning a Compact Code for Novel-Category Recognition , 2011, NIPS.

[4]  Andrew W. Fitzgibbon,et al.  Efficient Object Category Recognition Using Classemes , 2010, ECCV.

[5]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[6]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[7]  Junmo Kim,et al.  Active Convolution: Learning the Shape of Convolution for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Rong Jin,et al.  Active Learning by Querying Informative and Representative Examples , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[10]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[11]  Trevor Darrell,et al.  Gaussian Processes for Object Categorization , 2010, International Journal of Computer Vision.

[12]  Jan C. van Gemert,et al.  Active Decision Boundary Annotation with Deep Generative Models , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  David D. Lewis,et al.  Heterogeneous Uncertainty Sampling for Supervised Learning , 1994, ICML.