A semi-supervised trace lasso norm regularized image classification method

Since the cost of labeling data is getting higher and higher, it is essential to develop some algorithms for practical applications especially when only a small number of labeled images are available. We deal with this by designing a novel model and show that with a small amount of unlabeled samples added to the training set the classification result can be effectively promoted. In our method the query image is collaboratively represented by the whole training samples, whether they are labeled or unlabeled. There are two regularization terms. Rather than getting the sample sparsity, the first regularization term, a variant Trace Lasso norm, forces the group sparsity, which means the query image is presented by a small number of groups, say one or two groups, and in each group the training samples are fully used. This sparsity between groups and density within a group is preferred to the aim of face classification. The similarity matrix is used in the second term to obtain the pseudo-labels for the unlabeled training samples, thus the whole samples are classified into different groups, each one corresponding to a class. Augmented Lagrange Multiplier scheme and Alternating Direction Method of Multiplier are given to solve the problem numerically. Some experiments are conducted to show the performance of the proposed work.

[1]  Vijay John,et al.  Gabor Filter and Gershgorin Disk-based Convolutional Filter Constraining for Image Classification , 2017 .

[2]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010 .

[3]  Xudong Jiang,et al.  Supervised trace lasso for robust face recognition , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[4]  Shuying Li,et al.  CapsNet, CNN, FCN: Comparative Performance Evaluation for Image Classification , 2019 .

[5]  Amirthalingam Ramanan,et al.  Image Classification of Paddy Field Insect Pests Using Gradient-Based Features , 2014 .

[6]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale l1-Regularized Logistic Regression , 2007, J. Mach. Learn. Res..

[7]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[8]  Kittisak Kerdprasop,et al.  Evaluating on the Transfer Learning of CNN Architectures to a Construction Material Image Classification Task , 2019, International Journal of Machine Learning and Computing.

[9]  David J. Kriegman,et al.  Acquiring linear subspaces for face recognition under variable lighting , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Fang Zhao,et al.  Towards Pose Invariant Face Recognition in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Jian Yang,et al.  Beyond sparsity: The role of L1-optimizer in pattern classification , 2012, Pattern Recognit..

[13]  Qing Wang,et al.  Distance metric optimization driven convolutional neural network for age invariant face recognition , 2018, Pattern Recognit..

[14]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[15]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[16]  Francis R. Bach,et al.  Trace Lasso: a trace norm regularization for correlated designs , 2011, NIPS.

[17]  Jia Liu,et al.  The neural network for face recognition: Insights from an fMRI study on developmental prosopagnosia , 2018, NeuroImage.

[18]  Xiaoming Liu,et al.  Multi-Task Convolutional Neural Network for Pose-Invariant Face Recognition , 2017, IEEE Transactions on Image Processing.