Semi-Supervised Subspace Learning for Pattern Classification via Robust Low Rank Constraint

Feature subspace learning is a crucial issue in pattern analysis. However, it remains challenging when partial samples are unlabeled, which will cause weak discrimination. In this paper, we present a novel semi-supervised learning model that is capable of utilizing labeled and unlabeled training data simultaneously to learn discriminative feature subspace while preserving their locality. To achieve this goal, we joint learning feature subspace and completed labels. In the framework, low rank representation model is firstly exploited to explore the similarity relationship among all training samples, including labeled and unlabeled data. Then, the learned representation coefficients are used to generate a dynamic neighbor graph for designing the locality preservation constraints on both of label propagation and feature subspace. Finally, the prediction and true label are used to enforce the discrimination of feature subspace in the semantic space. Extensive experiment indicates that our proposed approach is more competitive than other comparison methods, while the model shows more robustness when training datasets are contaminated with noise.

[1]  Zhao Kang,et al.  Subspace Clustering via Variance Regularized Ridge Regression , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Junfeng Yang,et al.  A Fast Algorithm for Edge-Preserving Variational Multichannel Image Restoration , 2009, SIAM J. Imaging Sci..

[3]  Ivor W. Tsang,et al.  Flexible Manifold Embedding: A Framework for Semi-Supervised and Unsupervised Dimension Reduction , 2010, IEEE Transactions on Image Processing.

[4]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[5]  Huiyu Zhou,et al.  A Robust Parallel Object Tracking Method for Illumination Variations , 2018, Mobile Networks and Applications.

[6]  George Trigeorgis,et al.  Joint Multi-View Face Alignment in the Wild , 2017, IEEE Transactions on Image Processing.

[7]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[8]  Wotao Yin,et al.  A feasible method for optimization with orthogonality constraints , 2013, Math. Program..

[9]  Bin Shen,et al.  Online robust image alignment via iterative convex optimization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Rong Wang,et al.  Unsupervised Linear Discriminant Analysis for Jointly Clustering and Subspace Learning , 2019, IEEE Transactions on Knowledge and Data Engineering.

[11]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[12]  Yuan-Hai Shao,et al.  Robust and Sparse Linear Discriminant Analysis via an Alternating Direction Method of Multipliers , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Guanglu Sun,et al.  Self-supervised sparse coding scheme for image classification based on low rank representation , 2018, PloS one.

[14]  Bo Tang,et al.  Semisupervised Feature Selection Based on Relevance and Redundancy Criteria , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Guanglu Sun,et al.  Subspace structural constraint-based discriminative feature learning via nonnegative low rank representation , 2019, PloS one.

[17]  Qidi Wu,et al.  The application of nonlocal total variation in image denoising for mobile transmission , 2017, Multimedia Tools and Applications.

[18]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[19]  Hossein Mobahi,et al.  Holistic 3D reconstruction of urban structures from low-rank textures , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[20]  Lunke Fei,et al.  Robust Sparse Linear Discriminant Analysis , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Kejia Zhang,et al.  A multi-focus image fusion algorithm in 5G communications , 2018, Multimedia Tools and Applications.

[22]  Haoran Xie,et al.  Structure-guided shape-preserving mesh texture smoothing via joint low-rank matrix recovery , 2019, Comput. Aided Des..

[23]  Jiawei Han,et al.  Spectral Regression: A Unified Approach for Sparse Subspace Learning , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[24]  Daming Shi,et al.  Low-Rank-Sparse Subspace Representation for Robust Regression , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Zheng Pan,et al.  A NOVEL FAST FRACTAL IMAGE COMPRESSION METHOD BASED ON DISTANCE CLUSTERING IN HIGH DIMENSIONAL SPHERE SURFACE , 2017 .

[26]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[27]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[28]  Zheng Dou,et al.  An Adaptive Resource Allocation Model With Anti-Jamming in IoT Network , 2019, IEEE Access.

[29]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[30]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[31]  Wai Keung Wong,et al.  Low-Rank Embedding for Robust Image Feature Extraction , 2017, IEEE Transactions on Image Processing.

[32]  Arik Azran,et al.  The rendezvous algorithm: multiclass semi-supervised learning with Markov random walks , 2007, ICML '07.

[33]  Lin Wu,et al.  Multiview Spectral Clustering via Structured Low-Rank Matrix Factorization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Shichao Zhang,et al.  Low-Rank Sparse Subspace for Spectral Clustering , 2019, IEEE Transactions on Knowledge and Data Engineering.

[35]  Hari M. Srivastava,et al.  Parallel Fractal Compression Method for Big Video Data , 2018, Complex..

[36]  Wu Qidi,et al.  The Nonlocal Sparse Reconstruction Algorithm by Similarity Measurement with Shearlet Feature Vector , 2014 .

[37]  Mikhail Belkin,et al.  Beyond the point cloud: from transductive to semi-supervised learning , 2005, ICML.

[38]  Yu Zhang,et al.  Sparse Group Representation Model for Motor Imagery EEG Classification , 2019, IEEE Journal of Biomedical and Health Informatics.

[39]  Feiping Nie,et al.  Semi-supervised Feature Selection via Rescaled Linear Regression , 2017, IJCAI.

[40]  Zhao Kang,et al.  Kernel-driven similarity learning , 2017, Neurocomputing.

[41]  Ming Shao,et al.  Generalized Transfer Subspace Learning Through Low-Rank Constraint , 2014, International Journal of Computer Vision.

[42]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[43]  Tong Liu,et al.  A Node Self-Localization Algorithm With a Mobile Anchor Node in Underwater Acoustic Sensor Networks , 2019, IEEE Access.

[44]  Yun Fu,et al.  Robust Multi-View Subspace Learning through Dual Low-Rank Decompositions , 2016, AAAI.

[45]  Jiawei Han,et al.  Semi-supervised Discriminant Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[46]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[47]  Guanglu Sun,et al.  Collaborative Self-Regression Method With Nonlinear Feature Based on Multi-Task Learning for Image Classification , 2018, IEEE Access.

[48]  Tommi S. Jaakkola,et al.  Partially labeled classification with Markov random walks , 2001, NIPS.