Discriminative Label Relaxed Regression with Adaptive Graph Learning

The traditional label relaxation regression (LRR) algorithm directly fits the original data without considering the local structure information of the data. While the label relaxation regression algorithm of graph regularization takes into account the local geometric information, the performance of the algorithm depends largely on the construction of graph. However, the traditional graph structures have two defects. First of all, it is largely influenced by the parameter values. Second, it relies on the original data when constructing the weight matrix, which usually contains a lot of noise. This makes the constructed graph to be often not optimal, which affects the subsequent work. Therefore, a discriminative label relaxation regression algorithm based on adaptive graph (DLRR_AG) is proposed for feature extraction. DLRR_AG combines manifold learning with label relaxation regression by constructing adaptive weight graph, which can well overcome the problem of label overfitting. Based on a large number of experiments, it can be proved that the proposed method is effective and feasible.

[1]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[3]  Jing-Yu Yang,et al.  Illumination invariant extraction for face recognition using neighboring wavelet coefficients , 2012, Pattern Recognit..

[4]  Kevin Chen-Chuan Chang,et al.  A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[5]  Jiwen Lu,et al.  Automatic Subspace Learning via Principal Coefficients Embedding , 2014, IEEE Transactions on Cybernetics.

[6]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[7]  Wai Keung Wong,et al.  Low-Rank Embedding for Robust Image Feature Extraction , 2017, IEEE Transactions on Image Processing.

[8]  Feiping Nie,et al.  Discriminative Least Squares Regression for Multiclass Classification and Feature Selection , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Quanxue Gao,et al.  Joint Global and Local Structure Discriminant Analysis , 2013, IEEE Transactions on Information Forensics and Security.

[10]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[11]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Xuelong Li,et al.  Multi-View Clustering and Semi-Supervised Classification with Adaptive Neighbours , 2017, AAAI.

[13]  Binbin Pan,et al.  Local and Non-Local Feature-Based Kernel Nonnegative Matrix Factorization Method for Face Recognition , 2016, 2016 12th International Conference on Computational Intelligence and Security (CIS).

[14]  Jian Yang,et al.  LPP solution schemes for use with face recognition , 2010, Pattern Recognit..

[15]  Xuelong Li,et al.  Deterministic Column-Based Matrix Decomposition , 2010, IEEE Transactions on Knowledge and Data Engineering.

[16]  Liujuan Cao,et al.  Toward Optimal Manifold Hashing via Discrete Locally Linear Embedding , 2017, IEEE Transactions on Image Processing.

[17]  Jun Li,et al.  An improvement to linear regression classification for face recognition , 2018, Int. J. Mach. Learn. Cybern..

[18]  Hong Liu,et al.  Modified minimum squared error algorithm for robust classification and face recognition experiments , 2014, Neurocomputing.

[19]  Jiwen Lu,et al.  Single Sample Face Recognition via Learning Deep Supervised Autoencoders , 2015, IEEE Transactions on Information Forensics and Security.

[20]  Fang Liu,et al.  Semi-supervised double sparse graphs based discriminant analysis for dimensionality reduction , 2017, Pattern Recognit..

[21]  Heyan Huang,et al.  Concept Representation by Learning Explicit and Implicit Concept Couplings , 2021, IEEE Intelligent Systems.

[22]  Meng Wang,et al.  Robust Unsupervised Flexible Auto-weighted Local-coordinate Concept Factorization for Image Clustering , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Denis Hamad,et al.  Constraint scores for semi-supervised feature selection: A comparative study , 2011, Pattern Recognit. Lett..

[25]  Ran He,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Chunhong Pan,et al.  Manifold Regularized Local Sparse Representation for Face Recognition , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  HeRan,et al.  Maximum Correntropy Criterion for Robust Face Recognition , 2011 .

[28]  Gil González-Rodríguez,et al.  Inferential studies for a flexible linear regression model for interval-valued variables , 2016, Int. J. Comput. Math..

[29]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[30]  Lei Wang,et al.  Feature Selection With Redundancy-Constrained Class Separability , 2010, IEEE Transactions on Neural Networks.

[31]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Yandong Hou,et al.  Sparse representation-based robust face recognition by graph regularized low-rank sparse representation recovery , 2015, Neurocomputing.

[33]  Li Wang,et al.  Hybrid huberized support vector machines for microarray classification , 2007, ICML '07.

[34]  Xuelong Li,et al.  Learning a Nonnegative Sparse Graph for Linear Regression , 2015, IEEE Transactions on Image Processing.

[35]  Tuomo Kauranne,et al.  A combination of fuzzy similarity measures and fuzzy entropy measures for supervised feature selection , 2018, Expert Syst. Appl..

[36]  Yong Peng,et al.  Enhanced low-rank representation via sparse manifold adaption for semi-supervised learning , 2015, Neural Networks.

[37]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[38]  Bob Zhang,et al.  Adaptive Graph Completion Based Incomplete Multi-View Clustering , 2020, IEEE Transactions on Multimedia.

[39]  Qian Zhang,et al.  Research of improving semantic image segmentation based on a feature fusion model , 2020, Journal of Ambient Intelligence and Humanized Computing.

[40]  Ivor W. Tsang,et al.  Flexible Manifold Embedding: A Framework for Semi-Supervised and Unsupervised Dimension Reduction , 2010, IEEE Transactions on Image Processing.

[41]  Jun Zhou,et al.  Query-expanded collaborative representation based classification with class-specific prototypes for object recognition , 2014, Pattern Recognit..

[42]  Ling Shao,et al.  Discriminative Fisher Embedding Dictionary Learning Algorithm for Object Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Zheng Zhang,et al.  Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion , 2020, IEEE Transactions on Cybernetics.

[44]  Ioannis Patras,et al.  Tree-Structured Feature Extraction Using Mutual Information , 2012, IEEE Transactions on Neural Networks and Learning Systems.