Discriminative globality and locality preserving graph embedding for dimensionality reduction

Abstract Graph embedding in dimensionality reduction has attracted much attention in the high-dimensional data analysis. Graph construction in graph embedding plays an important role in the quality of dimensionality reduction. However, the discrimination information and the geometrical distributions of data samples are not fully exploited for discovering the essential geometrical and discriminant structures of data and strengthening the pattern discrimination in graph constructions of graph embedding. To overcome the limitations of graph constructions, in this article we propose a novel graph-based dimensionality reduction method entitled discriminative globality and locality preserving graph embedding (DGLPGE) by designing the informative globality and locality preserving graph constructions. In the constructed graphs, bidirectional weights of edges are newly defined by considering both the geometrical distributions of each point of edges and the class discrimination. Using the adjacent weights of graphs, we characterize the intra-class globality preserving scatter, the inter-class globality preserving scatter and the locality preserving scatter to formulate the objective function of DGLPGE in order to optimize the projection of dimensionality reduction. Extensive experiments demonstrate that the proposed DGLPGE often outperforms the state-of-the-art dimensionality reduction methods.

[1]  Lijiang Chen,et al.  Sparsity Regularization Discriminant Projection for Feature Extraction , 2018, Neural Processing Letters.

[2]  Zhihui Lai,et al.  Local sparsity preserving projection and its application to biometric recognition , 2017, Multimedia Tools and Applications.

[3]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[4]  Jian Yang,et al.  Modified Principal Component Analysis: An Integration of Multiple Similarity Subspace Models , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Wai Keung Wong,et al.  Robust Discriminant Regression for Feature Extraction , 2018, IEEE Transactions on Cybernetics.

[9]  Rong Wang,et al.  Fast and Orthogonal Locality Preserving Projections for Dimensionality Reduction , 2017, IEEE Transactions on Image Processing.

[10]  Ching-Hsien Hsu,et al.  Dimensionality reduction via preserving local information , 2020, Future Gener. Comput. Syst..

[11]  Abdelkamel Tari,et al.  Dimensionality reduction in data mining: A Copula approach , 2016, Expert Syst. Appl..

[12]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Wei Li,et al.  Discriminant Analysis-Based Dimension Reduction for Hyperspectral Image Classification: A Survey of the Most Recent Advances and an Experimental Comparison of Different Techniques , 2018, IEEE Geoscience and Remote Sensing Magazine.

[14]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[15]  Palash Goyal,et al.  Graph Embedding Techniques, Applications, and Performance: A Survey , 2017, Knowl. Based Syst..

[16]  Xiangyang Xue,et al.  Discriminant neighborhood embedding for classification , 2006, Pattern Recognit..

[17]  Belén Melián-Batista,et al.  High-dimensional feature selection via feature grouping: A Variable Neighborhood Search approach , 2016, Inf. Sci..

[18]  John Van Ness,et al.  On the dominance of non-parametric Bayes rule discriminant algorithms in high dimensions , 1980, Pattern Recognit..

[19]  Yongzhao Zhan,et al.  Sparsity and Geometry Preserving Graph Embedding for Dimensionality Reduction , 2018, IEEE Access.

[20]  Honggang Zhang,et al.  Comments on "Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Application to Face and Palm Biometrics" , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Yang Wang,et al.  Locality constrained Graph Optimization for Dimensionality Reduction , 2017, Neurocomputing.

[22]  Jian Yang,et al.  KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Xiaoyang Tan,et al.  Pattern Recognition , 2016, Communications in Computer and Information Science.

[24]  Li Zhang,et al.  Double adjacency graphs-based discriminant neighborhood embedding , 2015, Pattern Recognit..

[25]  Jian Yang,et al.  Multilinear Sparse Principal Component Analysis , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[27]  Zuoyong Li,et al.  Inter-class sparsity based discriminative least square regression , 2018, Neural Networks.

[28]  Tao Li,et al.  Collaborative representation based local discriminant projection for feature extraction , 2018, Digit. Signal Process..

[29]  Jian Yang,et al.  Rotational Invariant Dimensionality Reduction Algorithms , 2017, IEEE Transactions on Cybernetics.

[30]  Jianping Gou,et al.  Discriminative sparsity preserving graph embedding , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[31]  Rong Wang,et al.  Stable and orthogonal local discriminant embedding using trace ratio criterion for dimensionality reduction , 2018, Multimedia Tools and Applications.

[32]  YangJian,et al.  Globally Maximizing, Locally Minimizing , 2007 .

[33]  Alexandros Iosifidis,et al.  Weighted Linear Discriminant Analysis Based on Class Saliency Information , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[34]  Jian Yang,et al.  LPP solution schemes for use with face recognition , 2010, Pattern Recognit..

[35]  Zhenyu Wang,et al.  A collaborative representation based projections method for feature extraction , 2015, Pattern Recognit..

[36]  Xuelong Li,et al.  Locality Adaptive Discriminant Analysis , 2017, IJCAI.

[37]  Hailin Zhang,et al.  Joint Global and Local Structure Discriminant Analysis , 2013, IEEE Trans. Inf. Forensics Secur..

[38]  Jiasong Wu,et al.  PCANet: An energy perspective , 2016, Neurocomputing.

[39]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Lai Wei,et al.  Optimized projection for Collaborative Representation based Classification and its applications to face recognition , 2016, Pattern Recognit. Lett..

[41]  Kyoungok Kim,et al.  An improved semi-supervised dimensionality reduction using feature weighting: Application to sentiment analysis , 2018, Expert Syst. Appl..

[42]  Jinkuan Wang,et al.  Sparse locality preserving discriminative projections for face recognition , 2017, Neurocomputing.

[43]  Wai Keung Wong,et al.  Approximate Low-Rank Projection Learning for Feature Extraction , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Wei Li,et al.  Laplacian Regularized Collaborative Graph for Discriminant Analysis of Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[45]  Feiping Nie,et al.  Discriminative Least Squares Regression for Multiclass Classification and Feature Selection , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[46]  L. Teyssier Analytical Classification of Singular Saddle-Node Vector Fields , 2004 .

[47]  Kevin Chen-Chuan Chang,et al.  A Comprehensive Survey of Graph Embedding: Problems, Techniques, and Applications , 2017, IEEE Transactions on Knowledge and Data Engineering.

[48]  Jianping Gou,et al.  Locality-Based Discriminant Neighborhood Embedding , 2013, Comput. J..

[49]  Huan Liu,et al.  Efficient Feature Selection via Analysis of Relevance and Redundancy , 2004, J. Mach. Learn. Res..

[50]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[51]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[52]  Shangguang Wang,et al.  Hierarchical Discriminant Analysis , 2018, Sensors.