Weighted Local Discriminant Preservation Projection Ensemble Algorithm With Embedded Micro-Noise

High-dimensional data often cause the “curse of dimensionality” in data processing. Dimensionality reduction can effectively solve the curse of dimensionality and has been widely used in high-dimensional data processing. However, the existing dimensionality reduction algorithms neglect the effect of noise injection, failing to account for the datasets of large variance within classes and not effectively considering the stability of dimensionality reduction. To solve the problems, this paper proposes a weighted local discriminant preservation projection algorithm based on an ensemble imbedded mechanism with micro-noise injection (n_w_LPPD). The proposed algorithm aims to overcome the problem of large variance within classes and introduces an ensemble projection matrix via Bayesian fusion mechanism with micro-noise to enhance the antijamming capability of the model. Ten public datasets were used to verify the proposed algorithm. The experimental results demonstrated that the proposed algorithm is significantly effective, especially for the case of small sample datasets with high intraclass variance. The classification accuracy is improved by at least 10% compared to the case without dimensionality reduction. Even compared with some representative dimensionality reduction algorithms, the proposed n_w_LPPD has significantly superior classification performance.

[1]  Zhong Jin,et al.  Face recognition using discriminant locality preserving projections based on maximum margin criterion , 2010, Pattern Recognit..

[2]  Won-Yong Shin,et al.  Face Recognition Using Composite Features Based on Discriminant Analysis , 2018, IEEE Access.

[3]  Yuqing He,et al.  Bilateral filtering inspired locality preserving projections for hyperspectral images , 2015, Neurocomputing.

[4]  Jiuzhen Liang,et al.  Bilateral Two-Dimensional Neighborhood Preserving Discriminant Embedding for Face Recognition , 2017, IEEE Access.

[5]  Ahmed Bouridane,et al.  Combining Fisher locality preserving projections and passband DCT for efficient palmprint recognition , 2015, Neurocomputing.

[6]  Yaohang Li,et al.  High-dimensional MRI data analysis using a large-scale manifold learning approach , 2013, Machine Vision and Applications.

[7]  Jian-Huang Lai,et al.  Optimal locality preserving projection for face recognition , 2011, Neurocomputing.

[8]  Zhao Zhang,et al.  Lp- and Ls-Norm Distance Based Robust Linear Discriminant Analysis , 2018, Neural Networks.

[9]  Yi Yang,et al.  Random Erasing Data Augmentation , 2017, AAAI.

[10]  J. S. Marron,et al.  A scale-based approach to finding effective dimensionality in manifold learning , 2007, 0710.5349.

[11]  S. Huang,et al.  Cross-Speed Gait Recognition Using Speed-Invariant Gait Templates and Globality–Locality Preserving Projections , 2015, IEEE Transactions on Information Forensics and Security.

[12]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[13]  Hong Peng,et al.  Enhanced locality preserving projections using robust path based similarity , 2011, Neurocomputing.

[14]  Qian Du,et al.  Modified Tensor Locality Preserving Projection for Dimensionality Reduction of Hyperspectral Images , 2018, IEEE Geoscience and Remote Sensing Letters.

[15]  Jian-Jiun Ding,et al.  Facial expression recognition based on improved local binary pattern and class-regularized locality preserving projection , 2015, Signal Process..

[16]  Meng Wang,et al.  Unsupervised Nonnegative Adaptive Feature Extraction for Data Representation , 2019, IEEE Transactions on Knowledge and Data Engineering.

[17]  Tommy W. S. Chow,et al.  Constrained large Margin Local Projection algorithms and extensions for multimodal dimensionality reduction , 2012, Pattern Recognit..

[18]  Anastasios Tefas,et al.  Dimensionality Reduction Using Similarity-Induced Embeddings , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Shuicheng Yan,et al.  Robust Neighborhood Preserving Projection by Nuclear/L2,1-Norm Regularization for Image Feature Extraction , 2017, IEEE Transactions on Image Processing.

[20]  Xiaoheng Tan,et al.  Localized instance fusion of MRI data of Alzheimer’s disease for classification based on instance transfer ensemble learning , 2018, BioMedical Engineering OnLine.

[21]  Nicu Sebe,et al.  Flexible Manifold Learning With Optimal Graph for Image and Video Representation , 2018, IEEE Transactions on Image Processing.

[22]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[23]  Max A. Little,et al.  Objective Automatic Assessment of Rehabilitative Speech Treatment in Parkinson's Disease , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Rong Wang,et al.  Robust Locality Preserving Projections With Cosine-Based Dissimilarity for Linear Dimensionality Reduction , 2017, IEEE Access.

[25]  Dongdong Li,et al.  GMFLLM: A general manifold framework unifying three classic models for dimensionality reduction , 2017, Eng. Appl. Artif. Intell..

[26]  P. Niyogi,et al.  Locality Preserving Projections (LPP) , 2002 .

[27]  Jiashu Zhang,et al.  Discriminant Locality Preserving Projections Based on L1-Norm Maximization , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[29]  Hanqing Lu,et al.  Supervised kernel locality preserving projections for face recognition , 2005, Neurocomputing.

[30]  Meng Wang,et al.  Joint Label Prediction Based Semi-Supervised Adaptive Concept Factorization for Robust Data Representation , 2019, IEEE Transactions on Knowledge and Data Engineering.

[31]  Chao Wang,et al.  Locality Preserving Discriminant Projections , 2009, ICIC.

[32]  Geoffrey E. Hinton,et al.  To recognize shapes, first learn to generate images. , 2007, Progress in brain research.

[33]  Fikret S. Gürgen,et al.  Collection and Analysis of a Parkinson Speech Dataset With Multiple Types of Sound Recordings , 2013, IEEE Journal of Biomedical and Health Informatics.

[34]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[35]  Bo Du,et al.  Dimensionality Reduction and Classification of Hyperspectral Images Using Ensemble Discriminative Local Metric Learning , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[37]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[38]  Ping Wang,et al.  Adversarial Noise Layer: Regularize Neural Network by Adding Noise , 2018, 2019 IEEE International Conference on Image Processing (ICIP).

[39]  Xinbo Gao,et al.  Robust DLPP With Nongreedy $\ell _1$ -Norm Minimization and Maximization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Yan Zhang,et al.  Semi-supervised local multi-manifold Isomap by linear embedding for feature extraction , 2018, Pattern Recognit..

[41]  Tao Liu,et al.  Taste Recognition in E-Tongue Using Local Discriminant Preservation Projection , 2019, IEEE Transactions on Cybernetics.

[42]  Brian Johnson,et al.  Classifying a high resolution image of an urban area using super-object information , 2013 .

[43]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[44]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[45]  Lasse Holmström,et al.  A semiparametric density estimation approach to pattern classification , 2004, Pattern Recognit..

[46]  Haibo He,et al.  Dimensionality Reduction of Hyperspectral Imagery Based on Spatial–Spectral Manifold Learning , 2018, IEEE Transactions on Cybernetics.

[47]  David Zhang,et al.  An alternative formulation of kernel LPP with application to image recognition , 2006, Neurocomputing.

[48]  Wei Jia,et al.  Locality preserving discriminant projections for face and palmprint recognition , 2010, Neurocomputing.