An Improved Locally Linear Embedding Method for Feature Extraction

In this work, a feature extraction approach based on improved Locally Linear Embedding(LLE) is proposed. In the algorithm, tangent space distance is introduced to LLE, which overcomes the shortcoming of original LLE method based on Euclidean distance. It can satisfy the requirement of locally linear much better and so can express the I/O mapping quality better than classical method. Simulation results are given to demonstrate the effectiveness of the improved LLE method.

[1]  Yoshua Bengio,et al.  Locally Linear Embedding for dimensionality reduction in QSAR , 2004, J. Comput. Aided Mol. Des..

[2]  David Zhang,et al.  A method for speeding up feature extraction based on KPCA , 2007, Neurocomputing.

[3]  Arthur L. Samuel,et al.  Some Studies in Machine Learning Using the Game of Checkers , 1967, IBM J. Res. Dev..

[4]  Kati Pöllänen,et al.  Dynamic PCA-based MSPC charts for nucleation prediction in batch cooling crystallization processes , 2006 .

[5]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[6]  Thomas F. Edgar,et al.  Use of principal component analysis for sensor fault identification , 1996 .

[7]  Ke Lu,et al.  Locality pursuit embedding , 2004, Pattern Recognition.

[8]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[9]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[10]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[11]  A. L. Samuel,et al.  Some studies in machine learning using the game of checkers. II: recent progress , 1967 .

[12]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[13]  Qing-hua He,et al.  Fault detection of excavator’s hydraulic system based on dynamic principal component analysis , 2008 .