Patterns classification of nonlinear multi-dimensional time series based on manifold learning

The multi-sensor signals in industrial process is essentially a nonlinear multi-dimensional time series, so the process fault diagnosis can be implemented by pattern classification of nonlinear multi-dimensional time series. To conquer the effects of nonlinearity, correlation and high dimensionality in the time series, a supervised locally linear embedding (S-LLE) based method is proposed in this paper, in which the locally linear embedding algorithm is improved via the label information and a linear propagation method is applied to deal with the out-of-sample problem. Subsequently, the classifier can be designed by using support vector machines (SVM) and k-nearest neighbor algorithm (knn) in the low dimensional space. The proposed method can greatly preserve the consistency of data local neighborhood structure, effectively extract the low dimensional manifold features embedded in the multi-dimensional time series, and obviously improve the performance of the pattern classification. The experimental results on Tennessee Eastman (TE) process demonstrate the feasibility and effectiveness of the proposed method.

[1]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[2]  D. D. Ridder,et al.  Locally linear embedding for classification , 2002 .

[3]  Dimitrios Gunopulos,et al.  Non-linear dimensionality reduction techniques for classification and visualization , 2002, KDD.

[4]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[5]  Bhaskar D. Kulkarni,et al.  Knowledge incorporated support vector machines to detect faults in Tennessee Eastman Process , 2005, Comput. Chem. Eng..

[6]  Leo H. Chiang,et al.  Fault diagnosis in chemical processes using Fisher discriminant analysis, discriminant partial least squares, and principal component analysis , 2000 .

[7]  Samuel Kadoury,et al.  Face detection in gray scale images using locally linear embeddings , 2007, Comput. Vis. Image Underst..

[8]  Gibaek Lee,et al.  Multiple-Fault Diagnosis of the Tennessee Eastman Process Based on System Decomposition and Dynamic PLS , 2004 .

[9]  Lawrence K. Saul,et al.  Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold , 2003, J. Mach. Learn. Res..

[10]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[11]  Janos Gertler,et al.  Sensor and actuator fault isolation by structured partial PCA with nonlinear extensions , 2000 .

[12]  Ali Cinar,et al.  Diagnosis of process disturbances by statistical distance and angle measures , 1997 .

[13]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[14]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[15]  Sirish L. Shah,et al.  Fault detection and diagnosis in process data using one-class support vector machines , 2009 .