Improved Nonlinear PCA for Process Monitoring Using Support Vector Data Description

Abstract Nonlinear principal component analysis (PCA) based on neural networks has drawn significant attention as a monitoring tool for complex nonlinear processes, but there remains a difficulty with determining the optimal network topology. This paper exploits the advantages of the Fast Recursive Algorithm, where the number of nodes, the location of centres, and the weights between the hidden layer and the output layer can be identified simultaneously for the radial basis function (RBF) networks. The topology problem for the nonlinear PCA based on neural networks can thus be solved. Another problem with nonlinear PCA is that the derived nonlinear scores may not be statistically independent or follow a simple parametric distribution. This hinders its applications in process monitoring since the simplicity of applying predetermined probability distribution functions is lost. This paper proposes the use of a support vector data description and shows that transforming the nonlinear principal components into a feature space allows a simple statistical inference. Results from both simulated and industrial data confirm the efficacy of the proposed method for solving nonlinear principal component problems, compared with linear PCA and kernel PCA.

[1]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[2]  In-Beum Lee,et al.  Fault identification for process monitoring using kernel principal component analysis , 2005 .

[3]  Kang Li,et al.  A two-stage algorithm for identification of nonlinear dynamic systems , 2006, Autom..

[4]  Monica N. Nicolescu,et al.  Efficient background modeling through incremental Support Vector Data Description , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  U. Kruger,et al.  Moving window kernel PCA for adaptive monitoring of nonlinear processes , 2009 .

[6]  De-Shuang Huang,et al.  A Hybrid Forward Algorithm for RBF Neural Network Construction , 2006, IEEE Transactions on Neural Networks.

[7]  George W. Irwin,et al.  A fast nonlinear model identification method , 2005, IEEE Transactions on Automatic Control.

[8]  S. Wold Cross-Validatory Estimation of the Number of Components in Factor and Principal Components Models , 1978 .

[9]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[10]  B. Silverman,et al.  Some Aspects of the Spline Smoothing Approach to Non‐Parametric Regression Curve Fitting , 1985 .

[11]  In-Beum Lee,et al.  Fault detection and diagnosis based on modified independent component analysis , 2006 .

[12]  Sirish L. Shah,et al.  Model Identification and Error Covariance Matrix Estimation from Noisy Data Using PCA , 2004 .

[13]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[14]  Xun Wang,et al.  Nonlinear PCA With the Local Approach for Diesel Engine Fault Detection and Diagnosis , 2008, IEEE Transactions on Control Systems Technology.

[15]  David M. J. Tax,et al.  One-class classification , 2001 .

[16]  Shufeng Tan,et al.  Reducing data dimensionality through optimizing neural network inputs , 1995 .

[17]  John F. MacGregor,et al.  Multivariate SPC charts for monitoring batch processes , 1995 .

[18]  R. Cattell The Scree Test For The Number Of Factors. , 1966, Multivariate behavioral research.

[19]  B. Silverman Density estimation for statistics and data analysis , 1986 .

[20]  M. Kramer Nonlinear principal component analysis using autoassociative neural networks , 1991 .

[21]  S. Qin,et al.  Selection of the Number of Principal Components: The Variance of the Reconstruction Error Criterion with a Comparison to Other Methods† , 1999 .

[22]  I. Jolliffe Principal Component Analysis , 2002 .

[23]  Jing Deng,et al.  Improved Nonlinear PCA Based on RBF Networks and Principal Curves , 2010, LSMS/ICSEE.

[24]  David J. Sandoz,et al.  The application of principal component analysis and kernel density estimation to enhance process monitoring , 2000 .

[25]  Lei Xie,et al.  Statistical‐based monitoring of multivariate non‐Gaussian systems , 2008 .

[26]  T. McAvoy,et al.  Nonlinear principal component analysis—Based on principal curves and neural networks , 1996 .

[27]  Gary Montague,et al.  Non-linear principal components analysis using genetic programming , 1997 .

[28]  Weihua Li,et al.  Detection, identification, and reconstruction of faulty sensors with maximized sensitivity , 1999 .

[29]  H. Akaike A new look at the statistical model identification , 1974 .

[30]  O. Nelles Nonlinear System Identification: From Classical Approaches to Neural Networks and Fuzzy Models , 2000 .

[31]  Lei Xie,et al.  Swarm Intelligent Tuning of One-Class nu-SVM Parameters , 2006, RSKT.

[32]  George W. Irwin,et al.  Introduction of a nonlinearity measure for principal component models , 2005, Comput. Chem. Eng..

[33]  Elaine B. Martin,et al.  Non-linear principal components analysis with application to process fault detection , 2000, Int. J. Syst. Sci..

[34]  Barry Lennox,et al.  Monitoring a complex refining process using multivariate statistics , 2008 .

[35]  Fuli Wang,et al.  Stage-based soft-transition multiple PCA modeling and on-line monitoring strategy for batch processes , 2007 .

[36]  S. Qin,et al.  Determining the number of principal components for best reconstruction , 2000 .

[37]  Jie Zhang,et al.  Performance monitoring of processes with multiple operating modes through multiple PLS models , 2006 .

[38]  C. Yoo,et al.  Nonlinear process monitoring using kernel principal component analysis , 2004 .

[39]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[40]  George W. Irwin,et al.  RBF principal manifolds for process monitoring , 1999, IEEE Trans. Neural Networks.

[41]  Ryo Saegusa,et al.  Nonlinear principal component analysis to preserve the order of principal components , 2003, Neurocomputing.

[42]  George W. Irwin,et al.  Fast Forward RBF Network Construction Based on Particle Swarm Optimization , 2010, LSMS/ICSEE.