Integrating independent component analysis and support vector machine for multivariate process monitoring

This study aims to develop an intelligent algorithm by integrating the independent component analysis (ICA) and support vector machine (SVM) for monitoring multivariate processes. For developing a successful SVM-based fault detector, the first step is feature extraction. In real industrial processes, process variables are rarely Gaussian distributed. Thus, this study proposes the application of ICA to extract the hidden information of a non-Gaussian process before conducting SVM. The proposed fault detector will be implemented via two simulated processes and a case study of the Tennessee Eastman process. Results demonstrate that the proposed method possesses superior fault detection when compared to conventional monitoring methods, including PCA, ICA, modified ICA, ICA-PCA and PCA-SVM.

[1]  Te-Sheng Li,et al.  Applying wavelets transform and support vector machine for copper clad laminate defects classification , 2009, Comput. Ind. Eng..

[2]  Christos Georgakis,et al.  Disturbance detection and isolation by dynamic principal component analysis , 1995 .

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  S. Qin,et al.  Selection of the Number of Principal Components: The Variance of the Reconstruction Error Criterion with a Comparison to Other Methods† , 1999 .

[5]  Chi-Jie Lu,et al.  Integrated Application of SPC/EPC/ICA and neural networks , 2008 .

[6]  Xiaomu Song,et al.  Unsupervised spatiotemporal fMRI data analysis using support vector machines , 2009, NeuroImage.

[7]  Nojun Kwak,et al.  Feature extraction for classification problems and its application to face recognition , 2008, Pattern Recognit..

[8]  A. J. Morris,et al.  Non-linear principal components analysis for process fault detection , 1998 .

[9]  In-Beum Lee,et al.  Fault detection and diagnosis based on modified independent component analysis , 2006 .

[10]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[11]  A. Hyvarinen.  A family of fixed-point algorithms for independent component analysis , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis , 1997, Neural Computation.

[13]  John F. MacGregor,et al.  Multivariate SPC charts for monitoring batch processes , 1995 .

[14]  ChangKyoo Yoo,et al.  On-line monitoring of batch processes using multiway independent component analysis , 2004 .

[15]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[16]  A. J. Morris,et al.  Non-parametric confidence bounds for process performance monitoring charts☆ , 1996 .

[17]  Fred Spiring,et al.  Introduction to Statistical Quality Control , 2007, Technometrics.

[18]  Chih-Chieh Yang,et al.  Classification model for product form design using fuzzy support vector machines , 2008, Comput. Ind. Eng..

[19]  J. Edward Jackson,et al.  Quality Control Methods for Several Related Variables , 1959 .

[20]  A. J. Morris,et al.  Wavelets and non-linear principal components analysis for process monitoring , 1999 .

[21]  Zhi-huan Song,et al.  Process Monitoring Based on Independent Component Analysis - Principal Component Analysis ( ICA - PCA ) and Similarity Factors , 2007 .

[22]  ChangKyoo Yoo,et al.  Statistical monitoring of dynamic processes based on dynamic independent component analysis , 2004 .

[23]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[24]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[25]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[26]  Stefan Lessmann,et al.  A reference model for customer-centric data mining with support vector machines , 2009, Eur. J. Oper. Res..

[27]  Hyun Joon Shin,et al.  One-class support vector machines - an application in machine fault detection and classification , 2005, Comput. Ind. Eng..

[28]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[29]  Bo-Suk Yang,et al.  Intelligent fault diagnosis system of induction motor based on transient current signal , 2009 .

[30]  Chun-Chin Hsu,et al.  A process monitoring scheme based on independent component analysis and adjusted outliers , 2010 .

[31]  Zhi-huan Song,et al.  Online monitoring of nonlinear multiple mode processes based on adaptive local model approach , 2008 .

[32]  Manabu Kano,et al.  Monitoring independent components for fault detection , 2003 .

[33]  Lijuan Cao,et al.  A comparison of PCA, KPCA and ICA for dimensionality reduction in support vector machine , 2003, Neurocomputing.

[34]  Yihui Liu,et al.  Wavelet feature extraction for high-dimensional microarray data , 2009, Neurocomputing.

[35]  T. McAvoy,et al.  Nonlinear principal component analysis—Based on principal curves and neural networks , 1996 .

[36]  Junghui Chen,et al.  Dynamic process fault monitoring based on neural network and PCA , 2002 .

[37]  J. Macgregor,et al.  Monitoring batch processes using multiway principal component analysis , 1994 .

[38]  ChangKyoo Yoo,et al.  Fault detection of batch processes using multiway kernel principal component analysis , 2004, Comput. Chem. Eng..

[39]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[40]  J. E. Jackson,et al.  Control Procedures for Residuals Associated With Principal Component Analysis , 1979 .

[41]  Jiwen Lu,et al.  Gait recognition for human identification based on ICA and fuzzy SVM through multiple views fusion , 2007, Pattern Recognit. Lett..

[42]  Age K. Smilde,et al.  Generalized contribution plots in multivariate statistical process monitoring , 2000 .

[43]  ChangKyoo Yoo,et al.  Statistical process monitoring with independent component analysis , 2004 .

[44]  S. Wold.  Cross-Validatory Estimation of the Number of Components in Factor and Principal Components Models , 1978 .

[45]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[46]  Theodora Kourti,et al.  Multivariate SPC Methods for Process and Product Monitoring , 1996 .

[47]  Yingwei Zhang,et al.  Enhanced statistical analysis of nonlinear processes using KPCA, KICA and SVM , 2009 .

[48]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.