On-line adaptive principal component extraction algorithms using iteration approach

Two new on-line algorithms for adaptive principal component analysis (APCA) are proposed and discussed in order to solve the problem of on-line industrial process monitoring in this paper. Both the algorithms have the capability of extracting principal component eigenvectors on-line in a fixed size sliding data window with high dimensional input data. The first algorithm is based on the steepest gradient descent approach, which updates the covariance matrix with deflation transformation and on-line iteration. Based on neural networks, the second algorithm constructs the input data sequence with an on-line iteration method and trains the neural network in every data frame. The convergence of the two algorithms is then analyzed and the simulations are given to illustrate the effectiveness of the two algorithms. At last, the applications of the two algorithms are discussed.

[1]  Yuhong Zhao,et al.  Fault diagnosis method based on moving window PCA , 2009, 2009 Chinese Control and Decision Conference.

[2]  Toshihisa Tanaka,et al.  Generalized weighted rules for principal components tracking , 2005, IEEE Transactions on Signal Processing.

[3]  A. H. Ali.  Neural network principal component using adaptive principal component extractor (APEX) , 2003, The 3rd International Workshop on Scientific Use of Submarine Cables and Related Technologies, 2003..

[4]  Leu-Shing Lan,et al.  Accelerating Local Convergence of the Information Theory-Based Algorithm for Principal Component Analysis , 2007, 2007 International Joint Conference on Neural Networks.

[5]  Xianda Zhang,et al.  Adaptive nonlinear PCA algorithms for blind source separation without prewhitening , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[6]  L. State,et al.  A new adaptive PCA scheme for noise removal in image processing , 2008, 2008 50th International Symposium ELMAR.

[7]  H. Chen,et al.  An alternative proof of convergence for Kung-Diamantaras APEX algorithm , 1991, Neural Networks for Signal Processing Proceedings of the 1991 IEEE Workshop.

[8]  Zheng Bao,et al.  Cross-correlation neural network models for the smallest singular component of general matrix , 1998, Signal Process..

[9]  Matthew Brand,et al.  Incremental Singular Value Decomposition of Uncertain Data with Missing Values , 2002, ECCV.

[10]  Roger L. King,et al.  An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[11]  David Zhang,et al.  PCA-Based Spatially Adaptive Denoising of CFA Images for Single-Sensor Digital Cameras , 2009, IEEE Transactions on Image Processing.

[12]  Vwani P. Roychowdhury,et al.  Algorithms for accelerated convergence of adaptive PCA , 2000, IEEE Trans. Neural Networks Learn. Syst..

[13]  Weihua Li,et al.  Recursive PCA for adaptive process monitoring , 1999 .

[14]  S.Y. Kung,et al.  Adaptive Principal component EXtraction (APEX) and applications , 1994, IEEE Trans. Signal Process..

[15]  Udo Weimar,et al.  On-line novelty detection by recursive dynamic principal component analysis and gas sensor arrays under drift conditions , 2006 .

[16]  Zhiqiang Ge,et al.  Semiconductor Manufacturing Process Monitoring Based on Adaptive Substatistical PCA , 2010, IEEE Transactions on Semiconductor Manufacturing.

[17]  Yousef Saad,et al.  Lanczos Vectors versus Singular Vectors for Effective Dimension Reduction , 2009, IEEE Transactions on Knowledge and Data Engineering.

[18]  Sun-Yuan Kung,et al.  A neural network learning algorithm for adaptive principal component extraction (APEX) , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[19]  Haixia Xu,et al.  Adaptive kernel principal component analysis , 2010, Signal Process..