Process monitoring based on probabilistic PCA

Abstract This paper proposes a multivariate process monitoring method based on probabilistic principal component analysis (PPCA). First we will summarize several well-known statistical process monitoring methods, e.g. univariate/multivariate Shewhart charts, and the PCA-based method, i.e. Q and Hotelling's T 2 charts. And then the probabilistic method will be proposed and compared to the existing methods. In essence, the univariate Shewhart chart, multivariate Shewhart chart, Q chart, and T 2 chart are unified to the probabilistic method. The PPCA model is calibrated by the expectation and maximization (EM) algorithm similar to PCA by NIPALS algorithm; EM algorithm will be explained briefly in the article. Finally, through an illustrative example, we will show how the probabilistic method works and is applied to the process monitoring.

[1]  I. Jolliffe.  Principal Component Analysis , 2002 .

[2]  S. J. Wierda.  Multivariate statistical process control—recent results and directions for future research , 1994 .

[3]  J. E. Jackson,et al.  Control Procedures for Residuals Associated With Principal Component Analysis , 1979 .

[4]  Sam T. Roweis,et al.  EM Algorithms for PCA and SPCA , 1997, NIPS.

[5]  J. E. Jackson.  A User's Guide to Principal Components , 1991 .

[6]  T. W. Anderson.  An Introduction to Multivariate Statistical Analysis , 1959 .

[7]  R. Sparks.  QUALITY CONTROL WITH MULTIVARIATE DATA , 1992 .

[8]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[9]  Theodora Kourti,et al.  Statistical Process Control of Multivariate Processes , 1994 .

[10]  H. Hotelling.  Multivariate Quality Control-illustrated by the air testing of sample bombsights , 1947 .

[11]  Michael I. Jordan,et al.  Supervised learning from incomplete data via an EM approach , 1993, NIPS.

[12]  Age K. Smilde,et al.  Generalized contribution plots in multivariate statistical process monitoring , 2000 .

[13]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[14]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[15]  E. J. McShane.  Jensen's inequality , 1937 .

[16]  A. R. Crathorne,et al.  Economic Control of Quality of Manufactured Product. , 1933 .

[17]  W. A. Wallis,et al.  Techniques of Statistical Analysis. , 1950 .

[18]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[19]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[20]  Nola D. Tracy,et al.  Multivariate Control Charts for Individual Observations , 1992 .