Multivariate statistical process control charts: an overview

In this paper we discuss the basic procedures for the implementation of multivariate statistical process control via control charting. Furthermore, we review multivariate extensions for all kinds of univariate control charts, such as multivariate Shewhart-type control charts, multivariate CUSUM control charts and multivariate EWMA control charts. In addition, we review unique procedures for the construction of multivariate control charts, based on multivariate statistical techniques such as principal components analysis (PCA) and partial lest squares (PLS). Finally, we describe the most significant methods for the interpretation of an out-of-control signal.

[1]  Erik Johansson,et al.  Multivariate process and quality monitoring applied to an electrolysis process. : Part II - Multivariate time-series analysis of lagged latent variables , 1998 .

[2]  L. K. Chan,et al.  A multivariate control chart for detecting linear trends , 1994 .

[3]  L MasonR,et al.  ホテリングのT2統計量を利用した多変量統計的工程管理(MVSPC)を実装する , 2001 .

[4]  Theodora Kourti,et al.  Statistical Process Control of Multivariate Processes , 1994 .

[5]  H. Hotelling.  Multivariate Quality Control-illustrated by the air testing of sample bombsights , 1947 .

[6]  N. Ye,et al.  Robustness of Chi‐square and Canberra distance metrics for computer intrusion detection , 2002 .

[7]  Thong Ngee Goh,et al.  CONTROL CHART FOR MULTIVARIATE ATTRIBUTE PROCESSES , 1998 .

[8]  S. Bersimis,et al.  IDENTIFYING THE OUT OF CONTROL VARIABLE IN A MULTIVARIATE CONTROL CHART , 2002 .

[9]  Fugee Tsung,et al.  IMPROVING AUTOMATIC-CONTROLLED PROCESS QUALITY USING ADAPTIVE PRINCIPAL COMPONENT MONITORING , 1999 .

[10]  Barry M. Wise,et al.  Application of multi-way principal components analysis to nuclear waste storage tank monitoring , 1996 .

[11]  M. Gennaro,et al.  Monitoring of an industrial process by multivariate control charts based on principal component analysis. , 2003, Annali di chimica.

[12]  A. J. Morris,et al.  Monitoring of a Batch Continuous Process Using Mass Re-Sampling , 2002 .

[13]  H. Hotelling,et al.  Multivariate Quality Control , 1947 .

[14]  D. Hawkins.  Multivariate quality control based on regression-adjusted variables , 1991 .

[15]  Theodora Kourti,et al.  Model Predictive Monitoring for Batch Processes , 2004 .

[16]  D. Montgomery,et al.  Contributors to a multivariate statistical process control chart signal , 1996 .

[17]  George C. Runger,et al.  Multivariate Extensions to Cumulative Sum Control Charts , 2004 .

[18]  Rick L. Edgeman,et al.  Multivariate Statistical Process Control with Industrial Applications , 2004, Technometrics.

[19]  J. Healy.  A note on multivariate CUSUM procedures , 1987 .

[20]  A. A. Kalgonda,et al.  Multivariate Quality Control Chart for Autocorrelated Processes , 2004 .

[21]  N. S. Barnett,et al.  DISPERSION CONTROL FOR MULTIVARIATE PROCESSES – SOME COMPARISONS , 1996 .

[22]  John N. Dyer,et al.  A simulation study and evaluation of multivariate forecast based control charts applied to ARMA processes , 2003 .

[23]  J. Macgregor,et al.  Experiences with industrial applications of projection methods for multivariate statistical process control , 1996 .

[24]  Joel K. Jolayemi,et al.  Multivariate control charts: an optimization approach to the effective use and measurement of performance , 1989 .

[25]  J. Macgregor,et al.  Monitoring batch processes using multiway principal component analysis , 1994 .

[26]  John C. Young,et al.  THE CONTROL CHART FOR INDIVIDUAL OBSERVATIONS FROM A MULTIVARIATE NON-NORMAL DISTRIBUTION , 2001 .

[27]  Marion R. Reynolds,et al.  Multivariate Monitoring Using an MEWMA Control Chart with Unequal Sample Sizes , 2005 .

[28]  G. Runger.  Multivariate statistical process control for autocorrelated processes , 1996 .

[29]  Ali Cinar,et al.  Intelligent process monitoring by interfacing knowledge-based systems and multivariate statistical monitoring , 2000 .

[30]  D. Montgomery,et al.  Multivariate statistical process monitoring and diagnosis with grouped regression‐adjusted variables , 1999 .

[31]  Daniel Y. T. Fong,et al.  The analysis of process variation transmission with multivariate measurements , 1998 .

[32]  Douglas M. Hawkins,et al.  Regression Adjustment for Variables in Multivariate Quality Control , 1993 .

[33]  Wei Jiang,et al.  Multivariate Control Charts for Monitoring Autocorrelated Processes , 2004 .

[34]  G. Runger,et al.  Multivariate control charts for process dispersion , 2004 .

[35]  J. Edward Jackson,et al.  A User's Guide to Principal Components. , 1991 .

[36]  Erik Johansson,et al.  Multivariate process and quality monitoring applied to an electrolysis process: Part I. Process supervision with multivariate control charts , 1998 .

[37]  Mahmoud A. Mahmoud,et al.  On the Monitoring of Linear Profiles , 2003 .

[38]  W. Woodall,et al.  The Performance of Multivariate Control Charts in the Presence of Measurement Error , 2001 .

[39]  A. J. Morris,et al.  Performance monitoring of a multi-product semi-batch process , 2001 .

[40]  Steven E. Rigdon,et al.  A double-integral equation for the average run length of a multivariate exponentially weighted moving average control chart , 1995 .

[41]  T. M. Margavio,et al.  A comparison of multivariate moving average control charts for the process mean , 1995 .

[42]  S. D. Jong,et al.  Multivariate statistical process control in chromatography , 1997 .

[43]  Theodora Kourti,et al.  Application of latent variable methods to process control and multivariate statistical process control in industry , 2005 .

[44]  S. Rigdon.  An integral equation for the in-control average run length of a multivariate exponentially weighted moving average control chart , 1995 .

[45]  Joel K. Jolayemi,et al.  A power function model for determining sample sizes for the operations of multivariate control charts , 1995 .

[46]  Werner A.J. Schippers,et al.  An integrated approach to process control , 2001 .

[47]  N. José Alberto Vargas,et al.  Robust Estimation in Multivariate Control Charts for Individual Observations , 2003 .

[48]  Douglas M. Hawkins,et al.  A General Multivariate Exponentially Weighted Moving-Average Control Chart , 2007 .

[49]  G. B. Wetherill,et al.  Quality Control and Industrial Statistics , 1975 .

[50]  Neil H. Timm,et al.  Multivariate Quality Control Using Finite Intersection Tests , 1996 .

[51]  William H. Woodall,et al.  A review and analysis of cause-selecting control charts , 1993 .

[52]  Douglas C. Montgomery,et al.  Investigation and characterization of a control scheme for multivariate quality control , 1992 .

[53]  Theodora Kourti,et al.  Multivariate SPC Methods for Process and Product Monitoring , 1996 .

[54]  S. Tseng,et al.  A study on a multivariate EWMA controller , 2002 .

[55]  Francisco Aparisi,et al.  Hotelling's T2 control chart with adaptive sample sizes , 1996 .

[56]  John C. Young,et al.  Monitoring a multivariate step process , 1996 .

[57]  Junghui Chen,et al.  Post analysis on different operating time processes using orthonormal function approximation and multiway principal component analysis , 2000 .

[58]  A. Ferrer,et al.  Dealing with missing data in MSPC: several methods, different interpretations, some examples , 2002 .

[59]  Leo H. Chiang,et al.  Fault diagnosis in chemical processes using Fisher discriminant analysis, discriminant partial least squares, and principal component analysis , 2000 .

[60]  A. Smilde,et al.  Multivariate statistical process control of batch processes based on three-way models , 2000 .

[61]  George C. Runger,et al.  Projections and the U(2) Multivariate Control Chart , 1996 .

[62]  F. Aparisi,et al.  Statistical properties of the lsi multivariate control chart , 1999 .

[63]  George C. Runger,et al.  A Markov Chain Model for the Multivariate Exponentially Weighted Moving Averages Control Chart , 1996 .

[64]  Carl-Fredrik Mandenius,et al.  Monitoring a paperboard machine using multivariate statistical process control , 2004 .

[65]  Qiang Chen,et al.  An anomaly detection technique based on a chi‐square statistic for detecting intrusions into information systems , 2001 .

[66]  Ross Sparks,et al.  Multivariate Process Monitoring Using the Dynamic Biplot , 1997 .

[67]  Barry M. Wise,et al.  Application of PARAFAC2 to fault detection and diagnosis in semiconductor etch , 2001 .

[68]  Jyh-Jen Horng Shiau,et al.  Statistical process monitoring using an empirical Bayes multivariate process control chart , 2001 .

[69]  Connie M. Borror,et al.  Robustness of the EWMA Control Chart to Non-Normality , 1999 .

[70]  Douglas C. Montgomery,et al.  A review of multivariate control charts , 1995 .

[71]  H. I. Patel.  QUALITY CONTROL METHODS FOR MULTIVARIATE BINOMIAL AND POISSON DISTRIBUTIONS , 1973 .

[72]  George C. Runger,et al.  Designing a Multivariate EWMA Control Chart , 1997 .

[73]  Harald E. Krogstad,et al.  Simulation of Multivariate Gaussian Time Series , 1989 .

[74]  Philip Jonathan,et al.  Two Projection Methods for Use in the Analysis of Multivariate Process Data With an Illustration in Petrochemical Production , 2004, Technometrics.

[75]  Joel A. Nachlas,et al.  A simulation approach to multivariate quality control , 1997 .

[76]  A. J. Morris,et al.  Manufacturing performance enhancement through multivariate statistical process control , 1999 .

[77]  Connie M. Borror,et al.  Design Strategies for the Multivariate Exponentially Weighted Moving Average Control Chart , 2004 .

[78]  Francisco Aparisi,et al.  A Performance Analysis of Hotelling's χ2 Control Chart with Supplementary Runs Rules , 2004 .

[79]  Neil S Barnett,et al.  DISPERSION CONTROL FOR MULTIVARIATE PROCESSES , 1996 .

[80]  C. Mastrangelo,et al.  Multivariate Autocorrelated Processes: Data and Shift Generation , 2002 .

[81]  Authors' Biographies , 2005 .

[82]  Chih-Ming Hsu,et al.  Analysis of variations in a multi-variate process using neural networks , 2003 .

[83]  Age K. Smilde,et al.  Generalized contribution plots in multivariate statistical process monitoring , 2000 .

[84]  Susan L. Albin,et al.  Multivariate monitoring of batch process startup , 2001 .

[85]  A. J. Morris,et al.  Non-linear principal components analysis for process fault detection , 1998 .

[86]  Chung-Ho Chen,et al.  Economic-Statistical Design of Multivariate Control Charts Using Quality Loss Function , 2002 .

[87]  A. J. Morris,et al.  Batch process monitoring for consistent production , 1996 .

[88]  Douglas C. Montgomery,et al.  Statistically constrained economic design of the multivariate exponentially weighted moving average control chart , 2001 .

[89]  John F. MacGregor,et al.  Process monitoring and diagnosis by multiblock PLS methods , 1994 .

[90]  William H. Woodall,et al.  Phase I Analysis of Linear Profiles With Calibration Applications , 2004, Technometrics.

[91]  Tapas K. Das,et al.  Wavelet-based multiscale statistical process monitoring: A literature review , 2004 .

[92]  B.G.M. Vandeginste,et al.  The application of multivariate quality control in gas chromatography. , 1999 .

[93]  F. S. Stover,et al.  Statistical quality control applied to ion chromatography calibrations , 1998 .

[94]  Youn Min Chou,et al.  Systematic Patterns in T2 Charts , 2003 .

[95]  F. Aparisi,et al.  GENERALIZED VARIANCE CHART DESIGN WITH ADAPTIVE SAMPLE SIZES. THE BIVARIATE CASE , 2001 .

[96]  Junghui Chen,et al.  On-line batch process monitoring using dynamic PCA and dynamic PLS models , 2002 .

[97]  Connie M. Borror,et al.  Scalable Chi-Square Distance versus Conventional Statistical Distance for Process Monitoring with Uncorrelated Data Variables , 2003 .

[98]  A. Grigoryan,et al.  Multivariate double sampling |S| charts for controlling process variability , 2005 .

[99]  Arthur B. Yeh,et al.  A multivariate exponentially weighted moving average control chart for monitoring process variability , 2003 .

[100]  Joe H. Sullivan,et al.  A Self-Starting Control Chart for Multivariate Individual Observations , 2002, Technometrics.

[101]  William H. Woodall,et al.  Change-point detection of mean vector or covariance matrix shifts using multivariate individual observations , 2000 .

[102]  R. Sparks.  QUALITY CONTROL WITH MULTIVARIATE DATA , 1992 .

[103]  John M. Charnes,et al.  Tests for special causes with multivariate autocorrelated data , 1995, Comput. Oper. Res..

[104]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[105]  Marion R. Reynolds,et al.  Multivariate Monitoring of the Process Mean Vector with Sequential Sampling , 2005 .

[106]  A. J. Morris,et al.  Multivariate statistical process control of an industrial fluidised-bed reactor , 2000 .

[107]  Uwe Kruger,et al.  Recursive partial least squares algorithms for monitoring complex industrial processes , 2003 .

[108]  José-Luis Guerrero-Cusumano,et al.  Testing Variability in Multivariate Quality Control: A Conditional Entropy Measure Approach , 1995, Inf. Sci..

[109]  J. Edward Jackson,et al.  A User's Guide to Principal Components: Jackson/User's Guide to Principal Components , 2004 .

[110]  Elvira N. Loredo,et al.  A Program for ARL Calculation for Multivariate EWMA Charts , 2001 .

[111]  Jen Tang,et al.  Control Charts for Dependent and Independent Measurements Based on Bootstrap Methods , 1996 .

[112]  Theodora Kourti,et al.  Multivariate dynamic data modeling for analysis and statistical process control of batch processes, start‐ups and grade transitions , 2003 .

[113]  Douglas C. Montgomery,et al.  Statistical process monitoring with principal components , 1996 .

[114]  Douglas C. Montgomery,et al.  Process monitoring for multiple count data using generalized linear model-based control charts , 2003 .

[115]  John C. Young,et al.  IMPROVING THE SENSITIVITY OF THE T2 STATISTIC IN MULTIVARIATE PROCESS CONTROL , 1999 .

[116]  Seongkyu Yoon,et al.  Principal‐component analysis of multiscale data for process monitoring and fault diagnosis , 2004 .

[117]  Kwang-Jae Kim,et al.  A Method for Predicting Future Observations in the Monitoring of a Batch Process , 2003 .

[118]  Nola D. Tracy,et al.  Multivariate Control Charts for Individual Observations , 1992 .

[119]  Christos Georgakis,et al.  Disturbance detection and isolation by dynamic principal component analysis , 1995 .

[120]  Kevin M. Bodden,et al.  A Program for Approximating the In-Control ARL for the MEWMA Chart , 1999 .

[121]  H. Kramer,et al.  Ewma charts for multivariate time series , 1997 .

[122]  A. A. Kalagonda,et al.  Diagnosis of Multivariate Control Chart Signal Based on Dummy Variable Regression Technique , 2003 .

[123]  Youn Min Chou,et al.  Applying Hotelling's T2 Statistic to Batch Processes , 2001 .

[124]  J Junyi Zhang,et al.  Cumulative sum control charts for covariance matrix , 2000 .

[125]  J. Pignatiello,et al.  On constructing T 2 control charts for retrospective examination , 2000 .

[126]  George C. Runger,et al.  Comparison of multivariate CUSUM charts , 1990 .

[127]  Nola D. Tracy,et al.  Decomposition of T2 for Multivariate Control Chart Interpretation , 1995 .

[128]  W. T. Tucker,et al.  Identification of out of control quality characteristics in a multivariate manufacturing environment , 1991 .

[129]  Connie M. Borror,et al.  Robustness properties of multivariate EWMA control charts , 2003 .

[130]  A. Smilde,et al.  The effect of the size of the training set and number of principal components on the false alarm rate in statistical process monitoring , 2004 .

[131]  A. J. Morris,et al.  Wavelets and non-linear principal components analysis for process monitoring , 1999 .

[132]  Charles W. Champ,et al.  Assessment of Multivariate Process Control Techniques , 1997 .

[133]  D. Hawkins,et al.  A nonparametric multivariate cumulative sum procedure for detecting shifts in all directions , 2003 .

[134]  William H. Woodall,et al.  A Comparison of Multivariate Control Charts for Individual Observations , 1996 .

[135]  S. Chakraborti,et al.  Nonparametric Control Charts: An Overview and Some Results , 2001 .

[136]  Minitab.  Statistical Methods for Quality Improvement , 2001 .

[137]  Fassó Alessandro.  One‐sided mewama control charts , 1999 .

[138]  Smiley W. Cheng,et al.  A New Multivariate Control Chart for Monitoring Both Location and Dispersion , 2005 .

[139]  D. Mader,et al.  AN APPLICATION IN MULTIVARIATE STATISTICAL PROCESS CONTROL FOR POWER SUPPLY CALIBRATION , 1996 .

[140]  L. Zullo,et al.  Validation and verification of continuous plants operating modes using multivariate statistical methods , 1996 .

[141]  Manabu Kano,et al.  A new multivariate statistical process monitoring method using principal component analysis , 2001 .

[142]  Jose A. Romagnoli,et al.  Robust statistical process monitoring , 1996 .

[143]  Jian Zhang,et al.  MULTIVARIATE CUMULATIVE SUM CONTROL CHARTS BASED ON PROJECTION PURSUIT , 2001 .

[144]  A. B. Yeh,et al.  A likelihood-ratio-based EWMA control chart for monitoring variability of multivariate normal processes , 2004 .

[145]  S. W. Butler,et al.  Supervisory run-to-run control of polysilicon gate etch using in situ ellipsometry , 1994 .

[146]  Douglas C. Montgomery,et al.  Research Issues and Ideas in Statistical Process Control , 1999 .

[147]  Enrique Del Castillo,et al.  A multivariate double EWMA process adjustment scheme for drifting processes , 2002, IIE Transactions.

[148]  Barry M. Wise,et al.  The process chemometrics approach to process monitoring and fault detection , 1995 .

[149]  Mokhtar B. Abdullah,et al.  A NEW ROBUST BIVARIATE CONTROL CHART FOR LOCATION , 2001 .

[150]  A. A. Tates,et al.  Monitoring a PVC batch process with multivariate statistical process control charts , 1999 .

[151]  N. K. Bose,et al.  Neural Network Fundamentals with Graphs, Algorithms and Applications , 1995 .

[152]  Michael H. Ramsey,et al.  The potential of multivariate quality control as a diagnostic tool in geoanalysis , 2000 .

[153]  William H. Woodall,et al.  Controversies and Contradictions in Statistical Process Control , 2000 .

[154]  X. Wang,et al.  Statistical Process Control Charts for Batch Operations Based on Independent Component Analysis , 2004 .

[155]  Yoav Benjamini,et al.  Multivariate Profile Charts for Statistical Process Control , 1994 .

[156]  W. Woodall,et al.  ON THE ECONOMIC DESIGN OF MULTIVARIATE CONTROL CHARTS , 2002 .

[157]  Youn Min Chou,et al.  Power comparisons for a hotelling's t2 STATISTIC , 1999 .

[158]  W. Woodall,et al.  Multivariate CUSUM Quality- Control Procedures , 1985 .

[159]  H. Moskowitz,et al.  Univariate X¯ control charts for individual characteristics in a multinormal model , 2000 .

[160]  M. Koutras,et al.  Improving the Performance of the Chi-square Control Chart via Runs Rules , 2006 .

[161]  X. Wang,et al.  Multidimensional Visualization of Principal Component Scores for Process Historical Data Analysis , 2004 .

[162]  Liu Yumin,et al.  An improvement for mewma in multivariate process control , 1996 .

[163]  F. Alt,et al.  Choosing principal components for multivariate statistical process control , 1996 .

[164]  Zachary G. Stoumbos,et al.  Robustness to Non-Normality of the Multivariate EWMA Control Chart , 2002 .

[165]  Joel K. Jolayemi.  A model for the statistical design of multivariate control charts with multiple control regions , 2000, Appl. Math. Comput..

[166]  D. Apley,et al.  The Autoregressive T2 Chart for Monitoring Univariate Autocorrelated Processes , 2002 .

[167]  John F. MacGregor,et al.  Multivariate SPC charts for monitoring batch processes , 1995 .

[168]  Douglas C. Montgomery,et al.  Using Control Charts to Monitor Process and Product Quality Profiles , 2004 .

[169]  W. Woodall,et al.  Adapting control charts for the preliminary analysis of multivariate observations , 1998 .

[170]  W. Melssen,et al.  Multivariate statistical process control using mixture modelling , 2005 .

[171]  J. B. Keats,et al.  Improving the performance of the multivariate exponentially weighted moving average control chart , 1999 .

[172]  Theodora Kourti,et al.  Analysis, monitoring and fault diagnosis of batch processes using multiblock and multiway PLS , 1995 .

[173]  Joel K. Jolayemi,et al.  An optimal design of multivariate control charts in the presence of multiple assignable causes , 1989 .

[174]  Regina Y. Liu.  Control Charts for Multivariate Processes , 1995 .

[175]  K. Tsui,et al.  Identification and Quantification in Multivariate Quality Control Problems , 1994 .

[176]  Fugee Tsung,et al.  A kernel-distance-based multivariate control chart using support vector methods , 2003 .

[177]  S. J. Wierda.  Multivariate statistical process control—recent results and directions for future research , 1994 .

[178]  John C. Young,et al.  A Practical Approach for Interpreting Multivariate T2 Control Chart Signals , 1997 .

[179]  Douglas C. Montgomery,et al.  Controlling multiple stream processes with principal components , 1996 .

[180]  Deborah F. Cook,et al.  Visualization of multivariate data with radial plots using SAS , 2001 .

[181]  John F. MacGregor,et al.  Multi-way partial least squares in monitoring batch processes , 1995 .

[182]  R. Crosier.  Multivariate generalizations of cumulative sum quality-control schemes , 1988 .

[183]  Kevin W Linderman,et al.  A weibull process failure mechanism for the economic design of mewma control charts , 2003 .

[184]  A. J. Morris,et al.  Non-parametric confidence bounds for process performance monitoring charts☆ , 1996 .

[185]  In-Beum Lee,et al.  Fault Detection Based on a Maximum-Likelihood Principal Component Analysis (PCA) Mixture , 2005 .

[186]  Jose Luis Beltran Guerrero,et al.  Multivariate mutual information , 1994 .

[187]  D. He,et al.  Multivariate multiple sampling charts , 2005 .

[188]  Do Sun Bai,et al.  A Multivariate T2 Control Chart for Skewed Populations Using Weighted Standard Deviations , 2004 .

[189]  B. J. Murphy.  Selecting Out of Control Variables with the T2 Multivariate Quality Control Procedure , 1987 .

[190]  Peihua Qiu,et al.  A Rank-Based Multivariate CUSUM Procedure , 2001, Technometrics.