Robust kernel distance multivariate control chart using support vector principles

It is important to monitor manufacturing processes in order to improve product quality and reduce production cost. Statistical Process Control (SPC) is the most commonly used method for process monitoring, in particular making distinctions between variations attributed to normal process variability to those caused by ‘special causes’. Most SPC and multivariate SPC (MSPC) methods are parametric in that they make assumptions about the distributional properties and autocorrelation structure of in-control process parameters, and, if satisfied, are effective in managing false alarms/-positives and false-negatives. However, when processes do not satisfy these assumptions, the effectiveness of SPC methods is compromised. Several non-parametric control charts based on sequential ranks of data depth measures have been proposed in the literature, but their development and implementation have been rather slow in industrial process control. Several non-parametric control charts based on machine learning principles have also been proposed in the literature to overcome some of these limitations. However, unlike conventional SPC methods, these non-parametric methods require event data from each out-of-control process state for effective model building. The paper presents a new non-parametric multivariate control chart based on kernel distance that overcomes these limitations by employing the notion of one-class classification based on support vector principles. The chart is non-parametric in that it makes no assumptions regarding the data probability density and only requires ‘normal’ or in-control data for effective representation of an in-control process. It does, however, make an explicit provision to incorporate any available data from out-of-control process states. Experimental evaluation on a variety of benchmarking datasets suggests that the proposed chart is effective for process monitoring.

[1]  Arthur B. Yeh,et al.  A multivariate exponentially weighted moving average control chart for monitoring process variability , 2003 .

[2]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[3]  Manabu Kano,et al.  Evolution of multivariate statistical process control: application of independent component analysis and external analysis , 2004, Comput. Chem. Eng..

[4]  S. Chakraborti,et al.  Nonparametric Control Charts: An Overview and Some Results , 2001 .

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Douglas C. Montgomery,et al.  A review of multivariate control charts , 1995 .

[7]  Claus Weihs,et al.  A Nonparametric Multivariate Control Chart Based on Data Depth , 2004 .

[8]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[9]  H. Hotelling Multivariate Quality Control-illustrated by the air testing of sample bombsights , 1947 .

[10]  K. Rose,et al.  The mathematics of success and failure (SPC) , 1991, IEEE Circuits and Devices Magazine.

[11]  Fugee Tsung,et al.  A kernel-distance-based multivariate control chart using support vector methods , 2003 .

[12]  W. Woodall,et al.  On Nonparametric Multivariate Control Charts Based on Data Depth , 2001 .

[13]  Regina Y. Liu,et al.  A Quality Index Based on Data Depth and Multivariate Rank Tests , 1993 .

[14]  Alan M. Polansky,et al.  A Smooth Nonparametric Approach to Multivariate Process Capability , 2001, Technometrics.

[15]  Peter R. Nelson,et al.  The Effect of Non-Normality on the Control Limits of X-Bar Charts , 1976 .

[16]  David M. J. Tax,et al.  One-class classification , 2001 .

[17]  Ali Cinar,et al.  Statistical process monitoring and disturbance diagnosis in multivariable continuous processes , 1996 .

[18]  D. Casasent,et al.  Support vector machines for class representation and discrimination , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[19]  Pekka Teppola,et al.  Wavelet–PLS regression models for both exploratory data analysis and process monitoring , 2000 .

[20]  George C. Runger,et al.  A Markov Chain Model for the Multivariate Exponentially Weighted Moving Averages Control Chart , 1996 .

[21]  Uwe Kruger,et al.  Synthesis of T2 and Q statistics for process monitoring , 2004 .

[22]  Jian Zhang,et al.  MULTIVARIATE CUMULATIVE SUM CONTROL CHARTS BASED ON PROJECTION PURSUIT , 2001 .

[23]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[24]  Douglas C. Montgomery,et al.  Research Issues and Ideas in Statistical Process Control , 1999 .

[25]  Seongkyu Yoon,et al.  Principal‐component analysis of multiscale data for process monitoring and fault diagnosis , 2004 .

[26]  Chih-Chou Chiu,et al.  Using radial basis function neural networks to recognize shifts in correlated manufacturing process parameters , 1998 .

[27]  John F. MacGregor STATISTICAL PROCESS CONTROL OF MULTIVARIATE PROCESSES , 1994 .

[28]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[29]  Connie M. Borror,et al.  Design Strategies for the Multivariate Exponentially Weighted Moving Average Control Chart , 2004 .

[30]  Olvi L. Mangasarian,et al.  Nonlinear Programming , 1969 .

[31]  G. Allen Pugh A COMPARISON OF NEURAL NETWORKS TO SPC CHARTS , 1991 .

[32]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[33]  Alice E. Smith,et al.  X-bar and R control chart interpretation using neural computing , 1994 .

[34]  P Laanvander,et al.  A class of distribution‐free control charts , 2004 .

[35]  穂鷹 良介 Non-Linear Programming の計算法について , 1963 .

[36]  I. Nimmo,et al.  Adequately address abnormal operations , 1995 .

[37]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[38]  B. Bakshi Multiscale PCA with application to multivariate statistical process monitoring , 1998 .

[39]  Ratna Babu Chinnam,et al.  Support vector machines for recognizing shifts in correlated and other manufacturing processes , 2002 .

[40]  George C. Runger,et al.  Multivariate Extensions to Cumulative Sum Control Charts , 2004 .

[41]  J. Mercer Functions of positive and negative type, and their connection with the theory of integral equations , 1909 .

[42]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[43]  Jie Zhang,et al.  Process performance monitoring using multivariate statistical process control , 1996 .

[44]  W. A. Shewhart,et al.  Quality control charts , 1926 .

[45]  N. Eickelmann,et al.  Statistical Process Control: What You Don't Measure Can Hurt You! , 2003, IEEE Softw..