Support vector machines for recognizing shifts in correlated and other manufacturing processes

Traditional statistical process control (SPC) techniques of control charting are not applicable in many process industries where the data from the facilities are often autocorrelated. This is often true in piece-part manufacturing industries that are highly automated and integrated. Several attempts have been made in the literature to extend traditional SPC techniques to deal with autocorrelated parameters. However, these extensions pose several serious limitations. The literature discusses several machine-learning methods based on radial basis function (RBF) networks and multi-layer perceptron (MLP) networks to address the limitations, with some success. This paper demonstrates that support vector machines (SVMs) can be extremely effective in minimizing both Type-I errors (probability that the method would wrongly declare the process to be out of control or generate a false alarm) and Type-II errors (probability that the method will be unable to detect a true shift or trend present in the process) in these autocorrelated processes. Even while employing the simplest type of polynomial kernels, the SVMs were extremely good at detecting shifts in papermaking and viscosity datasets (available in the literature) and performed as well or better than traditional as well as machine learning methods. It was also observed that SVMs are good at minimizing both Type-I and Type-II errors even in monitoring non-correlated processes. When tested on datasets available in the literature, they once again performed as well or better than the classical Shewhart control charts and other machine learning methods.

[1]  G. Allen Pugh A COMPARISON OF NEURAL NETWORKS TO SPC CHARTS , 1991 .

[2]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[3]  Douglas C. Montgomery,et al.  A time‐series approach to discrete real‐time process quality control , 1989 .

[4]  Chih-Chou Chiu,et al.  Using radial basis function neural networks to recognize shifts in correlated manufacturing process parameters , 1998 .

[5]  T. Harris,et al.  Statistical process control procedures for correlated observations , 1991 .

[6]  Nozer D. Singpurwalla Statistical Control by Monitoring and Feedback Adjustment: George Box and Alberto Luceno (Eds.); Wiley Series in Probability and Statistics; Copyright 1997, John Wiley and Sons, Inc.; ISBN 0-471-19046-2 , 2000 .

[7]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[8]  K. D. C. Stoodley Time Series and Systems Analysis with Applications , 1985 .

[9]  Marti A. Hearst Intelligent Connections: Battling with GA-Joe. , 1998 .

[10]  Layth C. Alwan,et al.  Time-Series Modeling for Statistical Process Control , 1988 .

[11]  Frederick W. Faltin,et al.  Statistical Control by Monitoring and Feedback Adjustment , 1999, Technometrics.

[12]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[13]  Alice E. Smith,et al.  X-bar and R control chart interpretation using neural computing , 1994 .

[14]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[15]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[16]  George C. Runger,et al.  Average run lengths for cusum control charts applied to residuals , 1995 .

[17]  Herbert Moskowitz,et al.  Run-Length Distributions of Special-Cause Control Charts for Correlated Processes , 1994 .

[18]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[19]  Marti A. Hearst,et al.  SVMs—a practical consequence of learning theory , 1998 .

[20]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[21]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[22]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[23]  George E. P. Box,et al.  Time Series Analysis: Forecasting and Control , 1977 .

[24]  Herbert Moskowitz,et al.  [Run-Length Distributions of Special-Cause Control Charts for Correlated Processes]: Discussion , 1994 .