Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach

The effective recognition of unnatural control chart patterns (CCPs) is a critical issue in statistical process control, as unnatural CCPs can be associated with specific assignable causes adversely affecting the process. Machine learning techniques, such as artificial neural networks (ANNs), have been widely used in the research field of CCP recognition. However, ANN approaches can easily overfit the training data, producing models that can suffer from the difficulty of generalization. This causes a pattern misclassification problem when the training examples contain a high level of background noise (common cause variation). Support vector machines (SVMs) embody the structural risk minimization, which has been shown to be superior to the traditional empirical risk minimization principle employed by ANNs. This research presents a SVM-based CCP recognition model for the on-line real-time recognition of seven typical types of unnatural CCP, assuming that the process observations are AR(1) correlated over time. Empirical comparisons indicate that the proposed SVM-based model achieves better performance in both recognition accuracy and recognition speed than the model based on a learning vector quantization network. Furthermore, the proposed model is more robust toward background noise in the process data than the model based on a back propagation network. These results show the great potential of SVM methods for on-line CCP recognition.

[1]  Yeou-Ren Shiue,et al.  On-line identification of control chart patterns using self-organizing approaches , 2005 .

[2]  Miin-Shen Yang,et al.  A fuzzy-soft learning vector quantization for control chart pattern recognition , 2002 .

[3]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[4]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[5]  Wu Meng,et al.  Application of Support Vector Machines in Financial Time Series Forecasting , 2007 .

[6]  Hsuan-Tien Lin A Study on Sigmoid Kernels for SVM and the Training of non-PSD Kernels by SMO-type Methods , 2005 .

[7]  Bhavani Raskutti,et al.  The Effect of Attribute Scaling on the Performance of Support Vector Machines , 2004, Australian Conference on Artificial Intelligence.

[8]  Ruey-Shiang Guh,et al.  A hybrid learning-based model for on-line detection and analysis of control chart patterns , 2005, Comput. Ind. Eng..

[9]  Lloyd S. Nelson,et al.  Interpreting Shewhart X̄ Control Charts , 1985 .

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[11]  Thomas Lee Lucy-Bouler Using autocorrelations, cusums and runs rules for control chart pattern recognition: an expert system approach , 1991 .

[12]  Chuen-Sheng Cheng,et al.  Design of a knowledge-based expert system for statistical process control , 1992 .

[13]  Ruey-Shiang Guh,et al.  Real-time recognition of control chart patterns in autocorrelated processes using a learning vector quantization network-based approach , 2008 .

[14]  Herbert Moskowitz,et al.  [Run-Length Distributions of Special-Cause Control Charts for Correlated Processes]: Rejoinder , 1994 .

[15]  Shai Fine,et al.  A hybrid GMM/SVM approach to speaker identification , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[16]  Jen-Ying Shih,et al.  A study of Taiwan's issuer credit rating systems using support vector machines , 2006, Expert Syst. Appl..

[17]  Lucila Ohno-Machado,et al.  A Comparison of Machine Learning Methods for the Diagnosis of Pigmented Skin Lesions , 2001, J. Biomed. Informatics.

[18]  Lloyd S. Nelson,et al.  Column: Technical Aids: The Shewhart Control Chart--Tests for Special Causes , 1984 .

[19]  Jill A. Swift,et al.  Out-of-control pattern recognition and analysis for quality control charts using LISP-based systems , 1995 .

[20]  Gerald A. Silver,et al.  Systems Analysis and Design , 1989 .

[21]  Averill M. Law,et al.  Simulation modelling and analysis , 1991 .

[22]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[23]  Herbert Moskowitz,et al.  Run-Length Distributions of Special-Cause Control Charts for Correlated Processes , 1994 .

[24]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[25]  Chuen-Sheng Cheng,et al.  Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines , 2008, Expert Syst. Appl..

[26]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[27]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[28]  Bernhard Schölkopf,et al.  Comparing support vector machines with Gaussian kernels to radial basis function classifiers , 1997, IEEE Trans. Signal Process..

[29]  F. Tay,et al.  Application of support vector machines in financial time series forecasting , 2001 .

[30]  Ratna Babu Chinnam,et al.  Support vector machines for recognizing shifts in correlated and other manufacturing processes , 2002 .

[31]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[32]  Chuen-Sheng Cheng,et al.  A NEURAL NETWORK APPROACH FOR THE ANALYSIS OF CONTROL CHART PATTERNS , 1997 .

[33]  George C. Runger,et al.  Average run lengths for cusum control charts applied to residuals , 1995 .

[34]  Shien-Ming Wu,et al.  Time series and system analysis with applications , 1983 .

[35]  Yoke San Wong,et al.  Multiclassification of tool wear with support vector machine by manufacturing loss consideration , 2004 .

[36]  H. Brian Hwarng Detecting process mean shift in the presence of autocorrelation: a neural-network based monitoring scheme , 2004 .

[37]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[38]  Asoke K. Nandi,et al.  Support vector machines for detection and characterization of rolling element bearing faults , 2001 .

[39]  A. Vasilopoulos,et al.  Modification of Control Chart Limits in the Presence of Data Correlation , 1978 .

[40]  Ah Chung Tsoi,et al.  Lessons in Neural Network Training: Overfitting May be Harder than Expected , 1997, AAAI/IAAI.

[41]  H. Brian Hwarng,et al.  A neural network approach to identifying cyclic behaviour on control charts: a comparative study , 1997, Int. J. Syst. Sci..

[42]  James T. Kwok,et al.  Automated Text Categorization Using Support Vector Machine , 1998, ICONIP.

[43]  Chuen-Sheng Cheng A multi-layer neural network model for detecting changes in the process mean , 1995 .

[44]  Bernhard Schölkopf,et al.  Extracting Support Data for a Given Task , 1995, KDD.

[45]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[46]  Roger M. Sauter,et al.  Introduction to Statistical Quality Control (2nd ed.) , 1992 .

[47]  Shing I. Chang,et al.  An integrated neural network approach for simultaneous monitoring of process mean and variance shifts a comparative study , 1999 .

[48]  Warren S. Sarle,et al.  Stopped Training and Other Remedies for Overfitting , 1995 .