Recognition of concurrent control chart patterns using wavelet transform decomposition and multiclass support vector machines

Statistical process control charts have been widely utilized for monitoring process variation in many applications. Nonrandom patterns exhibited by control charts imply certain potential assignable causes that may deteriorate the process performance. Though some effective approaches to recognition of control chart patterns (CCPs) have been developed, most of them only focus on recognition and analysis of single patterns. A hybrid approach by integrating wavelet transform and improved particle swarm optimization-based support vector machine (P-SVM) for on-line recognition of concurrent CCPs is developed in this paper. A statistical correlation coefficient is used to determine whether the input pattern is a single or concurrent CCP. Based on wavelet transform, a raw concurrent pattern signal is decomposed into two basic pattern signals, which can be recognized by multiclass SVMs. The performance of the hybrid approach is evaluated by simulation experiments, and numerical and graphical results are provided to demonstrate that the proposed approach can perform effectively and efficiently in on-line CCP recognition task.

[1]  Douglas C. Montgomery,et al.  Statistical Quality Control , 2008 .

[2]  Tawfik T. El-Midany,et al.  A proposed framework for control chart pattern recognition in multivariate process using artificial neural networks , 2010, Expert Syst. Appl..

[3]  Amit Mitra,et al.  Statistical Quality Control , 2002, Technometrics.

[4]  Yousef Al-Assaf,et al.  Recognition of control chart patterns using multi-resolution wavelets analysis and neural networks , 2004, Comput. Ind. Eng..

[5]  Miin-Shen Yang,et al.  A control chart pattern recognition system using a statistical correlation coefficient method , 2005, Comput. Ind. Eng..

[6]  Duc Truong Pham,et al.  Feature-based control chart pattern recognition , 1997 .

[7]  Amjed M. Al-Ghanim,et al.  An unsupervised learning neural algorithm for identifying process behavior on control charts and a comparison with supervised learning approaches , 1997 .

[8]  J.D.T. Tannock,et al.  Recognition of control chart concurrent patterns using a neural network approach , 1999 .

[9]  J. D. T. Tannock,et al.  On-line control chart pattern detection and discrimination - a neural network approach , 1999, Artif. Intell. Eng..

[10]  G. A. Pugh.  Synthetic neural networks for process control , 1989 .

[11]  Lifeng Xi,et al.  Fault diagnosis in assembly processes based on engineering-driven rules and PSOSAEN algorithm , 2011, Comput. Ind. Eng..

[12]  Seyed Taghi Akhavan Niaki,et al.  Fault Diagnosis in Multivariate Control Charts Using Artificial Neural Networks , 2005 .

[13]  Jian Liu,et al.  An efficient star acquisition method based on SVM with mixtures of kernels , 2005, Pattern Recognit. Lett..

[14]  Yousef Al-Assaf,et al.  Multi-Resolution Wavelets Analysis Approach for the Recognition of Concurrent Control Chart Patterns , 2004 .

[15]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[16]  Lifeng Xi,et al.  Online intelligent monitoring and diagnosis of aircraft horizontal stabilizer assemble processes , 2010 .

[17]  Thomas Lee Lucy-Bouler.  Using autocorrelations, cusums and runs rules for control chart pattern recognition: an expert system approach , 1991 .

[18]  Chuen-Sheng Cheng,et al.  Design of a knowledge-based expert system for statistical process control , 1992 .

[19]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[20]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[21]  Lu Wencong,et al.  Support vector regression applied to materials optimization of sialon ceramics , 2006 .

[22]  Domenico Conforti,et al.  Kernel based support vector machine via semidefinite programming: Application to medical diagnosis , 2010, Comput. Oper. Res..

[23]  Jun Wang,et al.  A support vector machine with a hybrid kernel and minimal Vapnik-Chervonenkis dimension , 2004, IEEE Transactions on Knowledge and Data Engineering.

[24]  Khaled Assaleh,et al.  Features extraction and analysis for classifying causable patterns in control charts , 2005, Comput. Ind. Eng..

[25]  Chuen-Sheng Cheng,et al.  Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines , 2008, Expert Syst. Appl..

[26]  Bernhard Schölkopf,et al.  Kernel Methods in Computational Biology , 2005 .

[27]  Duc Truong Pham,et al.  Control chart pattern recognition using learning vector quantization networks , 1994 .

[28]  Robert Kern.  Statistical Quality Control , 2014 .

[29]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[30]  H. B. Hwarng.  Multilayer perceptions for detecting cyclic data on control charts , 1995 .

[31]  Zheng Chen,et al.  A hybrid system for SPC concurrent pattern recognition , 2007, Adv. Eng. Informatics.

[32]  Tai-Yue Wang,et al.  Artificial neural networks to classify mean shifts from multivariate χ2 chart signals , 2004, Comput. Ind. Eng..

[33]  Ruey-Shiang Guh,et al.  A hybrid learning-based model for on-line detection and analysis of control chart patterns , 2005, Comput. Ind. Eng..

[34]  Jill A. Swift,et al.  Out-of-control pattern recognition and analysis for quality control charts using LISP-based systems , 1995 .

[35]  Fugee Tsung,et al.  A kernel-distance-based multivariate control chart using support vector methods , 2003 .

[36]  Sankar K. Pal,et al.  Multilayer perceptron, fuzzy sets, and classification , 1992, IEEE Trans. Neural Networks.

[37]  Amjed M. Al-Ghanim,et al.  Automated unnatural pattern recognition on control charts using correlation analysis techniques , 1997 .

[38]  Ratna Babu Chinnam,et al.  Support vector machines for recognizing shifts in correlated and other manufacturing processes , 2002 .

[39]  Chuen-Sheng Cheng,et al.  A NEURAL NETWORK APPROACH FOR THE ANALYSIS OF CONTROL CHART PATTERNS , 1997 .

[40]  Zhao Lu,et al.  Non-Mercer hybrid kernel for linear programming support vector regression in nonlinear systems identification , 2009, Appl. Soft Comput..

[41]  G. B. Wetherill,et al.  Quality Control and Industrial Statistics , 1975 .

[42]  Shichang Du,et al.  Product lifecycle-oriented quality and productivity improvement based on stream of variation methodology , 2008, Comput. Ind..

[43]  Ahmed Ghorbel,et al.  A survey of control-chart pattern-recognition literature (1991-2010) based on a new conceptual classification scheme , 2012, Comput. Ind. Eng..

[44]  H. B. Hwarng,et al.  Detecting process non-randomness through a fast and cumulative learning ART-based pattern recognizer , 1995 .

[45]  Ruey-Shiang Guh,et al.  Integrating artificial intelligence into on‐line statistical process control , 2003 .

[46]  Yeou-Ren Shiue,et al.  On-line identification of control chart patterns using self-organizing approaches , 2005 .

[47]  Adnan Hassan,et al.  Improved SPC chart pattern recognition using statistical features , 2003 .

[48]  C. Burrus,et al.  Introduction to Wavelets and Wavelet Transforms: A Primer , 1997 .

[49]  Yi-Chih Hsieh,et al.  A neural network based model for abnormal pattern recognition of control charts , 1999 .

[50]  Chih-Chou Chiu,et al.  Using radial basis function neural networks to recognize shifts in correlated manufacturing process parameters , 1998 .

[51]  Shankar Chakraborty,et al.  Feature-based recognition of control chart patterns , 2006, Comput. Ind. Eng..

[52]  Shankar Chakraborty,et al.  Improved recognition of control chart patterns using artificial neural networks , 2008 .

[53]  S. Gunn.  Support Vector Machines for Classification and Regression , 1998 .

[54]  Hairong Qi,et al.  An integrated approach for process monitoring using wavelet analysis and competitive neural network , 2007 .

[55]  Way Kuo,et al.  A hybrid approach for identification of concurrent control chart patterns , 2009, J. Intell. Manuf..

[56]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[57]  Eugene L. Grant,et al.  Statistical Quality Control , 1946 .

[58]  A. Ebrahimzadeh,et al.  Application of the PSO-SVM model for recognition of control chart patterns. , 2010, ISA transactions.

[59]  Lloyd S. Nelson,et al.  Column: Technical Aids: The Shewhart Control Chart--Tests for Special Causes , 1984 .

[60]  J. Lv,et al.  An integrated system for on-line intelligent monitoring and identifying process variability and its application , 2010, Int. J. Comput. Integr. Manuf..

[61]  Shankar Chakraborty,et al.  Recognition of control chart patterns using improved selection of features , 2009, Comput. Ind. Eng..

[62]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.