Recognition of control chart patterns using fuzzy SVM with a hybrid kernel function

Accurate control chart patterns recognition (CCPR) plays an essential role in the implementation of control charts. However, it is a challenging problem since nonrandom control chart patterns (CCPs) are normally distorted by “common process variations”. In this paper, a novel method of CCPR by integrating fuzzy support vector machine (SVM) with hybrid kernel function and genetic algorithm (GA) is proposed. Firstly, two shape features and two statistical features that do not depend on the distribution parameters and number of samples are presented to explicitly describe the characteristics of CCPs. Then, a novel multiclass method based on fuzzy SVM with a hybrid kernel function is proposed. In this method, the influence of outliers on classification accuracy of SVM-based classifiers is weakened by assigning a degree of membership for every training sample. Meanwhile, a hybrid kernel function combining Gaussian kernel and polynomial kernel is adopted to further enhance the generalization ability of the classifiers. To solve the issue of features selection and parameters optimization, GA is used to simultaneously optimize the input features subsets and parameters of fuzzy SVM-based classifier. Finally, several simulation experiments and a real example are addressed to validate the feasibility and effectiveness of the proposed methodology. And the results of simulation experiments demonstrate that it can achieve excellent performance for CCPR and outperforms other approaches, such as learning vector quantization network, multi-layer perceptron network, probability neural network, fuzzy clustering and SVM, in term of recognition accuracy. The results of the practical cases manifest that the proposed method has application potential for solving the problem of control chart interpretation in real-world.

[1]  G. B. Wetherill,et al.  Quality Control and Industrial Statistics , 1975 .

[2]  Lloyd S. Nelson,et al.  Column: Technical Aids: The Shewhart Control Chart--Tests for Special Causes , 1984 .

[3]  Daniel L. Thomas,et al.  What is an Expert System , 1988 .

[4]  Chuen-Sheng Cheng,et al.  Design of a knowledge-based expert system for statistical process control , 1992 .

[5]  Z. Michalewicz,et al.  A modified genetic algorithm for optimal control problems , 1992 .

[6]  Anil Mital,et al.  Quality control expert systems: a review of pertinent literature , 1993, J. Intell. Manuf..

[7]  Darrell Whitley,et al.  A genetic algorithm tutorial , 1994, Statistics and Computing.

[8]  Duc Truong Pham,et al.  Control chart pattern recognition using learning vector quantization networks , 1994 .

[9]  Amjed M. Al-Ghanim,et al.  Unnatural pattern recognition on control charts using correlation analysis techniques , 1995 .

[10]  Jill A. Swift,et al.  Out-of-control pattern recognition and analysis for quality control charts using LISP-based systems , 1995 .

[11]  Amjed M. Al-Ghanim,et al.  Automated unnatural pattern recognition on control charts using correlation analysis techniques , 1997 .

[12]  Chuen-Sheng Cheng,et al.  A NEURAL NETWORK APPROACH FOR THE ANALYSIS OF CONTROL CHART PATTERNS , 1997 .

[13]  Duc Truong Pham,et al.  Feature-based control chart pattern recognition , 1997 .

[14]  James T. Kwok,et al.  Automated Text Categorization Using Support Vector Machine , 1998, ICONIP.

[15]  Kristin P. Bennett,et al.  Multicategory Classification by Support Vector Machines , 1999, Comput. Optim. Appl..

[16]  J. D. T. Tannock,et al.  A neural network approach to characterize pattern parameters in process control charts , 1999, J. Intell. Manuf..

[17]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[18]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[19]  Claus Bahlmann,et al.  Online handwriting recognition with support vector machines - a kernel approach , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[20]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[21]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[22]  Adnan Hassan,et al.  Improved SPC chart pattern recognition using statistical features , 2003 .

[23]  Yousef Al-Assaf,et al.  Recognition of control chart patterns using multi-resolution wavelets analysis and neural networks , 2004, Comput. Ind. Eng..

[24]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[25]  Jun Wang,et al.  A support vector machine with a hybrid kernel and minimal Vapnik-Chervonenkis dimension , 2004, IEEE Transactions on Knowledge and Data Engineering.

[26]  Joseph Picone,et al.  Applications of support vector machines to speech recognition , 2004, IEEE Transactions on Signal Processing.

[27]  Ruey-Shiang Guh,et al.  A hybrid learning-based model for on-line detection and analysis of control chart patterns , 2005, Comput. Ind. Eng..

[28]  Khaled Assaleh,et al.  Features extraction and analysis for classifying causable patterns in control charts , 2005, Comput. Ind. Eng..

[29]  M. Arif Wani,et al.  Parallel algorithm for control chart pattern recognition , 2005, Fourth International Conference on Machine Learning and Applications (ICMLA'05).

[30]  Shankar Chakraborty,et al.  Feature-based recognition of control chart patterns , 2006, Comput. Ind. Eng..

[31]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[32]  Zheng Chen,et al.  A hybrid system for SPC concurrent pattern recognition , 2007, Adv. Eng. Informatics.

[33]  Way Kuo,et al.  Identification of control chart patterns using wavelet filtering and robust fuzzy clustering , 2007, J. Intell. Manuf..

[34]  Fred Spiring,et al.  Introduction to Statistical Quality Control , 2007, Technometrics.

[35]  Shankar Chakraborty,et al.  A study on the various features for effective control chart pattern recognition , 2007 .

[36]  Ruey-Shiang Guh,et al.  Real-time recognition of control chart patterns in autocorrelated processes using a learning vector quantization network-based approach , 2008 .

[37]  Zhiqiang Cheng,et al.  A Research about Pattern Recognition of Control Chart Using Probability Neural Network , 2008, 2008 ISECS International Colloquium on Computing, Communication, Control, and Management.

[38]  Mohamed Cheriet,et al.  Model selection for the LS-SVM. Application to handwriting recognition , 2009, Pattern Recognit..

[39]  Pingyu Jiang,et al.  Recognizing control chart patterns with neural network and numerical fitting , 2009, J. Intell. Manuf..

[40]  Lifeng Xi,et al.  Online intelligent monitoring and diagnosis of aircraft horizontal stabilizer assemble processes , 2010 .

[41]  R. Brereton,et al.  Support vector machines for classification and regression. , 2010, The Analyst.

[42]  Susanta Kumar Gauri,et al.  Control chart pattern recognition using feature-based learning vector quantization , 2010 .

[43]  A. Ebrahimzadeh,et al.  Application of the PSO-SVM model for recognition of control chart patterns. , 2010, ISA transactions.

[44]  A. Ebrahimzadeh,et al.  Control chart pattern recognition using an optimized neural network and efficient features. , 2010, ISA transactions.

[45]  Ataollah Ebrahimzadeh,et al.  Control chart pattern recognition using neural networks and efficient features: a comparative study , 2011, Pattern Analysis and Applications.

[46]  Ruey-Shiang Guh,et al.  Effective recognition of control chart patterns in autocorrelated data using a support vector machine based approach , 2011, Comput. Ind. Eng..

[47]  Ataollah Ebrahimzadeh,et al.  Control chart pattern recognition using a novel hybrid intelligent method , 2011, Appl. Soft Comput..

[48]  Ataollah Ebrahimzadeh,et al.  Control chart pattern recognition using K-MICA clustering and neural networks. , 2012, ISA transactions.

[49]  Shankar Chakraborty,et al.  An expert system for control chart pattern recognition , 2012 .

[50]  Ibrahim Masood,et al.  Pattern recognition for bivariate process mean shifts using feature-based artificial neural network , 2012, The International Journal of Advanced Manufacturing Technology.

[51]  Jan Lundberg,et al.  Multivariate process parameter change identification by neural network , 2013, The International Journal of Advanced Manufacturing Technology.

[52]  Rassoul Noorossana,et al.  Identifying change point of a non-random pattern on control chart using artificial neural networks , 2013, The International Journal of Advanced Manufacturing Technology.

[53]  Jose A. Ventura,et al.  A new genetic algorithm for lot-streaming flow shop scheduling with limited capacity buffers , 2013, J. Intell. Manuf..

[54]  Zhen He,et al.  Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques , 2013, J. Intell. Manuf..

[55]  Jun Lv,et al.  Recognition of concurrent control chart patterns using wavelet transform decomposition and multiclass support vector machines , 2013, Comput. Ind. Eng..

[56]  Saeid Nahavandi,et al.  Identification of concurrent control chart patterns with singular spectrum analysis and learning vector quantization , 2012, Journal of Intelligent Manufacturing.

[57]  Shichang Du,et al.  Minimal Euclidean distance chart based on support vector regression for monitoring mean shifts of auto-correlated processes , 2013 .

[58]  Kazuhiro Takeyasu,et al.  Optimization technique by genetic algorithms for international logistics , 2014, J. Intell. Manuf..

[59]  Imtiaz Ahmed,et al.  Performance evaluation of control chart for multiple assignable causes using genetic algorithm , 2014 .

[60]  Petros Xanthopoulos,et al.  A weighted support vector machine method for control chart pattern recognition , 2014, Comput. Ind. Eng..

[61]  Wei Zhou,et al.  Autoregressive coefficient-invariant control chart pattern recognition in autocorrelated manufacturing processes using neural network ensemble , 2013, Journal of Intelligent Manufacturing.

[62]  Tian-Shyug Lee,et al.  A multi-stage control chart pattern recognition scheme based on independent component analysis and support vector machine , 2014, Journal of Intelligent Manufacturing.

[63]  Shan Suthaharan,et al.  Support Vector Machine , 2016 .