A survey of control-chart pattern-recognition literature (1991-2010) based on a new conceptual classification scheme

Control Chart Pattern Recognition (CCPR) is a critical task in Statistical Process Control (SPC). Abnormal patterns exhibited in control charts can be associated with certain assignable causes adversely affecting the process stability. Abundant literature treats the detection of different Control Chart Patterns (CCPs). In fact, numerous CCPR studies have been developed according to various objectives and hypotheses. Despite the widespread literature on this topic, efforts to review and analyze research on CCPR are very limited. For this reason, this survey paper proposes a new conceptual classification scheme, based on content analysis method, to classify past and current developments in CCPR research. More than 120 papers published on CCPR studies within 1991-2010 were classified and analyzed. Major findings of this survey include the following. (1) The most popular CCPR studies deal with independently and identically distributed process data. (2) Some recent studies on identification of mean shifts or/and variance shifts of a multivariate process are based on innovative techniques. (3) The percentage of studies that address concurrent pattern identification is increasing. (4) The majority of the reviewed articles use Artificial Neural Network (ANN) approach. Feature-based techniques, in particular wavelet-denoise, are investigated for improving the recognition performance of ANN. For the same reason, there is a general trend followed by many authors who propose hybrid, modular and integrated ANN recognizer designs combined with decision tree learning, particle swarm optimization, etc. (5) There are two main categories of performance criteria used to evaluate CCPR approaches: statistical criteria that are related to two conventional Average Run Length (ARL) measures, and recognition-accuracy criteria, which are not based on these ARL measures. The most applied criteria are recognition-accuracy criteria, mainly for ANN-based approaches. Performance criteria which are related to ARL measures are insufficient and inappropriate in the case of concurrent pattern identification. Finally, this paper briefly discusses some future research directions and our perspectives.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  A. K. Kochhar,et al.  Pattern recognition for statistical process control charts , 1998 .

[3]  Joarder Kamruzzaman,et al.  Movement Pattern Recognition Using Neural Networks , 2006 .

[4]  Ratna Babu Chinnam,et al.  Support vector machines for recognizing shifts in correlated and other manufacturing processes , 2002 .

[5]  Marion R. Reynolds,et al.  Control charts for monitoring processes with autocorrelated data , 1997 .

[6]  J. D. T. Tannock,et al.  A neural network approach to characterize pattern parameters in process control charts , 1999, J. Intell. Manuf..

[7]  Suraj M. Alexander,et al.  Advisory system for control chart selection , 1986 .

[8]  Tomas Velasco,et al.  Back propagation artificial neural networks for the analysis of quality control charts , 1993 .

[9]  Mohammad Hossein Fazel Zarandi,et al.  A general fuzzy-statistical clustering approach for estimating the time of change in variable sampling control charts , 2010, Inf. Sci..

[10]  Chuen-Sheng Cheng,et al.  A NEURAL NETWORK APPROACH FOR THE ANALYSIS OF CONTROL CHART PATTERNS , 1997 .

[11]  Ruey‐Shiang Guh.  Robustness of the neural network based control chart pattern recognition system to non‐normality , 2002 .

[12]  Jionghua Jin,et al.  Automatic feature extraction of waveform signals for in-process diagnostic performance improvement , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[13]  S. W. Roberts.  Control chart tests based on geometric moving averages , 2000 .

[14]  Norma Faris Hubele,et al.  Back-propagation pattern recognizers for X¯ control charts: methodology and performance , 1993 .

[15]  S. M. Alexander,et al.  The application of expert systems to manufacturing process control , 1987 .

[16]  Andrew C. Palm,et al.  Tables of Run Length Percentiles for Determining the Sensitivity of Shewhart Control Charts for Averages with Supplementary Runs Rules , 1990 .

[17]  Shing I. Chang,et al.  A neural fuzzy control chart for detecting and classifying process mean shifts , 1996 .

[18]  G. Allen Pugh.  A COMPARISON OF NEURAL NETWORKS TO SPC CHARTS , 1991 .

[19]  Mojtaba Salehi,et al.  On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model , 2011, Neurocomputing.

[20]  Ruey-Shiang Guh.  Optimizing Feedforward Neural Networks For Control Chart Pattern Recognition Through Genetic Algorithms , 2004, Int. J. Pattern Recognit. Artif. Intell..

[21]  Deborah F. Cook,et al.  An augmented neural network classification approach to detecting mean shifts in correlated manufacturing process parameters , 2004 .

[22]  Argon Chen,et al.  An alternative mean estimator for processes monitored by SPC charts , 2000 .

[23]  Duc Truong Pham,et al.  Control Chart Pattern Recognition Using Combinations of Multi-Layer Perceptrons and Learning-Vector-Quantization Neural Networks , 1993 .

[24]  Xiaojun Zhou,et al.  Identifying source(s) of out-of-control signals in multivariate manufacturing processes using selective neural network ensemble , 2009, Eng. Appl. Artif. Intell..

[25]  Kevin J. Dooley,et al.  Identification of change structure in statistical process control , 1992 .

[26]  Seref Sagiroglu,et al.  Training multilayered perceptrons for pattern recognition: a comparative study of four training algorithms , 2001 .

[27]  Chuen-Sheng Cheng,et al.  Design of a knowledge-based expert system for statistical process control , 1992 .

[28]  Susanta Kumar Gauri.  Control chart pattern recognition using feature-based learning vector quantization , 2010 .

[29]  Ruey-Shiang Guh.  Real-time pattern recognition in statistical process control: A hybrid neural network/decision tree-based approach , 2005 .

[30]  Richard Stacey,et al.  A prototype expert system for selecting control charts , 1988 .

[31]  Seyed Taghi Akhavan Niaki,et al.  A clustering approach to identify the time of a step change in Shewhart control charts , 2008, Qual. Reliab. Eng. Int..

[32]  Miin-Shen Yang,et al.  A control chart pattern recognition system using a statistical correlation coefficient method , 2005, Comput. Ind. Eng..

[33]  Herbert Moskowitz,et al.  [Run-Length Distributions of Special-Cause Control Charts for Correlated Processes]: Rejoinder , 1994 .

[34]  R. Kolbe,et al.  Content-Analysis Research: An Examination of Applications with Directives for Improving Research Reliability and Objectivity , 1991 .

[35]  Fred Spiring,et al.  Introduction to Statistical Quality Control , 2007, Technometrics.

[36]  Ruey-Shiang Guh,et al.  Real-time recognition of control chart patterns in autocorrelated processes using a learning vector quantization network-based approach , 2008 .

[37]  Duc Truong Pham,et al.  Neural Networks for Identification, Prediction and Control , 1995 .

[38]  Amjed M. Al-Ghanim,et al.  An unsupervised learning neural algorithm for identifying process behavior on control charts and a comparison with supervised learning approaches , 1997 .

[39]  Amjed M. Al-Ghanim,et al.  Unnatural pattern recognition on control charts using correlation analysis techniques , 1995 .

[40]  Shing I. Chang,et al.  An integrated neural network approach for simultaneous monitoring of process mean and variance shifts a comparative study , 1999 .

[41]  Ataollah Ebrahimzadeh,et al.  Control chart pattern recognition using a novel hybrid intelligent method , 2011, Appl. Soft Comput..

[42]  Robert M. Parkin,et al.  Integrating novelty detection, neural networks and conventional tools for pattern recognition in multivariate processes , 2004 .

[43]  H. Brian Hwarng,et al.  A neural network approach to identifying cyclic behaviour on control charts: a comparative study , 1997, Int. J. Syst. Sci..

[44]  A. Anglani,et al.  Adaptive resonance theory-based neural algorithms for manufacturing process quality control , 2004 .

[45]  Hui Ping Cheng,et al.  Denoising and feature extraction for control chart pattern recognition in autocorrelated processes , 2008 .

[46]  F. Zorriassatine,et al.  Using novelty detection to identify abnormalities caused by mean shifts in bivariate processes , 2003 .

[47]  Lloyd S. Nelson,et al.  Column: Technical Aids: The Shewhart Control Chart--Tests for Special Causes , 1984 .

[48]  Bin Wu,et al.  A neural network ensemble model for on-line monitoring of process mean and variance shifts in correlated processes , 2010, Expert Syst. Appl..

[49]  Way Kuo,et al.  Identification of control chart patterns using wavelet filtering and robust fuzzy clustering , 2007, J. Intell. Manuf..

[50]  H. B. Hwarng.  Multilayer perceptions for detecting cyclic data on control charts , 1995 .

[51]  Anil Mital,et al.  Quality control expert systems: a review of pertinent literature , 1993, J. Intell. Manuf..

[52]  William H. Woodall,et al.  Performance of the Control Chart Trend Rule under Linear Shift , 1988 .

[53]  Tai-Yue Wang,et al.  Mean shifts detection and classification in multivariate process: a neural-fuzzy approach , 2002, J. Intell. Manuf..

[54]  H. Brian Hwarng.  Proper and effective training of a pattern recognizer for cyclic data , 1995 .

[55]  Tawfik T. El-Midany,et al.  A proposed framework for control chart pattern recognition in multivariate process using artificial neural networks , 2010, Expert Syst. Appl..

[56]  Yousef Al-Assaf,et al.  Recognition of control chart patterns using multi-resolution wavelets analysis and neural networks , 2004, Comput. Ind. Eng..

[57]  Marion R. Reynolds,et al.  Control Charts for Monitoring the Mean and Variance of Autocorrelated Processes , 1999 .

[58]  Duc Truong Pham,et al.  Feature-based control chart pattern recognition , 1997 .

[59]  H. B. Hwarng.  Simultaneous identification of mean shift and correlation change in AR(1) processes , 2005 .

[60]  J.D.T. Tannock,et al.  Recognition of control chart concurrent patterns using a neural network approach , 1999 .

[61]  Yuehjen E. Shao,et al.  Recognizing Mixture Control Chart Patterns with Independent Component Analysis and Support Vector Machine , 2010, ISNN.

[62]  Shankar Chakraborty,et al.  Recognition of control chart patterns using improved selection of features , 2009, Comput. Ind. Eng..

[63]  Hairong Qi,et al.  An integrated approach for process monitoring using wavelet analysis and competitive neural network , 2007 .

[64]  Wei Jiang,et al.  A Weighted CUSUM Chart for Detecting Patterned Mean Shifts , 2008 .

[65]  Ruey-Shan Guo,et al.  Decision tree based control chart pattern recognition , 2008 .

[66]  H. Brian Hwarng,et al.  Boltzmann machines that learn to recognize patterns on control charts , 1992 .

[67]  H. Brian Hwarng.  Detecting process mean shift in the presence of autocorrelation: a neural-network based monitoring scheme , 2004 .

[68]  Huan‐Neng Chiu,et al.  The economic design of x‐ control charts under a preventive maintenance policy , 1996 .

[69]  Tai-Yue Wang,et al.  Artificial neural networks to classify mean shifts from multivariate χ2 chart signals , 2004, Comput. Ind. Eng..

[70]  Ruey-Shiang Guh,et al.  On‐line Identification and Quantification of Mean Shifts in Bivariate Processes using a Neural Network‐based Approach , 2007, Qual. Reliab. Eng. Int..

[71]  Duc Truong Pham,et al.  Unsupervised adaptive resonance theory neural networks for control chart pattern recognition , 2001 .

[72]  Jill A. Swift,et al.  Out-of-control pattern recognition and analysis for quality control charts using LISP-based systems , 1995 .

[73]  Huang En-zhou.  Control chart patterns recognition based on support vector machine , 2007 .

[74]  Massimo Pacella,et al.  Understanding ART-based neural algorithms as statistical tools for manufacturing process quality control , 2005, Eng. Appl. Artif. Intell..

[75]  Duc Truong Pham,et al.  Efficient control chart pattern recognition through synergistic and distributed artificial neural networks , 1999 .

[76]  Chuen-Sheng Cheng,et al.  Control Chart Pattern Recognition Using Wavelet Analysis and Neural Networks , 2009 .

[77]  Shankar Chakraborty,et al.  A study on the various features for effective control chart pattern recognition , 2007 .

[78]  Yu Wang,et al.  Shift detection and source identification in multivariate autocorrelated processes , 2010 .

[79]  A. Ebrahimzadeh,et al.  Control chart pattern recognition using an optimized neural network and efficient features. , 2010, ISA transactions.

[80]  Herbert Moskowitz,et al.  Run-Length Distributions of Special-Cause Control Charts for Correlated Processes , 1994 .

[81]  J. D. T. Tannock,et al.  On-line control chart pattern detection and discrimination - a neural network approach , 1999, Artif. Intell. Eng..

[82]  Jianjun Shi,et al.  The GLRT for statistical process control of autocorrelated processes , 1999 .

[83]  G. A. Pugh.  Synthetic neural networks for process control , 1989 .

[84]  Seyed Taghi Akhavan Niaki,et al.  Fault Diagnosis in Multivariate Control Charts Using Artificial Neural Networks , 2005 .

[85]  Chuen-Sheng Cheng,et al.  A pattern recognition algorithm for an x¯ control chart , 1996 .

[86]  F. Zorriassatine,et al.  Novelty detection for practical pattern recognition in condition monitoring of multivariate processes: a case study , 2005 .

[87]  D. C. Reddy,et al.  Identification and interpretation of manufacturing process patterns through neural networks , 1998 .

[88]  Miin-Shen Yang,et al.  A fuzzy-soft learning vector quantization for control chart pattern recognition , 2002 .

[89]  Ismael Lopez-Juarez,et al.  SPC without Control Limits and Normality Assumption: A New Method , 2009, CIARP.

[90]  Jianjun Shi,et al.  Automatic feature extraction of waveform signals for in-process diagnostic performance improvement , 2001, J. Intell. Manuf..

[91]  Jay B. Jordan,et al.  Automated process monitoring using statistical pattern recognition techniques on X‐bar control charts , 1996 .

[92]  Chuen-Sheng Cheng,et al.  Using neural networks to detect the bivariate process variance shifts pattern , 2011, Comput. Ind. Eng..

[93]  David West,et al.  Control of complex manufacturing processes: a comparison of SPC methods with a radial basis function neural network , 1999 .

[94]  Amjed M. Al-Ghanim,et al.  Automated unnatural pattern recognition on control charts using correlation analysis techniques , 1997 .

[95]  Mehmet Erler,et al.  Control Chart Pattern Recognition Using Artificial Neural Networks , 2000 .

[96]  Duc Truong Pham,et al.  Control chart pattern recognition using a new type of self-organizing neural network , 1998 .

[97]  Shankar Chakraborty,et al.  Real time statistical process advisor for effective quality control , 2006, Decis. Support Syst..

[98]  Ashraf S. Youssef,et al.  Automated Identification of Basic Control Charts Patterns Using Neural Networks , 2010, J. Softw. Eng. Appl..

[99]  Rassoul Noorossana,et al.  Using Neural Networks to Detect and Classify Out‐of‐control Signals in Autocorrelated Processes , 2003 .

[100]  Yan-Kwang Chen,et al.  Grey relation pattern recogniser for X-bar control charts , 2000, Int. J. Manuf. Technol. Manag..

[101]  Shaoxiong Wu.  Abnormal Pattern Parameters Estimation of Control Chart Based on Wavelet Transform and Probabilistic Neural Network , 2006 .

[102]  W. Shewhart.  The Economic Control of Quality of Manufactured Product. , 1932 .

[103]  Zhang Wu.  Diagnosis of assignable cause in statistical process control , 1996 .

[104]  Deborah F. Cook,et al.  Utilization of neural networks for the recognition of variance shifts in correlated manufacturing process parameters , 2001 .

[105]  Ibrahim Masood,et al.  Issues in development of artificial neural network-based control chart pattern recognition schemes , 2010 .

[106]  Ercan Oztemel,et al.  Control chart pattern recognition using neural networks , 1992 .

[107]  Chih-Ming Hsu,et al.  Analysis of variations in a multi-variate process using neural networks , 2003 .

[108]  Domenico Cantone,et al.  Pattern Matching for Control Chart Monitoring , 2008 .

[109]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[110]  Lifeng Xi,et al.  A neural network ensemble-based model for on-line monitoring and diagnosis of out-of-control signals in multivariate manufacturing processes , 2009, Expert Syst. Appl..

[111]  Mahmoud A. Barghash,et al.  Pattern recognition of control charts using artificial neural networks—analyzing the effect of the training parameters , 2004, J. Intell. Manuf..

[112]  Ruey-Shiang Guh,et al.  A hybrid learning-based model for on-line detection and analysis of control chart patterns , 2005, Comput. Ind. Eng..

[113]  G. B. Wetherill,et al.  Quality Control and Industrial Statistics , 1975 .

[114]  Layth C. Alwan,et al.  The Problem of Misplaced Control Limits , 1995 .

[115]  Marcus B. Perry,et al.  Control chart pattern recognition using back propagation artificial neural networks , 2001 .

[116]  Khaled Assaleh,et al.  Features extraction and analysis for classifying causable patterns in control charts , 2005, Comput. Ind. Eng..

[117]  Chuen-Sheng Cheng.  A multi-layer neural network model for detecting changes in the process mean , 1995 .

[118]  Indra Kiran.  Effective Control Chart Pattern Recognition Using Artificial Neural Networks , 2010 .

[119]  Ruey-Shiang Guh,et al.  An effective application of decision tree learning for on-line detection of mean shifts in multivariate control charts , 2008, Comput. Ind. Eng..

[120]  A. S. Anagun.  A neural network applied to pattern recognition in statistical process control , 1998 .

[121]  C.-S. Cheng.  Group technology and expert systems concepts applied to statistical process control in small-batch manufacturing , 1989 .

[122]  Duc Truong Pham,et al.  An Integrated Neural Network and Expert System Tool for Statistical Process Control , 1995 .

[123]  D. M. Titterington,et al.  Neural Networks: A Review from a Statistical Perspective , 1994 .

[124]  Chuen-Sheng Cheng,et al.  A neural network-based procedure for the monitoring of exponential mean , 2001 .

[125]  Jamal Arkat,et al.  Artificial neural networks in applying MCUSUM residuals charts for AR(1) processes , 2007, Appl. Math. Comput..

[126]  Chih-Chou Chiu,et al.  Using radial basis function neural networks to recognize shifts in correlated manufacturing process parameters , 1998 .

[127]  Shankar Chakraborty,et al.  Feature-based recognition of control chart patterns , 2006, Comput. Ind. Eng..

[128]  Kai Yang,et al.  Application of artificial neural network to identify non-random variation patterns on the run chart in automotive assembly process , 2003 .

[129]  Zhi Qiang Cheng,et al.  Source(s) Identification of Variance Shifts in Bivariate Process Using LS-SVM Based Pattern Recognition Model , 2010 .

[130]  Shankar Chakraborty,et al.  Improved recognition of control chart patterns using artificial neural networks , 2008 .

[131]  Yeou-Ren Shiue,et al.  On-line identification of control chart patterns using self-organizing approaches , 2005 .

[132]  Adnan Hassan,et al.  Improved SPC chart pattern recognition using statistical features , 2003 .

[133]  S. Tamer Cavusgil,et al.  A classification and assessment of research streams in International Marketing , 1995 .

[134]  Mohammad Hossein Fazel Zarandi,et al.  A hybrid fuzzy adaptive sampling - Run rules for Shewhart control charts , 2008, Inf. Sci..

[135]  Ker-Ming Lee,et al.  Shifts recognition in correlated process data using a neural network , 2001 .

[136]  Yousef Al-Assaf,et al.  Multi-Resolution Wavelets Analysis Approach for the Recognition of Concurrent Control Chart Patterns , 2004 .

[137]  Duc Truong Pham,et al.  XPC: an on-line expert system for statistical process control , 1992 .

[138]  Ruey-Shiang Guh,et al.  Simultaneous process mean and variance monitoring using artificial neural networks , 2010, Comput. Ind. Eng..

[139]  Way Kuo,et al.  A hybrid approach for identification of concurrent control chart patterns , 2009, J. Intell. Manuf..

[140]  Lloyd S. Nelson,et al.  Interpreting Shewhart X̄ Control Charts , 1985 .

[141]  Seoung Bum Kim,et al.  Data mining model-based control charts for multivariate and autocorrelated processes , 2012, Expert Syst. Appl..

[142]  N F Hubele,et al.  X¯ CONTROL CHART PATTERN IDENTIFICATION THROUGH EFFICIENT OFF-LINE NEURAL NETWORK TRAINING , 1993 .

[143]  A. Ebrahimzadeh,et al.  Application of the PSO-SVM model for recognition of control chart patterns. , 2010, ISA transactions.

[144]  Layth C. Alwan,et al.  Time-Series Modeling for Statistical Process Control , 1988 .

[145]  Alice E. Smith,et al.  X-bar and R control chart interpretation using neural computing , 1994 .

[146]  H. B. Hwarng,et al.  Toward identifying the source of mean shifts in multivariate SPC: a neural network approach , 2008 .

[147]  Norma Faris Hubele,et al.  Enhancement and evaluation of pattern recognition in control charts , 2001 .

[148]  Yi-Chih Hsieh,et al.  A neural network based model for abnormal pattern recognition of control charts , 1999 .

[149]  Duc Truong Pham,et al.  Control chart pattern recognition using learning vector quantization networks , 1994 .

[150]  Massimo Pacella,et al.  Manufacturing quality control by means of a Fuzzy ART network trained on natural process data , 2004, Eng. Appl. Artif. Intell..

[151]  J. D. T. Tannock,et al.  A review of neural networks for statistical process control , 1998, J. Intell. Manuf..

[152]  H. B. Hwarng,et al.  Detecting process non-randomness through a fast and cumulative learning ART-based pattern recognizer , 1995 .

[153]  Pingyu Jiang,et al.  Recognizing control chart patterns with neural network and numerical fitting , 2009, J. Intell. Manuf..

[154]  James R. Evans,et al.  A framework for expert system development in statistical quality control , 1988 .

[155]  Ruey-Shiang Guh,et al.  Integrating artificial intelligence into on‐line statistical process control , 2003 .

[156]  T. L. Lucy-Bouler.  Problems in Control Chart Pattern Recognition Systems , 1993 .

[157]  Ercan Öztemel.  Integrating expert systems and neural networks for on-line statistical process control , 1992 .

[158]  G. Runger,et al.  Multivariate control charts for process dispersion , 2004 .