A neural network ensemble-based model for on-line monitoring and diagnosis of out-of-control signals in multivariate manufacturing processes

In multivariate statistical process control, most multivariate quality control charts are shown to be effective in detecting out-of-control signals based upon an overall statistics. But these charts do not relieve the need for pinpointing source(s) of the out-of-control signals, which would be very useful for quality practitioners to locate the assignable causes that give rise to the out-of-control situation. In this study, a learning-based model has been investigated for monitoring and diagnosing out-of-control signals in a bivariate process. In this model, a selective neural network (NN) ensemble approach (DPSOEN, Discrete Particle Swarm Optimization) was developed for performing these tasks. The simulation results demonstrate that the proposed model outperforms the conventional multivariate control scheme in terms of average run length (ARL), and can accurately classify source(s) of out-of-control signals. Extensive experiment is also carried out to examine the effects of six statistical features on the performance of DPSOEN. Analysis from this study provides guidelines in developing NN ensemble-based Statistical process control recognition systems in multivariate processes.

[1]  Tai-Yue Wang,et al.  Mean shifts detection and classification in multivariate process: a neural-fuzzy approach , 2002, J. Intell. Manuf..

[2]  F. Zorriassatine,et al.  Using novelty detection to identify abnormalities caused by mean shifts in bivariate processes , 2003 .

[3]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[4]  H. Brian Hwarng Detecting process mean shift in the presence of autocorrelation: a neural-network based monitoring scheme , 2004 .

[5]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  H. B. Hwarng,et al.  Detecting process non-randomness through a fast and cumulative learning ART-based pattern recognizer , 1995 .

[7]  Karen A. F. Copeland Design and Analysis of Experiments, 5th Ed. , 2001 .

[8]  Hairong Qi,et al.  An integrated approach for process monitoring using wavelet analysis and competitive neural network , 2007 .

[9]  Tai-Yue Wang,et al.  Artificial neural networks to classify mean shifts from multivariate χ2 chart signals , 2004, Comput. Ind. Eng..

[10]  Ruey-Shiang Guh,et al.  On‐line Identification and Quantification of Mean Shifts in Bivariate Processes using a Neural Network‐based Approach , 2007, Qual. Reliab. Eng. Int..

[11]  W. A. Wallis,et al.  Techniques of Statistical Analysis. , 1950 .

[12]  Mahmoud A. Barghash,et al.  Pattern recognition of control charts using artificial neural networks—analyzing the effect of the training parameters , 2004, J. Intell. Manuf..

[13]  Ruey-Shiang Guh,et al.  A hybrid learning-based model for on-line detection and analysis of control chart patterns , 2005, Comput. Ind. Eng..

[14]  Alice E. Smith,et al.  X-bar and R control chart interpretation using neural computing , 1994 .

[15]  R. Crosier Multivariate generalizations of cumulative sum quality-control schemes , 1988 .

[16]  Adnan Hassan,et al.  Improved SPC chart pattern recognition using statistical features , 2003 .

[17]  Chuen-Sheng Cheng,et al.  A NEURAL NETWORK APPROACH FOR THE ANALYSIS OF CONTROL CHART PATTERNS , 1997 .

[18]  H. Hotelling,et al.  Multivariate Quality Control , 1947 .

[19]  W. Woodall,et al.  Multivariate CUSUM Quality- Control Procedures , 1985 .

[20]  Stelios Psarakis,et al.  Multivariate statistical process control charts: an overview , 2007, Qual. Reliab. Eng. Int..

[21]  Chuen-Sheng Cheng A multi-layer neural network model for detecting changes in the process mean , 1995 .

[22]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[23]  Ercan Oztemel,et al.  Control chart pattern recognition using neural networks , 1992 .

[24]  Chih-Ming Hsu,et al.  Analysis of variations in a multi-variate process using neural networks , 2003 .

[25]  J. E. Jackson Multivariate quality control , 1985 .

[26]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[27]  George C. Runger,et al.  Comparison of multivariate CUSUM charts , 1990 .

[28]  Nola D. Tracy,et al.  Decomposition of T2 for Multivariate Control Chart Interpretation , 1995 .

[29]  Frank B. Alt Multivariate Quality Control , 1984 .

[30]  Chih-Chou Chiu,et al.  Using radial basis function neural networks to recognize shifts in correlated manufacturing process parameters , 1998 .

[31]  George C. Runger,et al.  Designing a Multivariate EWMA Control Chart , 1997 .

[32]  H. Hotelling Multivariate Quality Control-illustrated by the air testing of sample bombsights , 1947 .

[33]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[34]  Shing I. Chang,et al.  An integrated neural network approach for simultaneous monitoring of process mean and variance shifts a comparative study , 1999 .

[35]  Duc Truong Pham,et al.  Control chart pattern recognition using learning vector quantization networks , 1994 .

[36]  J. D. T. Tannock,et al.  A review of neural networks for statistical process control , 1998, J. Intell. Manuf..

[37]  Shing I. Chang,et al.  A neural fuzzy control chart for detecting and classifying process mean shifts , 1996 .

[38]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[39]  G. A. Pugh Synthetic neural networks for process control , 1989 .

[40]  Seyed Taghi Akhavan Niaki,et al.  Fault Diagnosis in Multivariate Control Charts Using Artificial Neural Networks , 2005 .

[41]  Deborah F. Cook,et al.  Utilization of neural networks for the recognition of variance shifts in correlated manufacturing process parameters , 2001 .

[42]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[43]  Xin Yao,et al.  Evolutionary ensembles with negative correlation learning , 2000, IEEE Trans. Evol. Comput..