Simultaneous monitoring of mean vector and covariance matrix shifts in bivariate manufacturing processes using hybrid ensemble learning-based model

Many manufacturing processes are multivariate in nature because the quality of a given product is determined by several interrelated quality characteristics. Recently, various machine learning techniques (e.g., artificial neural network, support vector machine, support vector regression or decision tree) have been used as an effective tool to monitor process mean vector and covariance matrix shifts. However, most of these machine learning techniques-based approaches for process mean vector and covariance matrix have been developed separately in literature with the other parameter assumed to be under control. Little attention has been given to simultaneous monitoring of process mean vector and covariance matrix shifts. In addition, these approaches cannot provide more detailed shift information, for example the shift magnitude, which would be greatly useful for quality practitioners to search the assignable causes that give rise to the out-of-control situation. This study presents a hybrid ensemble learning-based model for simultaneous monitoring of process mean vector and covariance matrix shifts. The numerical results indicate that the proposed model can effectively detect and recognize not only mean vector or covariance matrix shifts but also mixed situations where mean vector and covariance matrix shifts exist concurrently. Meanwhile, the magnitude of the shift of each of the shifted quality characteristics can be accurately quantified. Empirical comparisons also show that the proposed model performs better than other existing approaches in detecting mean vector and covariance matrix shifts, while also providing the capability of recognition of shift types and quantification of shift magnitudes. A demonstrative example is provided.

[1]  N F Hubele,et al.  X¯ CONTROL CHART PATTERN IDENTIFICATION THROUGH EFFICIENT OFF-LINE NEURAL NETWORK TRAINING , 1993 .

[2]  Pingyu Jiang,et al.  Recognizing control chart patterns with neural network and numerical fitting , 2009, J. Intell. Manuf..

[3]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5]  Tai-Yue Wang,et al.  Mean shifts detection and classification in multivariate process: a neural-fuzzy approach , 2002, J. Intell. Manuf..

[6]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[7]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[8]  Ikuo Arizono,et al.  A study of multivariate (X̄, S) simultaneous control chart based on Kullback-Leibler information , 2004 .

[9]  Tai-Yue Wang,et al.  Artificial neural networks to classify mean shifts from multivariate χ2 chart signals , 2004, Comput. Ind. Eng..

[10]  Ruey-Shiang Guh,et al.  On‐line Identification and Quantification of Mean Shifts in Bivariate Processes using a Neural Network‐based Approach , 2007, Qual. Reliab. Eng. Int..

[11]  Mahmoud A. Barghash,et al.  Pattern recognition of control charts using artificial neural networks—analyzing the effect of the training parameters , 2004, J. Intell. Manuf..

[12]  Chuen-Sheng Cheng,et al.  Using neural networks to detect the bivariate process variance shifts pattern , 2011, Comput. Ind. Eng..

[13]  Frank Dieterle,et al.  Urinary nucleosides as potential tumor markers evaluated by learning vector quantization , 2003, Artif. Intell. Medicine.

[14]  Chih-Ming Hsu,et al.  Analysis of variations in a multi-variate process using neural networks , 2003 .

[15]  Wei Zhou,et al.  Autoregressive coefficient-invariant control chart pattern recognition in autocorrelated manufacturing processes using neural network ensemble , 2013, Journal of Intelligent Manufacturing.

[16]  Guido Smits,et al.  Improved SVM regression using mixtures of kernels , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[17]  Shing I. Chang,et al.  An integrated neural network approach for simultaneous monitoring of process mean and variance shifts a comparative study , 1999 .

[18]  Wen-An Yang Monitoring and diagnosing of mean shifts in multivariate manufacturing processes using two-level selective ensemble of learning vector quantization neural networks , 2015, J. Intell. Manuf..

[19]  Pei-Wen Chen,et al.  Estimating the shift size in the process mean with support vector regression and neural networks , 2011, Expert Syst. Appl..

[20]  Zhen He,et al.  Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques , 2013, J. Intell. Manuf..

[21]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[22]  Chung-Ho Chen,et al.  Economic-Statistical Design of Multivariate Control Charts Using Quality Loss Function , 2002 .

[23]  金超,et al.  Online monitoring and fault diagnosing system for crane , 2012 .

[24]  Michael B. C. Khoo,et al.  A New Bivariate Control Chart to Monitor the Multivariate Process Mean and Variance Simultaneously , 2004 .

[25]  J. D. T. Tannock,et al.  A neural network approach to characterize pattern parameters in process control charts , 1999, J. Intell. Manuf..

[26]  Chuen-Sheng Cheng,et al.  A NEURAL NETWORK APPROACH FOR THE ANALYSIS OF CONTROL CHART PATTERNS , 1997 .

[27]  Xing Li,et al.  Evolving support vector machine parameters , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[28]  Mohamed Limam,et al.  Support vector regression based residual MCUSUM control chart for autocorrelated process , 2008, Appl. Math. Comput..

[29]  Robert M. Farber,et al.  How Neural Nets Work , 1987, NIPS.

[30]  Robert E. Schapire,et al.  The strength of weak learnability , 1990, Mach. Learn..

[31]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[32]  Ruey-Shiang Guh,et al.  An effective application of decision tree learning for on-line detection of mean shifts in multivariate control charts , 2008, Comput. Ind. Eng..

[33]  Saeid Nahavandi,et al.  Identification of concurrent control chart patterns with singular spectrum analysis and learning vector quantization , 2012, Journal of Intelligent Manufacturing.

[34]  Marcela A. G. Machado,et al.  Control charts for monitoring the mean vector and the covariance matrix of bivariate processes , 2009 .

[35]  Smiley W. Cheng,et al.  A New Multivariate Control Chart for Monitoring Both Location and Dispersion , 2005 .

[36]  Jun Lv,et al.  On-line classifying process mean shifts in multivariate control charts based on multiclass support vector machines , 2012 .

[37]  Antonio Fernando Branco Costa,et al.  Monitoring the mean vector and the covariance ­matrix of multivariate processes with sample means and sample ranges , 2011 .

[38]  Thomas P. Ryan,et al.  Statistical methods for quality improvement , 1989 .

[39]  Norma Faris Hubele,et al.  Back-propagation pattern recognizers for X¯ control charts: methodology and performance , 1993 .

[40]  Mojtaba Salehi,et al.  On line detection of mean and variance shift using neural networks and support vector machine in multivariate processes , 2012, Appl. Soft Comput..

[41]  Thomas P. Ryan,et al.  Statistical Methods for Quality Improvement: Ryan/Quality Improvement 3E , 2011 .

[42]  Statistical Methods for Quality Improvement, 2nd Ed. , 2000 .

[43]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[44]  Shing I. Chang,et al.  Multivariate EWMA control charts using individual observations for process mean and variance monitoring and diagnosis , 2008 .

[45]  Chuen-Sheng Cheng,et al.  Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines , 2008, Expert Syst. Appl..

[46]  Stelios Psarakis,et al.  Multivariate statistical process control charts: an overview , 2007, Qual. Reliab. Eng. Int..

[47]  Riccardo Poli,et al.  Particle Swarm Optimisation , 2011 .