A Comparison of Different Classification Techniques to Determine the Change Causes in Hotelling's T2 Control Chart

To detect out-of control situations using multivariate control charts is relatively easy. However, the determination of the change causes is more difficult. In the last years the application of classification techniques to analyze the out-of-control signals has been proposed. These proposals include increasingly sophisticated methods but it is not clear, if there is one, which is the most powerful. In this paper we have simulated different scenarios varying the correlation structure and shift type, to test the performance of Linear Discriminant Analysis, Classification Trees, Neural Networks and Boosting Trees with the main aim to analyze whether or not using more complex classification methods is worthy. Results show that although the performance of different methods depends on the correlation structure and the class of change, under the more feasible situations Boosting shows the best performance. Copyright © 2015 John Wiley & Sons, Ltd.

[1]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[2]  Ruey-Shiang Guh,et al.  Integrating artificial intelligence into on‐line statistical process control , 2003 .

[3]  Alberto Ferrer,et al.  A Comparative Study of Different Methodologies for Fault Diagnosis in Multivariate Quality Control , 2014, Commun. Stat. Simul. Comput..

[4]  D. Montgomery,et al.  Contributors to a multivariate statistical process control chart signal , 1996 .

[5]  Chih-Chou Chiu,et al.  Using radial basis function neural networks to recognize shifts in correlated manufacturing process parameters , 1998 .

[6]  Francisco Aparisi,et al.  Techniques to interpret T 2 control chart signals , 2006 .

[7]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[8]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[9]  J.D.T. Tannock,et al.  Recognition of control chart concurrent patterns using a neural network approach , 1999 .

[10]  Gary K Grunwald,et al.  GLIMMPSE: Online Power Computation for Linear Models with and without a Baseline Covariate. , 2013, Journal of statistical software.

[11]  Lawrence O. Hall,et al.  A Comparison of Decision Tree Ensemble Creation Techniques , 2007 .

[12]  Fah Fatt Gan,et al.  A CUMULATIVE SUM CONTROL CHART FOR MONITORING PROCESS VARIANCE , 1995 .

[13]  Matías Gámez,et al.  adabag: An R Package for Classification with Boosting and Bagging , 2013 .

[14]  Robert E. Schapire,et al.  A theory of multiclass boosting , 2010, J. Mach. Learn. Res..

[15]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[16]  J. Friedman.  Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[17]  W. T. Tucker,et al.  Identification of out of control quality characteristics in a multivariate manufacturing environment , 1991 .

[18]  Min Zhang,et al.  Multivariate process monitoring and fault identification using multiple decision tree classifiers , 2013 .

[19]  Yi-Chih Hsieh,et al.  A neural network based model for abnormal pattern recognition of control charts , 1999 .

[20]  Seyed Taghi Akhavan Niaki,et al.  Fault Diagnosis in Multivariate Control Charts Using Artificial Neural Networks , 2005 .

[21]  Rassoul Noorossana,et al.  Effect of Autocorrelation on Performance of the MCUSUM Control Chart , 2006, Qual. Reliab. Eng. Int..

[22]  Esteban Alfaro,et al.  A boosting approach for understanding out-of-control signals in multivariate control charts , 2009 .

[23]  Shing I. Chang,et al.  A neural fuzzy control chart for detecting and classifying process mean shifts , 1996 .

[24]  Zhen He,et al.  Online monitoring and fault identification of mean shifts in bivariate processes using decision tree learning techniques , 2013, J. Intell. Manuf..

[25]  Marina Vives-Mestres,et al.  Out-of-Control Signals in Three-Part Compositional T2 Control Chart , 2014, Qual. Reliab. Eng. Int..

[26]  Xiaojun Zhou,et al.  Intelligent monitoring and diagnosis of manufacturing processes using an integrated approach of KBANN and GA , 2008, Comput. Ind..

[27]  Deborah F. Cook,et al.  Utilization of neural networks for the recognition of variance shifts in correlated manufacturing process parameters , 2001 .

[28]  John C. Young,et al.  A Practical Approach for Interpreting Multivariate T2 Control Chart Signals , 1997 .

[29]  Josep Antoni Martín Fernández,et al.  Out-of-control signals in three-part compositional T2 control chart , 2014 .

[30]  J. D. T. Tannock,et al.  A review of neural networks for statistical process control , 1998, J. Intell. Manuf..

[31]  Ruey-Shiang Guh,et al.  On‐line Identification and Quantification of Mean Shifts in Bivariate Processes using a Neural Network‐based Approach , 2007, Qual. Reliab. Eng. Int..

[32]  Lifeng Xi,et al.  A neural network ensemble-based model for on-line monitoring and diagnosis of out-of-control signals in multivariate manufacturing processes , 2009, Expert Syst. Appl..

[33]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[34]  Nola D. Tracy,et al.  Decomposition of T2 for Multivariate Control Chart Interpretation , 1995 .

[35]  Trevor Hastie,et al.  Multi-class AdaBoost ∗ , 2009 .

[36]  Nandini Das,et al.  Interpreting the out-of-control signal in multivariate control chart — a comparative study , 2008 .

[37]  Chuen-Sheng Cheng.  A multi-layer neural network model for detecting changes in the process mean , 1995 .