Multivariate process monitoring and fault identification using multiple decision tree classifiers

Machine learning based algorithms, such as a decision tree (DT) classifier, have been applied to automated process monitoring and fault identification in manufacturing processes, however the current DT-based process control models employ a single DT classifier for both mean shift detection and fault identification. As many manufacturing processes use automated data collection for multiple process parameters, a DT classifier would have to handle a large number of classes. Previous research shows that a large number of classes can degrade the accuracy of a DT multiclass classifier. In this study we propose a new process monitoring model using multiple DT classifiers with each handling a small number of classes. Moreover, we not only detect mean shifts but also identify process variability levels that may cause out-of-control signals. Experimental results show that our proposed model achieves satisfactory performance in process monitoring and fault identification with various parameter settings. It achieves better ARL performance compared with the baseline method based on a single DT classifier.

[1]  Xiaojun Zhou,et al.  Intelligent monitoring and diagnosis of manufacturing processes using an integrated approach of KBANN and GA , 2008, Comput. Ind..

[2]  H. Hotelling,et al.  Multivariate Quality Control , 1947 .

[3]  George C. Runger,et al.  Multivariate Extensions to Cumulative Sum Control Charts , 2004 .

[4]  Andrew M. Kuhn Multivariate Statistical Methods in Quality Management , 2005, Technometrics.

[5]  Ruey-Shiang Guh,et al.  On‐line Identification and Quantification of Mean Shifts in Bivariate Processes using a Neural Network‐based Approach , 2007, Qual. Reliab. Eng. Int..

[6]  Lifeng Xi,et al.  A neural network ensemble-based model for on-line monitoring and diagnosis of out-of-control signals in multivariate manufacturing processes , 2009, Expert Syst. Appl..

[7]  John C. Young,et al.  A Practical Approach for Interpreting Multivariate T2 Control Chart Signals , 1997 .

[8]  Ruey-Shiang Guh,et al.  A hybrid learning-based model for on-line detection and analysis of control chart patterns , 2005, Comput. Ind. Eng..

[9]  Douglas M. Hawkins,et al.  A General Multivariate Exponentially Weighted Moving-Average Control Chart , 2007 .

[10]  Fugee Tsung,et al.  Directional MEWMA Schemes for Multistage Process Monitoring and Diagnosis , 2008 .

[11]  R. Crosier Multivariate generalizations of cumulative sum quality-control schemes , 1988 .

[12]  J. Ross Quinlan,et al.  Simplifying decision trees , 1987, Int. J. Hum. Comput. Stud..

[13]  George C. Runger,et al.  Designing a Multivariate EWMA Control Chart , 1997 .

[14]  Brad Warner,et al.  Understanding Neural Networks as Statistical Tools , 1996 .

[15]  Nicholas J. Higham,et al.  INVERSE PROBLEMS NEWSLETTER , 1991 .

[16]  Robert L. Mason,et al.  Step-Down Analysis for Changes in the Covariance Matrix and Other Parameters , 2007 .

[17]  Charles W. Champ,et al.  A multivariate exponentially weighted moving average control chart , 1992 .

[18]  J. Macgregor,et al.  Monitoring batch processes using multiway principal component analysis , 1994 .

[19]  J. Ross Quinlan,et al.  Improved Use of Continuous Attributes in C4.5 , 1996, J. Artif. Intell. Res..

[20]  Yoav Benjamini,et al.  Multivariate Profile Charts for Statistical Process Control , 1994 .

[21]  W. Woodall,et al.  Multivariate CUSUM Quality- Control Procedures , 1985 .

[22]  Maman A. Djauhari,et al.  Improved Monitoring of Multivariate Process Variability , 2005 .

[23]  Shiyu Zhou,et al.  Data‐driven variation source identification for manufacturing process using the eigenspace comparison method , 2006 .

[24]  ChangKyoo Yoo,et al.  Fault detection of batch processes using multiway kernel principal component analysis , 2004, Comput. Chem. Eng..

[25]  Marion R. Reynolds,et al.  Multivariate Monitoring of the Process Mean Vector with Sequential Sampling , 2005 .

[26]  J. Edward Jackson,et al.  A User's Guide to Principal Components: Jackson/User's Guide to Principal Components , 2004 .

[27]  Li Lin,et al.  Intelligent remote monitoring and diagnosis of manufacturing processes using an integrated approach of neural networks and rough sets , 2003, J. Intell. Manuf..

[28]  Stelios Psarakis,et al.  Multivariate statistical process control charts: an overview , 2007, Qual. Reliab. Eng. Int..

[29]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[30]  Seyed Taghi Akhavan Niaki,et al.  Fault Diagnosis in Multivariate Control Charts Using Artificial Neural Networks , 2005 .

[31]  Ruey-Shiang Guh,et al.  An effective application of decision tree learning for on-line detection of mean shifts in multivariate control charts , 2008, Comput. Ind. Eng..

[32]  Tao Li,et al.  A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression , 2004, Bioinform..

[33]  J. D. T. Tannock,et al.  A review of neural networks for statistical process control , 1998, J. Intell. Manuf..

[34]  Fred Spiring,et al.  Introduction to Statistical Quality Control , 2007, Technometrics.

[35]  George C. Runger,et al.  Comparison of multivariate CUSUM charts , 1990 .

[36]  Nola D. Tracy,et al.  Decomposition of T2 for Multivariate Control Chart Interpretation , 1995 .

[37]  J. E. Jackson A User's Guide to Principal Components , 1991 .

[38]  Yeou-Ren Shiue,et al.  On-line identification of control chart patterns using self-organizing approaches , 2005 .

[39]  H. Kramer,et al.  Ewma charts for multivariate time series , 1997 .