Hybrid Artificial Neural Networks Modeling for Faults Identification of a Stochastic Multivariate Process

Due to the recent rapid growth of advanced sensing and production technologies, the monitoring and diagnosis of multivariate process operating performance have drawn increasing interest in process industries. The multivariate statistical process control (MSPC) chart is one of the most commonly used tools for detecting process faults. However, an out-of-control MSPC signal only indicates that process faults have intruded the underlying process. Identifying which of the monitored quality variables is responsible for the MSPC signal is fairly difficult. Pinpointing the responsible variable is vital for process improvement because it effectively determines the root causes of the process faults. Accordingly, this identification has become an important research issue concerning recent multivariate process applications. In contrast with the traditional single classifier approach, the present study proposes hybrid modeling schemes to address problems that involve a large number of quality variables in a multivariate normal process. The proposed scheme includes multivariate adaptive regression splines (MARS), logistic regression (LR), and artificial neural network (ANN). By applying MARS and LR techniques, we may obtain fewer but more significant quality variables, which can serve as inputs to the ANN classifier. The performance of our proposed approaches was evaluated by conducting a series of experiments.

[1]  D. Montgomery,et al.  Contributors to a multivariate statistical process control chart signal , 1996 .

[2]  Nola D. Tracy,et al.  Decomposition of T2 for Multivariate Control Chart Interpretation , 1995 .

[3]  Hamid Reza Karimi,et al.  Data-driven adaptive observer for fault diagnosis , 2012 .

[4]  S. Bersimis,et al.  IDENTIFYING THE OUT OF CONTROL VARIABLE IN A MULTIVARIATE CONTROL CHART , 2002 .

[5]  Yuming Zhou,et al.  Predicting object-oriented software maintainability using multivariate adaptive regression splines , 2007, J. Syst. Softw..

[6]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[7]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.

[8]  Yoav Benjamini,et al.  Multivariate Profile Charts for Statistical Process Control , 1994 .

[9]  Francisco Aparisi,et al.  Techniques to interpret T 2 control chart signals , 2006 .

[10]  Tai-Yue Wang,et al.  Artificial neural networks to classify mean shifts from multivariate χ2 chart signals , 2004, Comput. Ind. Eng..

[11]  Ali A. Houshmand,et al.  SIMULTANEOUS REPRESENTATION OF MULTIVARIATE AND CORRESPONDING UNIVARIATE X¯ CHARTS USING LINE-GRAPH , 1995 .

[12]  Yuehjen E. Shao,et al.  Prediction of Currency Volume Issued in Taiwan Using a Hybrid Artificial Neural Network and Multiple Regression Approach , 2013 .

[13]  J. Freidman,et al.  Multivariate adaptive regression splines , 1991 .

[14]  Mojtaba Salehi,et al.  On-line analysis of out-of-control signals in multivariate manufacturing processes using a hybrid learning-based model , 2011, Neurocomputing.

[15]  Loon Ching Tang,et al.  QUALITY NOTES: Simultaneous monitoring of univariate and multivariate SPC information using boxplots , 1998 .

[16]  Seyed Taghi Akhavan Niaki,et al.  Fault Diagnosis in Multivariate Control Charts Using Artificial Neural Networks , 2005 .

[17]  Babak Abbasi,et al.  A neural network applied to estimate process capability of non-normal processes , 2009, Expert Syst. Appl..

[18]  Ruey-Shiang Guh,et al.  On‐line Identification and Quantification of Mean Shifts in Bivariate Processes using a Neural Network‐based Approach , 2007, Qual. Reliab. Eng. Int..

[19]  Linda W. Blazek,et al.  Displaying Multivariate Data Using Polyplots , 1987 .

[20]  Yuehjen E. Shao,et al.  Change point determination for a multivariate process using a two-stage hybrid scheme , 2013, Appl. Soft Comput..

[21]  Yuehjen E. Shao,et al.  Fault Identification in Industrial Processes Using an Integrated Approach of Neural Network and Analysis of Variance , 2013 .

[22]  John C. Young,et al.  A Practical Approach for Interpreting Multivariate T2 Control Chart Signals , 1997 .

[23]  Yuehjen E. Shao,et al.  Mining the breast cancer pattern using artificial neural networks and multivariate adaptive regression splines , 2004, Expert Syst. Appl..

[24]  Age K. Smilde,et al.  Generalized contribution plots in multivariate statistical process monitoring , 2000 .

[25]  Yuehjen E. Shao,et al.  A Hybrid ICA-SVM Approach for Determining the Quality Variables at Fault in a Multivariate Process , 2012 .

[26]  Neil H. Timm,et al.  Multivariate Quality Control Using Finite Intersection Tests , 1996 .

[27]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[28]  Yi-Zeng Liang,et al.  Two-step multivariate adaptive regression splines for modeling a quantitative relationship between gas chromatography retention indices and molecular descriptors. , 2003, Journal of chromatography. A.

[29]  Yuehjen E. Shao,et al.  Mixture control chart patterns recognition using independent component analysis and support vector machine , 2011, Neurocomputing.

[30]  Chih-Chou Chiu,et al.  Identification of process disturbance using SPC/EPC and neural networks , 2003, J. Intell. Manuf..

[31]  Jay M. Rosenberger,et al.  A multivariate adaptive regression splines cutting plane approach for solving a two-stage stochastic programming fleet assignment model , 2012, Eur. J. Oper. Res..

[32]  Francesco Vidoli,et al.  Evaluating the water sector in Italy through a two stage method using the conditional robust nonparametric frontier and multivariate adaptive regression splines , 2011, Eur. J. Oper. Res..

[33]  Yu Wang,et al.  Shift detection and source identification in multivariate autocorrelated processes , 2010 .

[34]  Mojtaba Salehi,et al.  On line detection of mean and variance shift using neural networks and support vector machine in multivariate processes , 2012, Appl. Soft Comput..

[35]  Steven X. Ding,et al.  Real-Time Implementation of Fault-Tolerant Control Systems With Performance Optimization , 2014, IEEE Transactions on Industrial Electronics.

[36]  Theodora Kourti,et al.  Multivariate SPC Methods for Process and Product Monitoring , 1996 .

[37]  Steven X. Ding,et al.  Data-driven monitoring for stochastic systems and its application on batch process , 2013, Int. J. Syst. Sci..

[38]  Lijuan Cao,et al.  Support vector machines experts for time series forecasting , 2003, Neurocomputing.

[39]  Chuen-Sheng Cheng,et al.  Identifying the source of variance shifts in the multivariate process using neural networks and support vector machines , 2008, Expert Syst. Appl..

[40]  Yuehjen E. Shao,et al.  SIGNAL USING ARTIFICIAL NEURAL NETWORKS AND SUPPORT VECTOR MACHINE , 2009 .

[41]  Hong Wang,et al.  Data Driven Fault Diagnosis and Fault Tolerant Control: Some Advances and Possible New Directions: Data Driven Fault Diagnosis and Fault Tolerant Control: Some Advances and Possible New Directions , 2009 .

[42]  Martin Brown,et al.  Data Driven Fault Diagnosis and Fault Tolerant Control: Some Advances and Possible New Directions , 2009 .