Improved on-line process fault diagnosis through information fusion in multiple neural networks

A single neural network based fault diagnosis system may not give reliable fault diagnosis due to the fact that a perfect neural network is generally difficult, if not impossible, to develop. To enhance fault diagnosis reliability, this paper proposes a technique where multiple neural networks are developed and their diagnosis results are combined to give the overall diagnosis result. To develop a diverse range of individual networks, each individual network is trained on a replication of the original training data generated through bootstrap re-sampling with replacement. Furthermore, individual networks are trained from different initial weights. Different combination schemes including averaging, majority voting, and a proposed modified majority voting are studied. Applications of the proposed method to a simulated continuous stirred tank reactor demonstrate that combining multiple neural networks can give more reliable and earlier diagnosis than a single neural network whether the networks are trained on quantitative data or qualitative trend data. It is also shown that the modified majority voting combination method proposed in this paper gives better performance than other combination schemes.

[1]  Paul M. Frank,et al.  Issues of Fault Diagnosis for Dynamic Systems , 2010, Springer London.

[2]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[3]  Rolf Isermann,et al.  Process fault detection based on modeling and estimation methods - A survey , 1984, Autom..

[4]  Jie Zhang,et al.  On-line process fault diagnosis using neural network techniques , 1992 .

[5]  Eric B. Bartlett,et al.  Process modeling using stacked neural networks , 1996 .

[6]  Geoffrey E. Hinton,et al.  Adaptive Mixtures of Local Experts , 1991, Neural Computation.

[7]  Peter D. Roberts,et al.  Fault diagnosis of a mixing process using deep qualitative knowledge representation of physical behaviour , 1990, J. Intell. Robotic Syst..

[8]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[9]  L. Breiman.  Stacked Regressions , 1996, Machine Learning.

[10]  Jie Zhang,et al.  Fault detection and diagnosis using multivariate statistical techniques : Process operations and control , 1996 .

[11]  Richard J. Mammone,et al.  Artificial neural networks for speech and vision , 1994 .

[12]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[13]  C. Kiparissides,et al.  Inferential Estimation of Polymer Quality Using Stacked Neural Networks , 1997 .

[14]  Thomas F. Edgar,et al.  Identification of faulty sensors using principal component analysis , 1996 .

[15]  Jacky Montmain,et al.  Qualitative Event Analysis for Fault Diagnosis , 1991 .

[16]  S. Joe Qin,et al.  Multivariate process monitoring and fault diagnosis by multi-scale PCA , 2002 .

[17]  Ali Cinar,et al.  Diagnosis of process disturbances by statistical distance and angle measures , 1997 .

[18]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part I: Quantitative model-based methods , 2003, Comput. Chem. Eng..

[19]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part II: Qualitative models and search strategies , 2003, Comput. Chem. Eng..

[20]  Masahiro Abe,et al.  Incipient fault diagnosis of chemical processes via artificial neural networks , 1989 .

[21]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[22]  Raghunathan Rengaswamy,et al.  Fuzzy-logic based trend classification for fault diagnosis of chemical processes , 2003, Comput. Chem. Eng..

[23]  Jie Zhang,et al.  On-line process fault diagnosis using fuzzy neural networks , 1994 .

[24]  Paul M. Frank,et al.  Fault diagnosis in dynamic systems using analytical and knowledge-based redundancy: A survey and some new results , 1990, Autom..

[25]  Venkat Venkatasubramanian,et al.  A neural network methodology for process fault diagnosis , 1989 .

[26]  Jie Zhang,et al.  Process fault diagnosis with diagnostic rules based on structural decomposition , 1991 .

[27]  John F. MacGregor,et al.  Process monitoring and diagnosis by multiblock PLS methods , 1994 .