Comparing the Fault Diagnosis Performances of Single Neural Networks and Two Ensemble Neural Networks Based on the Boosting Methods

This work employs potential and distinct features of artificial neural networks, in particular the feed-forward multilayer structure, to achieve fault diagnosis in chemical plants. Artificial neural networks can automatically store information by learning from historical fault data without using any qualitative or quantitative model of the system. However, different limitations are encountered in utilizing a single neural network classifier in fault diagnosis of complex large-scale chemical processes. These limitations are mostly originated from the low reliability and also high generalization error of a single neural network classifier which may be faced in real applications. An attractive remedy for these issues is to use an ensemble of different neural network models instead of relying on a single one. In this work, boosting as a general well-known approach to improve the learning performance of learning algorithms by building ensemble models is investigated. In particular, an efficient boosting method called the Stage-wise Additive Modeling using a Multi-class Exponential Loss Function (SAMMELF) is utilized. This technique can effectively overcome the main limitations of the early boosting methods for fault diagnosis applications. The potential of the SAMMELF algorithm is proved through its application to the challenging diagnosis problem of the Tennessee-Eastman Process (TEP) where the whole sets of the predefined TEP faults are considered in the classification problem.

[1]  Morton J. Canty,et al.  Boosting a fast neural network for supervised land cover classification , 2009, Comput. Geosci..

[2]  Heikki N. Koivo,et al.  Artificial neural networks in fault diagnosis and control , 1994 .

[3]  S. Samanta,et al.  A comparative study of the performance of single neural network vs. Adaboost algorithm based combination of multiple neural networks for mineral resource estimation , 2005 .

[4]  Michael J. Pazzani,et al.  Error reduction through learning multiple descriptions , 2004, Machine Learning.

[5]  William G. Baxt,et al.  Improving the Accuracy of an Artificial Neural Network Using Multiple Differently Trained Networks , 1992, Neural Computation.

[6]  M. A. HUSSAIN,et al.  APPLICATION OF ARTIFICIAL INTELLIGENCE TECHNIQUES IN PROCESS FAULT DIAGNOSIS , 2007 .

[7]  Abdessamad Kobi,et al.  Fault diagnosis of industrial systems by conditional Gaussian network including a distance rejection criterion , 2010, Eng. Appl. Artif. Intell..

[8]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[9]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[10]  Arthur K. Kordon,et al.  Fault diagnosis based on Fisher discriminant analysis and support vector machines , 2004, Comput. Chem. Eng..

[11]  Jin Wang,et al.  Fault Detection Using the k-Nearest Neighbor Rule for Semiconductor Manufacturing Processes , 2007, IEEE Transactions on Semiconductor Manufacturing.

[12]  Reza Eslamloueyan,et al.  Designing a hierarchical neural network based on fuzzy clustering for fault diagnosis of the Tennessee-Eastman process , 2011, Appl. Soft Comput..

[13]  Yoshua Bengio,et al.  AdaBoosting Neural Networks: Application to on-line Character Recognition , 1997, ICANN.

[14]  Hooshang Jazayeri-Rad,et al.  Fault Detection and Diagnosis in a Sour Gas Absorption Column Using Neural Networks , 2009 .

[15]  Jie Zhang Improved on-line process fault diagnosis through information fusion in multiple neural networks , 2006, Comput. Chem. Eng..

[16]  Enrico Zio,et al.  Feature-based classifier ensembles for diagnosing multiple faults in rotating machinery , 2008, Appl. Soft Comput..

[17]  Masahiro Abe,et al.  Incipient fault diagnosis of chemical processes via artificial neural networks , 1989 .

[18]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[19]  Bhaskar D. Kulkarni,et al.  Knowledge incorporated support vector machines to detect faults in Tennessee Eastman Process , 2005, Comput. Chem. Eng..

[20]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[21]  Rolf Isermann,et al.  Process fault detection based on modeling and estimation methods - A survey , 1984, Autom..

[22]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[23]  Long-Sheng Chen,et al.  Using SVM based method for equipment fault detection in a thermal power plant , 2011, Comput. Ind..

[24]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[25]  Venkat Venkatasubramanian,et al.  Challenges in the industrial applications of fault diagnostic systems , 2000 .

[26]  David M. Himm elblau Applications of Artificial Neural Networks in Chemical Engineering , 2000 .

[27]  R.M. Valdovinos,et al.  Ensembles of Multilayer Perceptron and Modular Neural Networks for Fast and Accurate Learning , 2006, 2006 Fifth Mexican International Conference on Artificial Intelligence.

[28]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[29]  Sirish L. Shah,et al.  Fault detection and diagnosis in process data using one-class support vector machines , 2009 .

[30]  Jin Zhao,et al.  Fault Diagnosis of Complex Industrial Process Using KICA and Sparse SVM , 2013 .

[31]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[32]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[33]  Thomas E. Marlin,et al.  Multivariate statistical monitoring of process operating performance , 1991 .

[34]  David Mautner Himmelblau,et al.  Fault detection and diagnosis in chemical and petrochemical processes , 1978 .

[35]  Trevor Hastie,et al.  Multi-class AdaBoost ∗ , 2009 .

[36]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[37]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[38]  Luis Puigjaner,et al.  Performance assessment of a novel fault diagnosis system based on support vector machines , 2009, Comput. Chem. Eng..

[39]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part I: Quantitative model-based methods , 2003, Comput. Chem. Eng..

[40]  Yoshua Bengio,et al.  Boosting Neural Networks , 2000, Neural Computation.

[41]  D. Ruta,et al.  An Overview of Classifier Fusion Methods , 2000 .

[42]  Abdessamad Kobi,et al.  Bayesian networks and mutual information for fault diagnosis of industrial systems , 2006 .

[43]  Oleksandr Makeyev,et al.  Neural network with ensembles , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[44]  Christos Georgakis,et al.  Plant-wide control of the Tennessee Eastman problem , 1995 .

[45]  Kailash Singh,et al.  Neural network applications for detecting process faults in packed towers , 2004 .