A hybrid neural network model for rule generation and its application to process fault detection and diagnosis

In this paper, a hybrid neural network model, based on the integration of fuzzy ARTMAP (FAM) and the rectangular basis function network (RecBFN), which is capable of learning and revealing fuzzy rules is proposed. The hybrid network is able to classify data samples incrementally and, at the same time, to extract rules directly from the network weights for justifying its predictions. With regards to process systems engineering, the proposed network is applied to a fault detection and diagnosis task in a power generation station. Specifically, the efficiency of the network in monitoring the operating conditions of a circulating water (CW) system is evaluated by using a set of real sensor measurements collected from the power station. The rules extracted are analyzed, discussed, and compared with those from a rule extraction method of FAM. From the comparison results, it is observed that the proposed network is able to extract more meaningful rules with a lower degree of rule redundancy and higher interpretability within the neural network framework. The extracted rules are also in agreement with experts' opinions for maintaining the CW system in the power generation plant.

[1]  Ludmila I. Kuncheva,et al.  How good are fuzzy If-Then classifiers? , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Brian Lithgow,et al.  New Fault Diagnosis of Circuit Breakers , 2002, IEEE Power Engineering Review.

[3]  Simon Kasif,et al.  A System for Induction of Oblique Decision Trees , 1994, J. Artif. Intell. Res..

[4]  Hong-Tzer Yang,et al.  A new neural networks approach to on-line fault section estimation using information of protective relays and circuit breakers , 1994 .

[5]  M. Negnevitsky,et al.  Neural networks approach to online identification of multiple failures of protection systems , 2005, IEEE Transactions on Power Delivery.

[6]  S.M. Rovnyak,et al.  Decision tree-based methodology for high impedance fault detection , 2004, IEEE Transactions on Power Delivery.

[7]  Ethem Alpaydin,et al.  Omnivariate decision trees , 2001, IEEE Trans. Neural Networks.

[8]  Young-Moon Park,et al.  A Restoration Aid Expert System for Distribution Substations , 1996, IEEE Power Engineering Review.

[9]  V. Miranda,et al.  Knowledge discovery in neural networks with application to transformer failure diagnosis , 2005, IEEE Transactions on Power Systems.

[10]  J. R. McDonald,et al.  A multi agent system for monitoring industrial gas turbine start-up sequences , 2001, PICA 2001. Innovative Computing for Power - Electric Energy Meets the Market. 22nd IEEE Power Engineering Society. International Conference on Power Industry Computer Applications (Cat. No.01CH37195).

[11]  Michael R. Berthold,et al.  Building precise classifiers with automatic rule extraction , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[12]  Johannes Gehrke,et al.  SECRET: a scalable linear regression tree algorithm , 2002, KDD.

[13]  A. De,et al.  Recognition of Impulse Fault Patterns in Transformers Using Kohonen's Self-Organizing Feature Map , 2002, IEEE Power Engineering Review.

[14]  R. Nakano,et al.  Medical diagnostic expert system based on PDP model , 1988, IEEE 1988 International Conference on Neural Networks.

[15]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part III: Process history based methods , 2003, Comput. Chem. Eng..

[16]  Jorge L. Aravena,et al.  A modular methodology for fast fault detection and classification in power systems , 1998, IEEE Trans. Control. Syst. Technol..

[17]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[18]  Yan Zhang,et al.  A multi-resolution system approach to power transformer insulation diagnosis , 1998, Proceedings of 1998 International Symposium on Electrical Insulating Materials. 1998 Asian International Conference on Dielectrics and Electrical Insulation. 30th Symposium on Electrical Insulating Ma.

[19]  N. Abe,et al.  On the application of a machine learning technique to fault diagnosis of power distribution lines , 1995 .

[20]  Brian D. Ripley,et al.  Pattern Recognition and Neural Networks , 1996 .

[21]  M. M. Morcos,et al.  Application of AI tools in fault diagnosis of electrical machines and drives-an overview , 2003 .

[22]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[23]  Mohamed A. El-Sharkawi,et al.  Detection of shorted-turns in the field winding of turbine-generator rotors using novelty detectors-development and field test , 1996 .

[24]  Jude W. Shavlik,et al.  Extracting Refined Rules from Knowledge-Based Neural Networks , 1993, Machine Learning.

[25]  Ah-Hwee Tan,et al.  Rule Extraction: From Neural Architecture to Symbolic Representation , 1995 .

[26]  I. Hatono,et al.  Fuzzy decision trees by fuzzy ID3 algorithm and its application to diagnosis systems , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[27]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[28]  Stephen Grossberg,et al.  Fuzzy ARTMAP: A neural network architecture for incremental supervised learning of analog multidimensional maps , 1992, IEEE Trans. Neural Networks.

[29]  David W. Opitz,et al.  Dynamically adding symbolically meaningful nodes to knowledge-based neural networks , 1995, Knowl. Based Syst..

[30]  CHEE PENG LIM,et al.  An Incremental Adaptive Network for On-line Supervised Learning and Probability Estimation , 1997, Neural Networks.

[31]  C. Lee Giles,et al.  Extraction, Insertion and Refinement of Symbolic Rules in Dynamically Driven Recurrent Neural Networks , 1993 .

[32]  Abhinandan De,et al.  Recognition of Impulse Fault Patterns in Transformers Using Kohonen's Self-Organizing Feature Map , 2002 .

[33]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[34]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[35]  Sebastian Thrun,et al.  Extracting Rules from Artifical Neural Networks with Distributed Representations , 1994, NIPS.

[36]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part II: Qualitative models and search strategies , 2003, Comput. Chem. Eng..

[37]  Michael R. Berthold,et al.  Boosting the Performance of RBF Networks with Dynamic Decay Adjustment , 1994, NIPS.

[38]  P. J. Griffin,et al.  An Artificial Neural Network Approach to Transformer Fault Diagnosis , 1996, IEEE Power Engineering Review.

[39]  Witold Pedrycz,et al.  Designing decision trees with the use of fuzzy granulation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[40]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[41]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[42]  Chee Peng Lim,et al.  Application of an adaptive neural network with symbolic rule extraction to fault detection and diagnosis in a power generation plant , 2004 .

[43]  Stephen Grossberg,et al.  Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system , 1991, Neural Networks.

[44]  Peter Crossley,et al.  Application of a wide area back-up protection expert system to prevent cascading outages , 2001, 2001 Power Engineering Society Summer Meeting. Conference Proceedings (Cat. No.01CH37262).

[45]  Issam Dagher,et al.  An ordering algorithm for pattern presentation in fuzzy ARTMAP that tends to improve generalization performance , 1999, IEEE Trans. Neural Networks.

[46]  Yoichi Hayashi,et al.  A Neural Expert System with Automated Extraction of Fuzzy If-Then Rules , 1990, NIPS.

[47]  Raghunathan Rengaswamy,et al.  A review of process fault detection and diagnosis: Part I: Quantitative model-based methods , 2003, Comput. Chem. Eng..

[48]  A. De,et al.  A fuzzy ARTMAP fault classifier for impulse testing of power transformers , 2004, IEEE Transactions on Dielectrics and Electrical Insulation.