Integrating Unsupervised and Supervised Learning in Neural Networks for Fault Diagnosis

Recently, there has been considerable interest in the use of neural networks for fault diagnosis applications. To overcome the main limitations of the neural networks approach, improvements are sought mainly in two respects: (a) a better understanding of the nature of decision boundaries (b) determining the network structure without the usual arbitrary trial and error schemes. In this perspective, we have compared different neural network paradigms and developed an appropriate integrated approach. A feedforward network with ellipsoidal units has been shown to be superior to other architectures. Two different types of learning strategies are compared for training neural networks: unsupervised and supervised learning. Their relative merits and demerits are discussed and a combination has been proposed to develop a network that meets our diagnosis requirements. Unsupervised learning component serves to identify the features and establish the network structure. Supervised learning serves to finetune the resulting network. We present results from a reactor-distillation column case study to demonstrate the structure of the measurement pattern distribution and the suitability of ellipsoidal units approach. By considering the transient behavior in the diagnosis framework, we point out that the problem of fault diagnosis can be treated on the same footing for both batch and continuous processes.

[1]  Manfred Morari,et al.  Local Training for Radial Basis Function Networks: Towards Solving the Hidden Unit Problem , 1991, 1991 American Control Conference.

[2]  Ramaswamy Vaidyanathan,et al.  Process fault detection and diagnosis using neural networks , 1990 .

[3]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[4]  Slobodan Ribarić,et al.  Introduction to Pattern Recognition , 1988 .

[5]  Terrance L. Huntsberger,et al.  PARALLEL SELF-ORGANIZING FEATURE MAPS FOR UNSUPERVISED PATTERN RECOGNITION , 1990 .

[6]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[7]  S. N. Kavuri,et al.  Using fuzzy clustering with ellipsoidal units in neural networks for robust fault classification , 1993 .

[8]  Josiah C. Hoskins,et al.  Artificial neural network models for knowledge representation in chemical engineering , 1990 .

[9]  Lyle H. Ungar,et al.  Adaptive networks for fault diagnosis and process control , 1990 .

[10]  Venkat Venkatasubramanian,et al.  On the nature of fault space classification structure developed by neural networks , 1992 .

[11]  Venkat Venkatasubramanian,et al.  Solving the hidden node problem in networks with ellipsoidal units and related issues , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[12]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[13]  Max Donath,et al.  American Control Conference , 1993 .

[14]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[15]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[16]  Venkat Venkatasubramanian,et al.  Representing and diagnosing dynamic process data using neural networks , 1992 .