Fault detection and diagnosis based on transfer learning for multimode chemical processes

Abstract Fault detection and diagnosis (FDD) has been an active research field during the past several decades. Methods based on deep neural networks have made some important breakthroughs recently. However, networks require a large number of fault data for training. A chemical process may have several modes during production. Since fault is a low possibility event, some modes may have few fault data in history. Furthermore, collecting and annotating industrial data are extremely expensive and time-consuming. With scarce or unlabeled fault data, networks cannot be effectively used for modeling. In this paper, we present a FDD method based on transfer learning for multimode chemical processes. To overcome the fault data rareness and no label issues in some modes, transfer learning transfers the knowledge from a source mode to a target mode for FDD. Tennessee Eastman (TE) process with five modes is utilized to verify the performance of our proposed method.

[1]  Reza Eslamloueyan,et al.  Designing a hierarchical neural network based on fuzzy clustering for fault diagnosis of the Tennessee-Eastman process , 2011, Appl. Soft Comput..

[2]  Jinsong Zhao,et al.  A novel process monitoring approach based on variational recurrent autoencoder , 2019, Comput. Chem. Eng..

[3]  Thomas J. McAvoy,et al.  Nonlinear PLS Modeling Using Neural Networks , 1992 .

[4]  Zhanpeng Zhang,et al.  A deep belief network based fault diagnosis model for complex chemical processes , 2017, Comput. Chem. Eng..

[5]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  S. Joe Qin,et al.  A novel dynamic PCA algorithm for dynamic data modeling and process monitoring , 2017 .

[7]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[8]  Mohammad Javad Yazdanpanah,et al.  Designing supervised local neural network classifiers based on EM clustering for fault diagnosis of Tennessee Eastman process , 2015 .

[9]  Shuai Yang,et al.  Transfer Learning Based Fault Diagnosis with Missing Data Due to Multi-Rate Sampling , 2019, Sensors.

[10]  Leo H. Chiang,et al.  Fault diagnosis in chemical processes using Fisher discriminant analysis, discriminant partial least squares, and principal component analysis , 2000 .

[11]  Mohieddine Jelali,et al.  Revision of the Tennessee Eastman Process Model , 2015 .

[12]  Manabu Kano,et al.  Monitoring independent components for fault detection , 2003 .

[13]  Arthur K. Kordon,et al.  Fault diagnosis based on Fisher discriminant analysis and support vector machines , 2004, Comput. Chem. Eng..

[14]  Hao Wu,et al.  Deep convolutional neural network model based chemical process fault diagnosis , 2018, Comput. Chem. Eng..

[15]  Raghunathan Rengaswamy,et al.  Fault Diagnosis by Qualitative Trend Analysis of the Principal Components , 2005 .

[16]  Liya Hou,et al.  Diagnosis of multiple simultaneous fault via hierarchical artificial neural networks , 1994 .

[17]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[18]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[19]  In-Beum Lee,et al.  Fault identification for process monitoring using kernel principal component analysis , 2005 .

[20]  Mengjie Zhang,et al.  Domain Adaptive Neural Networks for Object Recognition , 2014, PRICAI.

[21]  N. Ricker.  Optimal steady-state operation of the Tennessee Eastman challenge process , 1995 .

[22]  W. Harmon Ray,et al.  Dynamic PLS modelling for process control , 1993 .

[23]  Sivaraman Balakrishnan,et al.  Optimal kernel choice for large-scale two-sample tests , 2012, NIPS.

[24]  John F. MacGregor,et al.  Process monitoring and diagnosis by multiblock PLS methods , 1994 .

[25]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[26]  Furong Gao,et al.  Review of Recent Research on Data-Based Process Monitoring , 2013 .

[27]  Yoshua Bengio,et al.  Deep Learning of Representations for Unsupervised and Transfer Learning , 2011, ICML Unsupervised and Transfer Learning.

[28]  Mei Wang,et al.  Deep Visual Domain Adaptation: A Survey , 2018, Neurocomputing.

[29]  Raghunathan Rengaswamy,et al.  A Signed Directed Graph and Qualitative Trend Analysis-Based Framework for Incipient Fault Diagnosis , 2007 .

[30]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  Chenglin Wen,et al.  Fault diagnosis based on deep learning , 2016, 2016 American Control Conference (ACC).

[33]  Michael I. Jordan,et al.  Deep Transfer Learning with Joint Adaptation Networks , 2016, ICML.

[34]  Venkat Venkatasubramanian,et al.  A neural network methodology for process fault diagnosis , 1989 .

[35]  Christos Georgakis,et al.  Disturbance detection and isolation by dynamic principal component analysis , 1995 .

[36]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[37]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[38]  S. Joe Qin,et al.  Dynamic-Inner Partial Least Squares for Dynamic Data Modeling , 2015 .