Deep Learning With Tensor Factorization Layers for Sequential Fault Diagnosis and Industrial Process Monitoring

Fault diagnosis technology is crucial to ensure the long-term reliability of the industrial process control system. With the increase of industrial data availability, conventional monitoring approaches may not function well under the assumption that the training and the application data come from the same distribution. Following the intuition that industrial data exhibit time dependency and inherent complex characteristics, this paper proposes an adaptive sequential fault diagnosis method based on a tensor factorization layer merged with deep neural network model (TF-DNN). Tensor representation is firstly applied to preserve the number of the raw data entries and their sequential dependence between observations. Multilinear mapping with tensor-to-tensor projection is then to transform the input and hidden tensor to the low-dimensional tensors, which makes the learned representations sparser with the grid-like structures. With the tensor factorization layers, the proposed deep network shares efficient knowledge across the spatiotemporal features of fault data. The outstanding performance of this method is demonstrated and compared to the existing models in the benchmark Tennessee Eastman process and a real industrial methanol plant.

[1]  Dexian Huang,et al.  Data-driven soft sensor development based on deep learning technique , 2014 .

[2]  Hao Wu,et al.  Deep convolutional neural network model based chemical process fault diagnosis , 2018, Comput. Chem. Eng..

[3]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[4]  Zhiqiang Ge,et al.  Review on data-driven modeling and monitoring for plant-wide industrial processes , 2017 .

[5]  Bo Jin,et al.  Sequential Fault Diagnosis Based on LSTM Neural Network , 2018, IEEE Access.

[6]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[7]  Zhi-huan Song,et al.  Process Monitoring Based on Independent Component Analysis - Principal Component Analysis ( ICA - PCA ) and Similarity Factors , 2007 .

[8]  Stella Bezergianni,et al.  Application of Principal Component Analysis for Monitoring and Disturbance Detection of a Hydrotreating Process , 2008 .

[9]  Li Wang,et al.  Multivariate statistical process monitoring using an improved independent component analysis , 2010 .

[10]  Alaa Tharwat,et al.  Classification assessment methods , 2020, Applied Computing and Informatics.

[11]  Haiping Lu,et al.  Multilinear Subspace Learning: Dimensionality Reduction of Multidimensional Data , 2013 .

[12]  Hong Zhou,et al.  Decentralized Fault Diagnosis of Large-Scale Processes Using Multiblock Kernel Partial Least Squares , 2010, IEEE Transactions on Industrial Informatics.

[13]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[14]  Donghua Zhou,et al.  Total projection to latent structures for process monitoring , 2009 .

[15]  Richard D. Braatz,et al.  Fault Detection and Diagnosis in Industrial Systems , 2001 .

[16]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[17]  Biao Huang,et al.  Review and Perspectives of Data-Driven Distributed Monitoring for Industrial Plant-Wide Processes , 2019, Industrial & Engineering Chemistry Research.

[18]  Carlos F. Alcala,et al.  Reconstruction-based contribution for process monitoring with kernel principal component analysis , 2010, Proceedings of the 2010 American Control Conference.

[19]  Evangelos E. Papalexakis,et al.  Identifying and Alleviating Concept Drift in Streaming Tensor Decomposition , 2018, ECML/PKDD.

[20]  Xuefeng Yan,et al.  Parallel PCA–KPCA for nonlinear process monitoring , 2018, Control Engineering Practice.

[21]  Chenglin Wen,et al.  Deep learning fault diagnosis method based on global optimization GAN for unbalanced data , 2020, Knowl. Based Syst..

[22]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[23]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[24]  Zhanpeng Zhang,et al.  A deep belief network based fault diagnosis model for complex chemical processes , 2017, Comput. Chem. Eng..

[25]  S. Joe Qin,et al.  A novel dynamic PCA algorithm for dynamic data modeling and process monitoring , 2017 .

[26]  Dan Schonfeld,et al.  Multilinear Discriminant Analysis for Higher-Order Tensor Data Classification , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.