Autoencoder embedded dictionary learning for nonlinear industrial process fault diagnosis

Abstract Industrial processes usually exhibit great nonlinearity generated from the effects of complex mechanisms, system integrations and multiple working conditions. Although a variety of dictionary learning algorithms have been proposed in recent years for industrial process fault diagnosis, most of them only model the process data via a linear combination of a few dictionary atoms, which cannot effectively characterize the nonlinear relationships among variables and may lead to limited diagnosis performance. Recent improvements in multilayer neural networks, especially the autoencoders, offer opportunities to tackle the nonlinear problem. However, the overall limited availability of fault samples poses great challenges in achieving satisfactory performance. To address the mentioned issues simultaneously, the present study proposes an Autoencoder Embedded Dictionary Learning approach (AEDL) for nonlinear industrial process fault diagnosis. First, an autoencoder is employed to learn a nonlinear mapping that maps the linearly inseparable industrial process data to a high-dimensional space, where a desired dictionary is learned according to the basic dictionary learning algorithm. Next, two supervised graphs, leveraging the priors of industrial process data, are introduced into the learning process to make the proposed approach robust to training samples. After obtaining the dictionary, the coding coefficients of the process data over the dictionary can be used for fault diagnosis via a simple classifier. As revealed from the encouraging experimental results on the Tennessee Eastman process, the developed approach outperforms several dictionary learning approaches and some other nonlinear fault diagnosis methods.

[1]  Chunhui Zhao,et al.  A Fine-Grained Adversarial Network Method for Cross-Domain Industrial Fault Diagnosis , 2020, IEEE Transactions on Automation Science and Engineering.

[2]  Chunhui Zhao,et al.  Enhanced Random Forest With Concurrent Analysis of Static and Dynamic Nodes for Industrial Fault Classification , 2020, IEEE Transactions on Industrial Informatics.

[3]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[4]  Chunhua Yang,et al.  Nonlinear process monitoring using kernel dictionary learning with application to aluminum electrolysis process , 2019, Control Engineering Practice.

[5]  Weihua Gui,et al.  Distributed dictionary learning for high-dimensional process monitoring , 2020 .

[6]  Chunhui Zhao,et al.  Broad Convolutional Neural Network Based Industrial Process Fault Diagnosis With Incremental Learning Capability , 2020, IEEE Transactions on Industrial Electronics.

[7]  Lei Xie,et al.  Structured Joint Sparse Principal Component Analysis for Fault Detection and Isolation , 2019, 2018 IEEE 7th Data Driven Control and Learning Systems Conference (DDCLS).

[8]  Nilanjan Ray,et al.  Object Classification With Joint Projection and Low-Rank Dictionary Learning , 2016, IEEE Transactions on Image Processing.

[9]  Shijin Wang,et al.  One-dimensional convolutional auto-encoder-based feature learning for fault diagnosis of multivariate processes , 2020 .

[10]  Yuhao Wang,et al.  High-Voltage Circuit Breaker Fault Diagnosis Using a Hybrid Feature Transformation Approach Based on Random Forest and Stacked Autoencoder , 2019, IEEE Transactions on Industrial Electronics.

[11]  Yuping Zhang,et al.  Local class-specific discriminant analysis with variable weighting and its application in fault diagnosis , 2020, Comput. Chem. Eng..

[12]  Zhanpeng Zhang,et al.  A deep belief network based fault diagnosis model for complex chemical processes , 2017, Comput. Chem. Eng..

[13]  Bowen Zhou,et al.  Fault Diagnosis for Energy Internet Using Correlation Processing-Based Convolutional Neural Networks , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Mohd Azlan Hussain,et al.  A review of data-driven fault detection and diagnosis methods: applications in chemical process systems , 2019 .

[15]  Shigang Liu,et al.  Discriminative face recognition via kernel sparse representation , 2018, Multimedia Tools and Applications.

[16]  Yi Chai,et al.  Fisher Discriminative Sparse Representation Based on DBN for Fault Diagnosis of Complex System , 2018 .

[17]  Hazem Nounou,et al.  Partial kernel PCA-based GLRT for fault diagnosis of nonlinear processes , 2020, J. Intell. Fuzzy Syst..

[18]  Zhiqiang Ge,et al.  Semi-supervised fault classification based on dynamic Sparse Stacked auto-encoders model , 2017 .

[19]  Chenglin Wen,et al.  Weighted time series fault diagnosis based on a stacked sparse autoencoder , 2017 .

[20]  Jing Lin,et al.  Adaptive kernel density-based anomaly detection for nonlinear systems , 2018, Knowl. Based Syst..

[21]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[22]  Kaixiang Peng,et al.  A Novel Hierarchical Detection and Isolation Framework for Quality-Related Multiple Faults in Large-Scale Processes , 2020, IEEE Transactions on Industrial Electronics.

[23]  Ping Wang,et al.  Two-Step Localized Kernel Principal Component Analysis Based Incipient Fault Diagnosis for Nonlinear Industrial Processes , 2020 .

[24]  Mohammad Mehdi Ebadzadeh,et al.  Dictionary learning enhancement framework: Learning a non-linear mapping model to enhance discriminative dictionary learning methods , 2019, Neurocomputing.

[25]  Yang Tang,et al.  Multimode Process Monitoring and Fault Detection: A Sparse Modeling and Dictionary Learning Method , 2017, IEEE Transactions on Industrial Electronics.

[26]  Rama Chellappa,et al.  Design of Non-Linear Kernel Dictionaries for Object Recognition , 2013, IEEE Transactions on Image Processing.

[27]  Lei Zhang,et al.  Support Vector Guided Dictionary Learning , 2014, ECCV.

[28]  Chunhui Zhao,et al.  Sparse Exponential Discriminant Analysis and Its Application to Fault Diagnosis , 2018, IEEE Transactions on Industrial Electronics.

[29]  Michael Elad,et al.  Linearized Kernel Dictionary Learning , 2015, IEEE Journal of Selected Topics in Signal Processing.

[30]  Chao Ning,et al.  Sparse Contribution Plot for Fault Diagnosis of Multimodal Chemical Processes , 2015 .

[31]  Bin Xu,et al.  Generalized Discriminant Analysis: A Matrix Exponential Approach , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Yong Zeng,et al.  Fault diagnosis based on variable-weighted separability-oriented subclass discriminant analysis , 2019, Comput. Chem. Eng..

[33]  Hongbo Shi,et al.  A Novel Dynamic Weight Principal Component Analysis Method and Hierarchical Monitoring Strategy for Process Fault Detection and Diagnosis , 2020, IEEE Transactions on Industrial Electronics.

[34]  Hong Wang,et al.  Fault identification for quality monitoring of molten iron in blast furnace ironmaking based on KPLS with improved contribution rate , 2020 .

[35]  Lei Zhang,et al.  Dictionary Pair Classifier Driven Convolutional Neural Networks for Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Cheng Long,et al.  Multimode process monitoring based on robust dictionary learning with application to aluminium electrolysis process , 2019, Neurocomputing.

[37]  Chunhui Zhao,et al.  Online Fault Diagnosis for Industrial Processes With Bayesian Network-Based Probabilistic Ensemble Learning Strategy , 2019, IEEE Transactions on Automation Science and Engineering.

[38]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[39]  Yupu Yang,et al.  Automated feature learning for nonlinear process monitoring – An approach using stacked denoising autoencoder and k-nearest neighbor rule , 2018 .

[40]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[41]  Donghua Zhou,et al.  Incipient sensor fault diagnosis in multimode processes using conditionally independent Bayesian learning based recursive transformed component statistical analysis , 2019, Journal of Process Control.

[42]  Chunhua Yang,et al.  Structure Dictionary Learning-Based Multimode Process Monitoring and its Application to Aluminum Electrolysis Process , 2020, IEEE Transactions on Automation Science and Engineering.

[43]  David Zhang,et al.  Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification , 2014, International Journal of Computer Vision.

[44]  Nicu Sebe,et al.  When Dictionary Learning Meets Deep Learning: Deep Dictionary Learning and Coding Network for Image Recognition With Limited Data , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Qinghua Hu,et al.  Kernel sparse representation for time series classification , 2015, Inf. Sci..

[46]  Faisal Khan,et al.  A Bibliometric Review and Analysis of Data-Driven Fault Detection and Diagnosis Methods for Process Systems , 2018, Industrial & Engineering Chemistry Research.

[47]  Yaguo Lei,et al.  Applications of machine learning to machine fault diagnosis: A review and roadmap , 2020 .

[48]  David Zhang,et al.  Sparse, Collaborative, or Nonnegative Representation: Which Helps Pattern Classification? , 2018, Pattern Recognition.

[49]  Jiwen Lu,et al.  Simultaneous Local Binary Feature Learning and Encoding for Homogeneous and Heterogeneous Face Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Likun Ren,et al.  Fault Detection via Sparse Representation for Semiconductor Manufacturing Processes , 2014, IEEE Transactions on Semiconductor Manufacturing.

[51]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[52]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[53]  Che Rosmani Che Hassan,et al.  Multi-scale kernel Fisher discriminant analysis with adaptive neuro-fuzzy inference system (ANFIS) in fault detection and diagnosis framework for chemical process systems , 2019, Neural Computing and Applications.

[54]  Chunhui Zhao,et al.  Robust Monitoring and Fault Isolation of Nonlinear Industrial Processes Using Denoising Autoencoder and Elastic Net , 2020, IEEE Transactions on Control Systems Technology.