Fisher Discriminative Sparse Representation Based on DBN for Fault Diagnosis of Complex System

Fault detection and diagnosis in the chemical industry is a challenging task due to the large number of measured variables and complex interactions among them. To solve this problem, a new fault diagnosis method named Fisher discriminative sparse representation (FDSR), based on deep belief network (DBN), is proposed in this paper. We used DBN to extract the features of all faulty and normal modes. Features extracted by the DBN were used to learn subdictionaries, then the overcomplete dictionary was constructed by cascading all subdictionaries in order, and each dictionary atom corresponded to class labels. The Fisher discrimination criterion (FDC) was applied to the dictionary learning to ensure smaller within-class scatter but greater between-class scatter. The quadratic programming method was applied to estimate the sparse coefficients simultaneously class by class. Therefore, both the reconstruction error and sparse coefficients were discriminative, so that the reconstruction error after sparse coding can be used for pattern classification. An experiment performed on the Tennessee Eastman (TE) process indicated that compared with the traditional monitoring methods, the FDSR based on DBN produced more interpretable results and achieved superior performance for feature extraction and classification in the field of complex system fault diagnosis. T-distributed stochastic neighbor embedding (t-SNE) appropriately visualized the performance of the proposed method and produced reliable fault diagnosis results.

[1]  Dapeng Tao,et al.  Discriminative dictionary learning via Fisher discrimination K-SVD algorithm , 2015, Neurocomputing.

[2]  Yang Xiao,et al.  Fault Diagnosis Using a Joint Model Based on Sparse Representation and SVM , 2016, IEEE Transactions on Instrumentation and Measurement.

[3]  Lei Shi,et al.  Weld seam fitting and welding torch trajectory planning based on NURBS in intersecting curve welding , 2018 .

[4]  Cunbao Ma,et al.  Deep quantum inspired neural network with application to aircraft fuel system fault diagnosis , 2017, Neurocomputing.

[5]  David Zhang,et al.  Sparse Representation Based Fisher Discrimination Dictionary Learning for Image Classification , 2014, International Journal of Computer Vision.

[6]  Lifeng Wu,et al.  Fault Diagnosis of Roller Bearings Based on a Wavelet Neural Network and Manifold Learning , 2017 .

[7]  Lijun Wu,et al.  Fault detection and diagnosis based on sparse representation classification (SRC) , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[8]  Jingqi Yuan,et al.  Batch Process Monitoring with Tensor Global−Local Structure Analysis , 2013 .

[9]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part I: Fault Diagnosis With Model-Based and Signal-Based Approaches , 2015, IEEE Transactions on Industrial Electronics.

[10]  Mohammad Mehdi Homayounpour,et al.  Normal sparse Deep Belief Network , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[11]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[12]  J. Macgregor,et al.  Monitoring batch processes using multiway principal component analysis , 1994 .

[13]  Wenhao Huang,et al.  Deep Architecture for Traffic Flow Prediction: Deep Belief Networks With Multitask Learning , 2014, IEEE Transactions on Intelligent Transportation Systems.

[14]  Noel Lopes,et al.  Towards adaptive learning with improved convergence of deep belief networks on graphics processing units , 2014, Pattern Recognit..

[15]  Jie Yu,et al.  Quality relevant nonlinear batch process performance monitoring using a kernel based multiway non-Gaussian latent subspace projection approach , 2014 .

[16]  Furong Gao,et al.  Review of Recent Research on Data-Based Process Monitoring , 2013 .

[17]  Geoffrey E. Hinton,et al.  Conditional Restricted Boltzmann Machines for Structured Output Prediction , 2011, UAI.

[18]  David He,et al.  Detection of Pitting in Gears Using a Deep Sparse Autoencoder , 2017 .

[19]  Vikram Garaniya,et al.  A sparse PCA for nonlinear fault diagnosis and robust feature discovery of industrial processes , 2016 .

[20]  Jingqi Yuan,et al.  Multivariate statistical process control based on multiway locality preserving projections , 2008 .

[21]  Moussa Boukhnifer,et al.  Robust fault tolerant tracking controller design for vehicle dynamics: a descriptor approach , 2015 .

[22]  Manabu Kano,et al.  Monitoring independent components for fault detection , 2003 .

[23]  Yong Peng,et al.  EEG-based emotion classification using deep belief networks , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[24]  Lorenzo Rosasco,et al.  Iterative Projection Methods for Structured Sparsity Regularization , 2009 .

[25]  Di Tang,et al.  Improved fault detection and diagnosis using sparse global-local preserving projections , 2016 .

[26]  Peter Glöckner,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2013 .

[27]  Hak-Keung Lam,et al.  Observer-Based Fault Detection for Nonlinear Systems With Sensor Fault and Limited Communication Capacity , 2016, IEEE Transactions on Automatic Control.

[28]  Jie Chen,et al.  Robust Model-Based Fault Diagnosis for Dynamic Systems , 1998, The International Series on Asian Studies in Computer and Information Science.

[29]  Steven X. Ding,et al.  Design of robust fuzzy fault detection filter for polynomial fuzzy systems with new finite frequency specifications , 2018, Autom..

[30]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[31]  Huanxin Zou,et al.  Sparse Representation-Based SAR Image Target Classification on the 10-Class MSTAR Data Set , 2016 .

[32]  Lei Zhang,et al.  Metaface learning for sparse representation based face recognition , 2010, 2010 IEEE International Conference on Image Processing.

[33]  Xiaozhan Yang,et al.  Robust Model-Based Fault Diagnosis for PEM Fuel Cell Air-Feed System , 2016, IEEE Transactions on Industrial Electronics.

[34]  Mohammed Chadli,et al.  Fuzzy Fault Detection Filter Design for T–S Fuzzy Systems in the Finite-Frequency Domain , 2017, IEEE Transactions on Fuzzy Systems.

[35]  John F. MacGregor,et al.  Multi-way partial least squares in monitoring batch processes , 1995 .

[36]  Shi Tao,et al.  Aerial image classification based on sparse representation and deep belief network , 2016, 2016 35th Chinese Control Conference (CCC).

[37]  David Zhang,et al.  Fisher Discrimination Dictionary Learning for sparse representation , 2011, 2011 International Conference on Computer Vision.

[38]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[39]  Ligang Wu,et al.  Fault Detection Filtering for Nonhomogeneous Markovian Jump Systems via a Fuzzy Approach , 2018, IEEE Transactions on Fuzzy Systems.

[40]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[41]  Ma Yao,et al.  On-line monitoring of batch processes using generalized additive kernel principal component analysis , 2015 .

[42]  Yi Chai,et al.  A Geometric Dictionary Learning Based Approach for Fluorescence Spectroscopy Image Fusion , 2017 .

[43]  Mohammad Javad Yazdanpanah,et al.  Designing supervised local neural network classifiers based on EM clustering for fault diagnosis of Tennessee Eastman process , 2015 .

[44]  Xiao-Lei Zhang,et al.  Deep Belief Networks Based Voice Activity Detection , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[45]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[46]  Nan Yu,et al.  The Deep Belief and Self-Organizing Neural Network as a Semi-Supervised Classification Method for Hyperspectral Data , 2017 .

[47]  Ling Li,et al.  Unsupervised dictionary learning with Fisher discriminant for clustering , 2016, Neurocomputing.

[48]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[49]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.