Deep Belief Networks Ensemble with Multi-objective Optimization for Failure Diagnosis

Early diagnosis that can detect faults from some symptoms accurately is critical, because it provides the potential benefits such as reducing maintenance costs, improving productivity and avoiding serious damages. Degradation pattern classification for early diagnosis has not been explored in many researches yet. This paper will use hybrid ensemble model for degradation pattern classification. Supervised training of deep models (e.g. Many-layered Neural Nets) is difficult for optimization problem with unlabeled datasets or insufficient data sample. Shallow models (SVMs, Neural Networks, etc...) are unlikely candidates for learning high-level abstractions, since they are affected by the curse of dimensionality. Therefore, deep learning network (DBN), an unsupervised learning model, in diagnosis problem has been investigated to do classification. Few researches have been done for exploring the effects of DBN in diagnosis. In this paper, an ensemble of DBNs with MOEA/D has been applied for diagnosis to handle failure degradation with multivariate sensory data. Turbofan engine degradation dataset is employed to demonstrate the efficacy of the proposed model. We believe that deep learning with multi-objective ensemble for degradation pattern classification can shed new light on failure diagnosis, and our work presented the applicability of this method to diagnosis as well as prognostics.

[1]  K. Tan GREY-BOX MODEL IDENTIFICATION VIA EVOLUTIONARY COMPUTING , 2007 .

[2]  Kay Chen Tan,et al.  Modeling and control of a pilot pH plant using genetic algorithm , 2005, Eng. Appl. Artif. Intell..

[3]  Kay Chen Tan,et al.  Global exponential stability of discrete-time neural networks for constrained quadratic optimization , 2004, Neurocomputing.

[4]  Xin Yao,et al.  Ensemble Learning Using Multi-Objective Evolutionary Algorithms , 2006, J. Math. Model. Algorithms.

[5]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[6]  Jian-Da Wu,et al.  An expert system for fault diagnosis in internal combustion engines using wavelet packet transform and neural network , 2009, Expert Syst. Appl..

[7]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[8]  Luis Enrique Sucar,et al.  Probabilistic Model-Based Diagnosis , 2000, MICAI.

[9]  Luis Enrique Sucar,et al.  A probabilistic model-based approach for fault diagnosis , 2000 .

[10]  Kay Chen Tan,et al.  A coevolutionary algorithm for rules discovery in data mining , 2006, Int. J. Syst. Sci..

[11]  Sébastien Rebecchi,et al.  An Introduction to Deep Learning , 2011, ESANN.

[12]  Xin Yao,et al.  DIVACE: Diverse and Accurate Ensemble Learning Algorithm , 2004, IDEAL.

[13]  Angel Javier Quispe Carita,et al.  Bayesian Networks applied to Failure Diagnosis in Power Transformer , 2013, IEEE Latin America Transactions.

[14]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[15]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[16]  Remco C. Veltkamp,et al.  An Ensemble of Deep Support Vector Machines for Image Categorization , 2009, 2009 International Conference of Soft Computing and Pattern Recognition.

[17]  Feng Li,et al.  Fault Diagnosis of Turbine Based on Data-Driven , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[18]  Abdullah Al Mamun,et al.  An evolutionary memetic algorithm for rule extraction , 2010, Expert Syst. Appl..

[19]  Zhang Yi,et al.  A columnar competitive model for solving combinatorial optimization problems , 2004, IEEE Transactions on Neural Networks.

[20]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[21]  Pingfeng Wang,et al.  Failure diagnosis using deep belief learning based health state classification , 2013, Reliab. Eng. Syst. Saf..