Failure diagnosis using deep belief learning based health state classification

Effective health diagnosis provides multifarious benefits such as improved safety, improved reliability and reduced costs for operation and maintenance of complex engineered systems. This paper presents a novel multi-sensor health diagnosis method using deep belief network (DBN). DBN has recently become a popular approach in machine learning for its promised advantages such as fast inference and the ability to encode richer and higher order network structures. The DBN employs a hierarchical structure with multiple stacked restricted Boltzmann machines and works through a layer by layer successive learning process. The proposed multi-sensor health diagnosis methodology using DBN based state classification can be structured in three consecutive stages: first, defining health states and preprocessing sensory data for DBN training and testing; second, developing DBN based classification models for diagnosis of predefined health states; third, validating DBN classification models with testing sensory dataset. Health diagnosis using DBN based health state classification technique is compared with four existing diagnosis techniques. Benchmark classification problems and two engineering health diagnosis applications: aircraft engine health diagnosis and electric power transformer health diagnosis are employed to demonstrate the efficacy of the proposed approach.

[1]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[2]  Byeng D. Youn,et al.  Ensemble of Data-Driven Prognostic Algorithms with Weight Optimization and K-Fold Cross Validation , 2010 .

[3]  Yoshua Bengio,et al.  Exploring Strategies for Training Deep Neural Networks , 2009, J. Mach. Learn. Res..

[4]  Lifeng Xi,et al.  Residual life predictions for ball bearings based on self-organizing map and back propagation neural network methods , 2007 .

[5]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[6]  William Nick Street,et al.  Breast Cancer Diagnosis and Prognosis Via Linear Programming , 1995, Oper. Res..

[7]  Bo-Suk Yang,et al.  Condition classification of small reciprocating compressor for refrigeration using artificial neural networks and support vector machines , 2005 .

[8]  Enrico Zio,et al.  Reliability engineering: Old problems and new challenges , 2009, Reliab. Eng. Syst. Saf..

[9]  Luca Podofillini,et al.  Condition-based maintenance optimization by means of genetic algorithms and Monte Carlo simulation , 2002, Reliab. Eng. Syst. Saf..

[10]  Mahesh D. Pandey,et al.  Discounted cost model for condition-based maintenance optimization , 2010, Reliab. Eng. Syst. Saf..

[11]  Enrico Zio,et al.  Classifier-ensemble incremental-learning procedure for nuclear transient identification at different operational conditions , 2011, Reliab. Eng. Syst. Saf..

[12]  K. F. Martin,et al.  A review by discussion of condition monitoring and fault diagnosis in machine tools , 1994 .

[13]  Nicolas Le Roux,et al.  The Curse of Highly Variable Functions for Local Kernel Machines , 2005, NIPS.

[14]  Bernardo Tormos,et al.  Analytical approach to wear rate determination for internal combustion engine condition monitoring based on oil analysis , 2003 .

[15]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[16]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[17]  Matthieu van der Heijden,et al.  On the availability of a k-out-of-N system given limited spares and repair capacity under a condition based maintenance strategy , 2004, Reliab. Eng. Syst. Saf..

[18]  Hua-Shu Dou,et al.  Vibration-Based Condition Monitoring , 2013 .

[19]  Asoke K. Nandi,et al.  Modified self-organising map for automated novelty detection applied to vibration signal monitoring , 2006 .

[20]  M. Marseguerra,et al.  Simulation modelling of repairable multi-component deteriorating systems for 'on condition' maintenance optimisation , 2002, Reliab. Eng. Syst. Saf..

[21]  Robert E. Uhrig,et al.  Monitoring and diagnosis of rolling element bearings using artificial neural networks , 1993, IEEE Trans. Ind. Electron..

[22]  N. R. Sakthivel,et al.  Multi component fault diagnosis of rotational mechanical system based on decision tree and support vector machine , 2011, Expert Syst. Appl..

[23]  Jianbo Yu,et al.  A similarity-based prognostics approach for Remaining Useful Life estimation of engineered systems , 2008, 2008 International Conference on Prognostics and Health Management.

[24]  Antoine Grall,et al.  A condition-based maintenance policy for stochastically deteriorating systems , 2002, Reliab. Eng. Syst. Saf..

[25]  Michael G. Pecht,et al.  Using cross-validation for model parameter selection of sequential probability ratio test , 2012, Expert Syst. Appl..

[26]  E. A. Elsayed,et al.  Invited paper Perspectives and challenges for research in quality and reliability engineering , 2000 .

[27]  Long Zhang,et al.  Bearing fault diagnosis using multi-scale entropy and adaptive neuro-fuzzy inference , 2010, Expert Syst. Appl..

[28]  Torsten Licht,et al.  Hierarchically Organized Bayesian Networks for Distributed Sensor Networks , 2002 .

[29]  Riccardo Leardi,et al.  PARVUS: An Extendable Package of Programs for Data Exploration , 1988 .

[30]  M. Pecht,et al.  Anomaly Detection of Polymer Resettable Circuit Protection Devices , 2012, IEEE Transactions on Device and Materials Reliability.

[31]  Wai Lok Woo,et al.  Neural network approaches to nonlinear blind source separation , 2005, Proceedings of the Eighth International Symposium on Signal Processing and Its Applications, 2005..

[32]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[33]  T. Leibfried,et al.  Online monitors keep transformers in service , 1998 .

[34]  D. Coit,et al.  Gamma distribution parameter estimation for field reliability data with missing failure times , 2000 .

[35]  L.M. Tolbert,et al.  Fault Diagnostic System for a Multilevel Inverter Using a Neural Network , 2007, IEEE Transactions on Power Electronics.

[36]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[37]  Xiang Li,et al.  Data-driven approaches in health condition monitoring — A comparative study , 2010, IEEE ICCA 2010.

[38]  Enrico Zio,et al.  Model-based Monte Carlo state estimation for condition-based component replacement , 2009, Reliab. Eng. Syst. Saf..

[39]  B. Samanta,et al.  Gear fault detection using artificial neural networks and support vector machines with genetic algorithms , 2004 .

[40]  James R. McDonald,et al.  The use of artificial neural networks for condition monitoring of electrical power transformers , 1998, Neurocomputing.

[41]  D. M. Allan,et al.  New techniques for monitoring the insulation quality of in-service HV apparatus , 1992 .

[42]  J. A. García-Souto,et al.  Measurements of mechanical vibrations at magnetic cores of power transformers with fiber-optic interferometric intrinsic sensor , 2000, IEEE Journal of Selected Topics in Quantum Electronics.

[43]  Abhinav Saxena,et al.  Damage propagation modeling for aircraft engine run-to-failure simulation , 2008, 2008 International Conference on Prognostics and Health Management.

[44]  Gang Niu,et al.  Development of an optimized condition-based maintenance system by data fusion and reliability-centered maintenance , 2010, Reliab. Eng. Syst. Saf..

[45]  Charles E Ebeling,et al.  An Introduction to Reliability and Maintainability Engineering , 1996 .

[46]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[47]  M.G. Pecht,et al.  Prognostics and health management of electronics , 2008, IEEE Transactions on Components and Packaging Technologies.

[48]  Tiedo Tinga,et al.  Application of physical failure models to enable usage and load based maintenance , 2010, Reliab. Eng. Syst. Saf..

[49]  Steven Y. Liang,et al.  Dynamic Prognostic Prediction of Defect Propagation on Rolling Element Bearings , 1999 .

[50]  Kaisa Simola,et al.  Application of stochastic filtering for lifetime prediction , 2006, Reliab. Eng. Syst. Saf..

[51]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[52]  Peter J. Fleming,et al.  DYNAMIC MODELLING FOR CONDITION MONITORING OF GAS TURBINES: GENETIC ALGORITHMS APPROACH , 2005 .

[53]  Byeng D. Youn,et al.  A Probabilistic Detectability-Based Structural Sensor Network Design Methodology for Prognostics and Health Management , 2010 .

[54]  Rommert Dekker,et al.  Applications of maintenance optimization models : a review and analysis , 1996 .

[55]  Anoushiravan Farshidianfar,et al.  Rolling element bearings multi-fault classification based on the wavelet denoising and support vector machine , 2007 .

[56]  Bo-Suk Yang,et al.  Support vector machine in machine condition monitoring and fault diagnosis , 2007 .

[57]  Enrico Zio,et al.  A data-driven fuzzy approach for predicting the remaining useful life in dynamic failure scenarios of a nuclear system , 2010, Reliab. Eng. Syst. Saf..

[58]  M. Kanehisa,et al.  A knowledge base for predicting protein localization sites in eukaryotic cells , 1992, Genomics.