Feature learning for fault detection in high-dimensional condition monitoring signals

Complex industrial systems are continuously monitored by a large number of heterogeneous sensors. The diversity of their operating conditions and the possible fault types make it impossible to collect enough data for learning all the possible fault patterns. This article proposes an integrated automatic unsupervised feature learning and one-class classification for fault detection that uses data on healthy conditions only for its training. The approach is based on stacked extreme learning machines (namely hierarchical extreme learning machines) and comprises an autoencoder, performing unsupervised feature learning, stacked with a one-class classifier monitoring the distance of the test data to the training healthy class, thereby assessing the health of the system. This study provides a comprehensive evaluation of hierarchical extreme learning machines fault detection capability compared to other machine learning approaches, such as stand-alone one-class classifiers (extreme learning machines and support vector machines); these same one-class classifiers combined with traditional dimensionality reduction methods (principal component analysis) and a deep belief network. The performance is first evaluated on a synthetic dataset that encompasses typical characteristics of condition monitoring data. Subsequently, the approach is evaluated on a real case study of a power plant fault. The proposed algorithm for fault detection, combining feature learning with the one-class classifier, demonstrates a better performance, particularly in cases where condition monitoring data contain several non-informative signals.

[1]  Bin Zhang,et al.  Lithium-ion battery remaining useful life prediction with Deep Belief Network and Relevance Vector Machine , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[2]  Yang Hu,et al.  Deep Health Indicator Extraction: A Method based on Auto-encoders and Extreme Learning Machines , 2016, Annual Conference of the PHM Society.

[3]  Wolfram Burgard,et al.  Deep Feature Learning for Acoustics-Based Terrain Classification , 2015, ISRR.

[4]  VincentPascal,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010 .

[5]  Victor C. M. Leung,et al.  Extreme Learning Machines [Trends & Controversies] , 2013, IEEE Intelligent Systems.

[6]  Don R. Hush,et al.  Network constraints and multi-objective optimization for one-class classification , 1996, Neural Networks.

[7]  R. Tibshirani,et al.  Extended Comparisons of Best Subset Selection, Forward Stepwise Selection, and the Lasso , 2017, 1707.08692.

[8]  Li Li,et al.  Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health Records , 2016, Scientific Reports.

[9]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[10]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[11]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[12]  Olga Fink,et al.  Deep Feature Learning Network for Fault Detection and Isolation , 2017 .

[13]  Olga Fink,et al.  Fleet PHM for Critical Systems: Bi-level Deep Learning Approach for Fault Detection , 2018 .

[14]  Jun Miao,et al.  One-Class Classification with Extreme Learning Machine , 2015 .

[15]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[16]  Guang-Bin Huang,et al.  What are Extreme Learning Machines? Filling the Gap Between Frank Rosenblatt’s Dream and John von Neumann’s Puzzle , 2015, Cognitive Computation.

[17]  Fuchun Sun,et al.  Building feature space of extreme learning machine with sparse denoising stacked-autoencoder , 2016, Neurocomputing.

[18]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[19]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[20]  Yaonan Wang,et al.  Autoencoder With Invertible Functions for Dimension Reduction and Image Reconstruction , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[21]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[22]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Peng Li,et al.  Deep Convolutional Computation Model for Feature Learning on Big Data in Internet of Things , 2018, IEEE Transactions on Industrial Informatics.

[24]  Takehisa Yairi,et al.  A review on the application of deep learning in system health management , 2018, Mechanical Systems and Signal Processing.

[25]  Hongming Zhou,et al.  Extreme Learning Machines [Trends & Controversies] , 2013 .

[26]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[27]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[28]  Robert X. Gao,et al.  Deep Learning for Improved System Remaining Life Prediction , 2018 .

[29]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[30]  Taehoon Lee,et al.  Semi-supervised Learning with Deep Generative Models for Asset Failure Prediction , 2017, ArXiv.

[31]  Joachim M. Buhmann,et al.  Wheel Defect Detection With Machine Learning , 2018, IEEE Transactions on Intelligent Transportation Systems.

[32]  Lovekesh Vig,et al.  Multi-Sensor Prognostics using an Unsupervised Health Index based on LSTM Encoder-Decoder , 2016, ArXiv.

[33]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Ruqiang Yan,et al.  Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks , 2017, Sensors.