A Stacked Autoencoder Neural Network based Automated Feature Extraction Method for Anomaly detection in On-line Condition Monitoring

Condition monitoring is one of the routine tasks in all major process industries. The mechanical parts such as a motor, gear, bearing are the major components of a process industry and any fault in them may cause a total shutdown of the whole process, which may result in serious losses. Therefore it is very crucial to predict any approaching defects before its occurrence. Several methods exist for this purpose and many research are being carried out for better and efficient models. However, most of them are based on the processing of raw sensor signals, which is tedious and expensive. Recently, there has been an increase in the feature based condition monitoring, where only the useful features are extracted from the raw signals and interpreted for the prediction of the fault. Most of these are handcrafted features, where these are manually obtained based on the nature of the raw data. This of course requires the prior knowledge of the nature of data and related processes. This limits the feature extraction process. However, recent development in the autoencoder based feature extraction method provides an alternative to the traditional handcrafted approaches; however, they have mostly been confined in the area of image and audio processing. In this work, we have developed an automated feature extraction method for on-line condition monitoring based on the stack of the traditional autoencoder and an on-line sequential extreme learning machine (OSELM) network. The performance of this method is comparable to that of the traditional feature extraction approaches. The method can achieve 100% detection accuracy for determining the bearing health states of NASA bearing dataset. The simple design of this method is promising for the easy hardware implementation of Internet of Things (IoT) based prognostics solutions.

[1]  Mahmood Yousefi-Azar,et al.  Autoencoder-based feature learning for cyber security applications , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[2]  Nirwan Ansari,et al.  EdgeIoT: Mobile Edge Computing for the Internet of Things , 2016, IEEE Communications Magazine.

[3]  Jing Tian,et al.  Motor Bearing Fault Detection Using Spectral Kurtosis-Based Feature Extraction Coupled With K-Nearest Neighbor Distance Analysis , 2016, IEEE Transactions on Industrial Electronics.

[4]  Aruna Tiwari,et al.  On the Construction of Extreme Learning Machine for One Class Classifier , 2016 .

[5]  Wahyu Caesarendra,et al.  A Review of Feature Extraction Methods in Vibration-Based Condition Monitoring and Its Application for Degradation Trend Estimation of Low-Speed Slew Bearing , 2017 .

[6]  Han Ding,et al.  New statistical moments for the detection of defects in rolling element bearings , 2005 .

[7]  Alaa Mohamed Riad,et al.  Prognostics: a literature review , 2016, Complex & Intelligent Systems.

[8]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[9]  S. P. Harsha,et al.  Failure Evaluation of Ball Bearing for Prognostics , 2016 .

[10]  R. Fernando,et al.  Efficient strategies for leave-one-out cross validation for genomic best linear unbiased prediction , 2017, Journal of Animal Science and Biotechnology.

[11]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[12]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[15]  Haizhou Li,et al.  A data-driven prognostics framework for tool remaining useful life estimation in tool condition monitoring , 2017, 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[16]  Christopher Durugbo,et al.  Analysing RMS and peak values of vibration signals for condition monitoring of wind turbine gearboxes , 2016 .

[17]  Arindam Basu,et al.  VLSI Extreme Learning Machine: A Design Space Exploration , 2017, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[18]  D. An,et al.  Data-Driven Prognostics , 2017 .

[19]  Erik Marchi,et al.  Sparse Autoencoder-Based Feature Transfer Learning for Speech Emotion Recognition , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[20]  Brigitte Chebel-Morello,et al.  PRONOSTIA : An experimental platform for bearings accelerated degradation tests. , 2012 .

[21]  Amparo Alonso-Betanzos,et al.  Fault Prognosis of Mechanical Components Using On-Line Learning Neural Networks , 2010, ICANN.

[22]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[23]  Enrico Zio,et al.  Prediction of peak values in time series data for prognostics of critical components in nuclear power plants , 2016 .

[24]  Ram Pal Singh,et al.  Online Sequential Extreme Learning Machine for Watermarking , 2015 .

[25]  Arindam Basu,et al.  Hardware architecture for large parallel array of Random Feature Extractors applied to image recognition , 2017, Neurocomputing.

[26]  Maria Chiara Leva,et al.  Cost benefit evaluation of maintenance options for aging equipment using monetised risk values: A practical application , 2018 .

[27]  Chenwei Deng,et al.  A fast learning algorithm for multi-layer extreme learning machine , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[28]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[29]  Jean-Luc Dugelay,et al.  Learned vs. Hand-Crafted Features for Pedestrian Gender Recognition , 2015, ACM Multimedia.

[30]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[31]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Michael Buchholz,et al.  Health diagnosis and remaining useful life prognostics of lithium-ion batteries using data-driven methods , 2013 .

[33]  Aruna Tiwari,et al.  On the construction of extreme learning machine for online and offline one-class classification - An expanded toolbox , 2017, Neurocomputing.

[34]  K. Medjaher,et al.  Feature Extraction and Evaluation for Health Assessment and Failure Prognostics , 2012 .

[35]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[36]  Konstantin Eckle,et al.  A comparison of deep networks with ReLU activation function and linear spline-type methods , 2018, Neural Networks.

[37]  Abien Fred Agarap Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[38]  Wei Zhao,et al.  Ensemble of model-based and data-driven prognostic approaches for reliability prediction , 2017, 2017 Prognostics and System Health Management Conference (PHM-Harbin).