Computational Framework for Machine Fault Diagnosis with Autoencoder Variants

Fault diagnosis is an integral component of Condition Monitoring systems used in industries. Deep learning techniques have recently been proven to be very effective in handling heterogeneous real time monitoring data. This paper presents a computational framework for machine fault diagnosis based on deep learning approaches and autoencoder variants. The framework includes methods for extraction of time domain and frequency domain features from raw data, training of autoencoders, and finally, detecting the presence of fault(s) using classifiers. A total of four different variants of autoencoders have been tested and analyzed for fault diagnosis framework; additionally, the option of reducing the learning complexity in autoencoder with layer wise feature selection strategy with ITER ranking has also been applied. For validation purpose, four standard fault diagnosis datasets were used. To obtain inferences, statistical tests was performed across all tested feature extraction techniques, autoencoder variants, and classifiers. The analysis suggests that stacked denoising sparse encoder in conjunction with frequency domain features and support vector classifiers gives consistent classification accuracy thus builds effective fault diagnosis system.

[1]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[2]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[3]  N. K. Verma,et al.  Smartphone application for fault recognition , 2012, 2012 Sixth International Conference on Sensing Technology (ICST).

[4]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[5]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Meiqin Liu,et al.  Deep learning neural network for power system fault diagnosis , 2016, CCC 2016.

[7]  Tianrui Li,et al.  Learning features from High Speed Train vibration signals with Deep Belief Networks , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[8]  Rahul Kumar Sevakula,et al.  Assessing Generalization Ability of Majority Vote Point Classifiers , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Honglak Lee,et al.  Deep learning for robust feature generation in audiovisual emotion recognition , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Nishchal K. Verma,et al.  Intelligent condition based monitoring of rotating machines using sparse auto-encoders , 2013, 2013 IEEE Conference on Prognostics and Health Management (PHM).

[11]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[12]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[13]  Vikas Singh,et al.  Deep Learning Architecture for High-Level Feature Generation Using Stacked Auto Encoder for Business Intelligence , 2018 .

[14]  Nishchal K. Verma,et al.  Intelligent Condition Based Monitoring Using Acoustic Signals for Air Compressors , 2016, IEEE Transactions on Reliability.

[15]  Danfeng Xie,et al.  A Hierarchical Deep Neural Network for Fault Diagnosis on Tennessee-Eastman Process , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[16]  Rahul Kumar Sevakula,et al.  Pattern Analysis Framework With Graphical Indices for Condition-Based Monitoring , 2017, IEEE Transactions on Reliability.

[17]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[18]  Dong Yu,et al.  Deep Learning and Its Applications to Signal and Information Processing , 2011 .

[19]  أحمد عامر,et al.  من البيانات الكبيرة إلى البيانات الذكية = From Big Data to Smart Data , 2016 .

[20]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[21]  Byeng D. Youn,et al.  Multi-Sensor Health Diagnosis Using Deep Belief Network Based State Classification , 2011 .

[22]  Huijun Gao,et al.  Data-Based Techniques Focused on Modern Industry: An Overview , 2015, IEEE Transactions on Industrial Electronics.

[23]  Gareth M. James,et al.  Majority vote classifiers: theory and applications , 1998 .

[24]  Cong Wang,et al.  Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings , 2016 .

[25]  Diego Cabrera,et al.  Gearbox fault diagnosis based on deep random forest fusion of acoustic and vibratory signals , 2016 .

[26]  Ulrich Weidmann,et al.  Using Deep Belief Networks for Predicting Railway Operations Failures , 2013 .

[27]  Robert X. Gao,et al.  Learning features from vibration signals for induction motor fault diagnosis , 2016, 2016 International Symposium on Flexible Automation (ISFA).

[28]  Jianfeng Gao,et al.  Deep stacking networks for information retrieval , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[29]  Shahin Hedayati Kia,et al.  Gear fault diagnosis using discrete wavelet transform and deep neural networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[30]  Yan Cui,et al.  Transfer Learning for Molecular Cancer Classification Using Deep Neural Networks , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[31]  Nishchal K. Verma,et al.  Windows mobile and tablet app for acoustic signature based machine health monitoring , 2014, 2014 9th International Conference on Industrial and Information Systems (ICIIS).

[32]  Nishchal K. Verma,et al.  An optimized fault diagnosis method for reciprocating air compressors based on SVM , 2011, 2011 IEEE International Conference on System Engineering and Technology.

[33]  David He,et al.  Full ceramic bearing fault diagnosis using LAMSTAR neural network , 2013, 2013 IEEE Conference on Prognostics and Health Management (PHM).

[34]  Yoshinobu Tamura,et al.  Reliability analysis based on deep learning for fault big data on bug tracking system , 2016, INFOCOM 2016.

[35]  Robert Babuska,et al.  Railway Track Circuit Fault Diagnosis Using Recurrent Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[37]  Andrew D. Ball,et al.  An approach to fault diagnosis of reciprocating compressor valves using Teager-Kaiser energy operator and deep belief networks , 2014, Expert Syst. Appl..

[38]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[39]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[40]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[41]  Yan Cui,et al.  Layerwise feature selection in Stacked Sparse Auto-Encoder for tumor type prediction , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).