Intelligent Fault Diagnosis of Rotary Machinery by Convolutional Neural Network with Automatic Hyper-Parameters Tuning Using Bayesian Optimization

Intelligent fault diagnosis can be related to applications of machine learning theories to machine fault diagnosis. Although there is a large number of successful examples, there is a gap in the optimization of the hyper-parameters of the machine learning model, which ultimately has a major impact on the performance of the model. Machine learning experts are required to configure a set of hyper-parameter values manually. This work presents a convolutional neural network based data-driven intelligent fault diagnosis technique for rotary machinery which uses model with optimized hyper-parameters and network structure. The proposed technique input raw three axes accelerometer signal as high definition 1-D data into deep learning layers with optimized hyper-parameters. Input is consisted of wide 12,800 × 1 × 3 vibration signal matrix. Model learning phase includes Bayesian optimization that optimizes hyper-parameters of the convolutional neural network. Finally, by using a Convolutional Neural Network (CNN) model with optimized hyper-parameters, classification in one of the 8 different machine states and 2 rotational speeds can be performed. This study accomplished the effective classification of different rotary machinery states in different rotational speeds using optimized convolutional artificial neural network for classification of raw three axis accelerometer signal input. Overall classification accuracy of 99.94% on evaluation set is obtained with the CNN model based on 19 layers. Additionally, more data are collected on the same machine with altered bearings to test the model for overfitting. Result of classification accuracy of 100% on second evaluation set has been achieved, proving the potential of using the proposed technique.

[1]  Peter I. Frazier,et al.  A Tutorial on Bayesian Optimization , 2018, ArXiv.

[2]  Jasper Snoek,et al.  Bayesian Optimization with Unknown Constraints , 2014, UAI.

[3]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[4]  Hang Lei,et al.  Hyperparameter Optimization for Machine Learning Models Based on Bayesian Optimization , 2019 .

[5]  Shuhui Wang,et al.  Convolutional neural network-based hidden Markov models for rolling element bearing fault identification , 2017, Knowl. Based Syst..

[6]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[7]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[8]  Jyoti K. Sinha,et al.  A future possibility of vibration based condition monitoring of rotating machines , 2013 .

[9]  A. Helen Victoria,et al.  Automatic tuning of hyperparameters using Bayesian optimization , 2020, Evolving Systems.

[10]  Hong Zhu,et al.  Hyper-Parameter Optimization: A Review of Algorithms and Applications , 2020, ArXiv.

[11]  Robert X. Gao,et al.  Learning features from vibration signals for induction motor fault diagnosis , 2016, 2016 International Symposium on Flexible Automation (ISFA).

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[14]  Nurshazlyn Mohd Aszemi,et al.  Hyperparameter Optimization in Convolutional Neural Network using Genetic Algorithms , 2019, International Journal of Advanced Computer Science and Applications.

[15]  Qingbo He,et al.  Energy-Fluctuated Multiscale Feature Learning With Deep ConvNet for Intelligent Spindle Bearing Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.

[16]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[17]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[18]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[19]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[20]  Peter Korošec,et al.  Insights into Exploration and Exploitation Power of Optimization Algorithm Using DSCTool , 2020, Mathematics.

[21]  Bruno Betrò,et al.  Bayesian methods in global optimization , 1991, J. Glob. Optim..

[22]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[23]  Hee-Jun Kang,et al.  Rolling element bearing fault diagnosis using convolutional neural network and vibration image , 2019, Cognitive Systems Research.

[24]  Goran Nenadic,et al.  Machine learning methods for wind turbine condition monitoring: A review , 2019, Renewable Energy.

[25]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[26]  Yaguo Lei,et al.  Intelligent Fault Diagnosis and Remaining Useful Life Prediction of Rotating Machinery , 2016 .

[27]  Serkan Kiranyaz,et al.  A Generic Intelligent Bearing Fault Diagnosis System Using Compact Adaptive 1D CNN Classifier , 2018, Journal of Signal Processing Systems.

[28]  Wei Gao,et al.  An Intelligent Fault Diagnosis Method for Bearings with Variable Rotating Speed Based on Pythagorean Spatial Pyramid Pooling CNN , 2018, Sensors.

[29]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[30]  Dragutin Lisjak,et al.  Fault Diagnosis of Rotary Machines Using Deep Convolutional Neural Network with Wide Three Axis Vibration Signal Input , 2020, Sensors.

[31]  Shunming Li,et al.  An intelligent fault diagnosis method of rotating machinery based on deep neural networks and time-frequency analysis , 2018, Journal of Vibroengineering.

[32]  Jianjun Hu,et al.  An Ensemble Deep Convolutional Neural Network Model with Improved D-S Evidence Fusion for Bearing Fault Diagnosis , 2017, Sensors.

[33]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[34]  Wei Gao,et al.  A Novel Fault Diagnosis Method for Rotating Machinery Based on a Convolutional Neural Network , 2018, Sensors.

[35]  Hee-Jun Kang,et al.  A survey on Deep Learning based bearing fault diagnosis , 2019, Neurocomputing.

[36]  Takehisa Yairi,et al.  A review on the application of deep learning in system health management , 2018, Mechanical Systems and Signal Processing.

[37]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[38]  Joaquin Vanschoren,et al.  Importance of Tuning Hyperparameters of Machine Learning Algorithms , 2020, ArXiv.

[39]  Xiaoqiang Yang,et al.  Research on fault diagnosis of hydraulic pump using convolutional neural network , 2016 .

[40]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[41]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.