Raw vibration signal pattern recognition with automatic hyper-parameter-optimized convolutional neural network for bearing fault diagnosis

Bearing fault diagnosis is of great significance for evaluating the reliability of machines because bearings are the critical components in rotating machinery and are prone to failure. Because of non-stationarity and the low signal-noise rate of raw vibration signals, traditional fault diagnosis methods often construct representative fault features via the technologies of feature engineering. These methods rely heavily on expertise and are inadequate in actual applications. Recently, methods based on convolutional neural networks have been studied extensively to relieve the demands of hand-crafted feature extraction and feature selection. However, the raw vibration signal is rarely taken as a direct input. This study combines a convolutional neural network with automatic hyper-parametric optimization and proposes two deep learning models for time-series pattern recognition to achieve “end-to-end” bearing fault diagnosis: a one-dimensional-convolutional neural network and a dilated convolutional neural network. The architecture of the two models are tweaked by automatic optimization rather than manual trial or grid search. Further, we try to figure out the inner operating mechanism of the proposed methods by visualizing the automatically learned features. The proposed methods are applied to diagnose roller bearing faults on a benchmark experiment and a prototype experiment. The results verify that our methods can achieve better performance than other intelligent methods via a Gaussian-noise test.

[1]  Djamel Benazzouz,et al.  Multi-fault diagnosis of rolling bearing using fuzzy entropy of empirical mode decomposition, principal component analysis, and SOM neural network , 2018, Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science.

[2]  Jun Yu,et al.  Combined flow graphs and normal naive Bayesian classifier for fault diagnosis of gear box , 2016 .

[3]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[4]  Francesco Ferracuti,et al.  Statistical Spectral Analysis for Fault Diagnosis of Rotating Machines , 2018, IEEE Transactions on Industrial Electronics.

[5]  Ming J. Zuo,et al.  Fault diagnosis for planetary gearboxes using multi-criterion fusion feature selection framework , 2013 .

[6]  Huan Liu,et al.  Feature selection for classification: A review , 2014 .

[7]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[8]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[9]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[10]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[11]  Satish C. Sharma,et al.  Fault diagnosis of ball bearings using machine learning methods , 2011, Expert Syst. Appl..

[12]  Jianfeng Zhao,et al.  Learning deep features to recognise speech emotion using merged deep CNN , 2018, IET Signal Process..

[13]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[14]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[15]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[16]  Wei Shi,et al.  Dilated convolution neural network with LeakyReLU for environmental sound classification , 2017, 2017 22nd International Conference on Digital Signal Processing (DSP).

[17]  Jong-Myon Kim,et al.  A Hybrid Feature Model and Deep-Learning-Based Bearing Fault Diagnosis , 2017, Sensors.

[18]  David D. Cox,et al.  Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures , 2013, ICML.

[19]  Robert B. Randall,et al.  Rolling element bearing diagnostics using the Case Western Reserve University data: A benchmark study , 2015 .

[20]  Yong-Hwa Kim,et al.  Intelligent fault detection using raw vibration signals via dilated convolutional neural networks , 2018, The Journal of Supercomputing.

[21]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[22]  Cong Wang,et al.  Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings , 2016 .

[23]  Robert B. Randall,et al.  Rolling element bearing diagnostics—A tutorial , 2011 .

[24]  Cong Wang,et al.  Fault feature extraction of rolling element bearings based on wavelet packet transform and sparse representation theory , 2018, J. Intell. Manuf..

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Haidong Shao,et al.  Rolling bearing fault diagnosis using an optimization deep belief network , 2015 .

[27]  Ming Liang,et al.  Bearing fault diagnosis under unknown time-varying rotational speed conditions via multiple time-frequency curve extraction , 2018 .

[28]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[29]  Qing Zhang,et al.  A two-stage feature selection and intelligent fault diagnosis method for rotating machinery using hybrid filter and wrapper method , 2018, Neurocomputing.

[30]  Gerald Penn,et al.  Convolutional Neural Networks for Speech Recognition , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[31]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[32]  Hongkai Jiang,et al.  An adaptive deep convolutional neural network for rolling bearing fault diagnosis , 2017 .

[33]  Boualem Boashash,et al.  1-D CNNs for structural damage detection: Verification on a structural health monitoring benchmark data , 2018, Neurocomputing.

[34]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[35]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.