Adaptive deep feature learning network with Nesterov momentum and its application to rotating machinery fault diagnosis

Abstract The effective fault diagnosis of rotating machinery is critical to ensure the continuous operation of equipment and is more economical than scheduled maintenance. Traditional signal processing-based and artificial intelligence-based methods, such as wavelet packet transform and support vector machine, have been proved effective in fault diagnosis of rotating machinery, which prevents unexpected machine breakdowns due to the failure of significant components. However, these methods have several disadvantages that make them unable to automatically and effectively extract valid fault features for the effective fault diagnosis of rotating machinery. A novel adaptive learning rate deep belief network combined with Nesterov momentum is developed in this study for rotating machinery fault diagnosis. Nesterov momentum is adopted to replace traditional momentum to enable declining in advance and to improve training performance. Then, an individual adaptive learning rate method is used to select a suitable step length for accelerating descent. To confirm the utility of the proposed deep learning network architecture, two examinations are implemented on datasets from gearbox and locomotive bearing test rigs. Results indicate that the method achieves impressive performance in fault pattern recognition. Comparisons with existing methods are also conducted to demonstrate that the proposed method is more accurate and robust.

[1]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[2]  Xiaoli Zhang,et al.  Intelligent fault diagnosis of roller bearings with multivariable ensemble-based incremental support vector machine , 2015, Knowl. Based Syst..

[3]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[4]  Yue Xie,et al.  Phoneme Recognition Based on Deep Belief Network , 2016, 2016 International Conference on Information System and Artificial Intelligence (ISAI).

[5]  Robert X. Gao,et al.  Wavelets for fault diagnosis of rotary machines: A review with applications , 2014, Signal Process..

[6]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[7]  Fanrang Kong,et al.  Fault diagnosis of rotating machinery based on the statistical parameters of wavelet packet paving and a generic support vector regressive classifier , 2013 .

[8]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[9]  Andrew D. Ball,et al.  An approach to fault diagnosis of reciprocating compressor valves using Teager-Kaiser energy operator and deep belief networks , 2014, Expert Syst. Appl..

[10]  Yaguo Lei,et al.  EEMD method and WNN for fault diagnosis of locomotive roller bearings , 2011, Expert Syst. Appl..

[11]  Ruqiang Yan,et al.  A sparse auto-encoder-based deep neural network approach for induction motor faults classification , 2016 .

[12]  Y. Nesterov A method for unconstrained convex minimization problem with the rate of convergence o(1/k^2) , 1983 .

[13]  Peter W. Tse,et al.  Faulty bearing signal recovery from large noise using a hybrid method based on spectral kurtosis and ensemble empirical mode decomposition , 2012 .

[14]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[15]  Peter W. Tse,et al.  A morphogram with the optimal selection of parameters used in morphological analysis for enhancing the ability in bearing fault diagnosis , 2012 .

[16]  Yaguo Lei,et al.  A Method Based on Multi-Sensor Data Fusion for Fault Detection of Planetary Gearboxes , 2012, Sensors.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Haidong Shao,et al.  Rolling bearing fault diagnosis using an optimization deep belief network , 2015 .

[19]  ZhiQiang Chen,et al.  Gearbox Fault Identification and Classification with Convolutional Neural Networks , 2015 .

[20]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[21]  Yu Zhang,et al.  Incipient Fault Diagnosis of Roller Bearing Using Optimized Wavelet Transform Based Multi-Speed Vibration Signatures , 2017, IEEE Access.

[22]  Zhipeng Feng,et al.  Time-varying demodulation analysis for rolling bearing fault diagnosis under variable speed conditions , 2017 .

[23]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[24]  Pingfeng Wang,et al.  Failure diagnosis using deep belief learning based health state classification , 2013, Reliab. Eng. Syst. Saf..

[25]  Diego Cabrera,et al.  Multimodal deep support vector classification with homologous features and its application to gearbox fault diagnosis , 2015, Neurocomputing.

[26]  Han Xiao,et al.  A novel identification method of Volterra series in rotor-bearing system for fault diagnosis , 2016 .

[27]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[28]  Fiorenzo Filippetti,et al.  Recent developments of induction motor drives fault diagnosis using AI techniques , 2000, IEEE Trans. Ind. Electron..

[29]  Fanrang Kong,et al.  Bearing fault diagnosis based on an improved morphological filter , 2016 .

[30]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[31]  Qiao Hu,et al.  Fault diagnosis of rotating machinery based on multiple ANFIS combination with GAs , 2007 .

[32]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[33]  Qingsong Xu,et al.  Improved shuffled frog leaping algorithm-based BP neural network and its application in bearing early fault diagnosis , 2015, Neural Computing and Applications.

[34]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[35]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[36]  P. Konar,et al.  Bearing fault detection of induction motor using wavelet and Support Vector Machines (SVMs) , 2011, Appl. Soft Comput..