Convolutional Neural Network in Intelligent Fault Diagnosis Toward Rotatory Machinery

Rotating machinery is of vital importance in the field of engineering, including aviation and navigation. Its failure will lead to severe loss to personnel safety and the stability of the equipment system. It is a long way to investigate the relevant fault diagnosis method, especially the intelligent fault diagnosis method on the basis of deep learning. In consideration of the limitations of traditional fault diagnosis approaches based on shallow layer network structure, the methods based on deep neural network (DNN) are worthy of thorough exploration. As a common DNN with special structure, deep convolutional neural network is of great concern in intelligent fault diagnosis due to its advantages in processing nonlinear problems. This review will play an emphasis on convolutional neural network (CNN). The basic structure and principle are introduced. The applications of CNN-based fault diagnosis method in rotating machinery are summarized and analyzed. Furthermore, the diagnosis performance and potential mechanism from different CNN methods are discussed. In the end, this review is highlighted on the challenges and the potential key points in research on novel intelligent fault diagnosis strategies. The corresponding analysis and discussion will provide some references and lay the foundation for the investigation in related fields.

[1]  Ming Zhao,et al.  A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox , 2017 .

[2]  Kun Yu,et al.  A Combined Polynomial Chirplet Transform and Synchroextracting Technique for Analyzing Nonstationary Signals of Rotating Machinery , 2020, IEEE Transactions on Instrumentation and Measurement.

[3]  Peng Chen,et al.  Vibration-Based Intelligent Fault Diagnosis for Roller Bearings in Low-Speed Rotating Machinery , 2018, IEEE Transactions on Instrumentation and Measurement.

[4]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[5]  Chao Liu,et al.  A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults , 2019, Knowl. Based Syst..

[6]  Shi Li,et al.  A novel convolutional neural network based fault recognition method via image fusion of multi-vibration-signals , 2019, Comput. Ind..

[7]  Zihan Zhang,et al.  Compound Fault Diagnosis of Gearboxes via Multi-label Convolutional Neural Network and Wavelet Transform , 2019, Comput. Ind..

[8]  Yangyang Wang,et al.  Signal-Based Intelligent Hydraulic Fault Diagnosis Methods: Review and Prospects , 2019, Chinese Journal of Mechanical Engineering.

[9]  Chao Liu,et al.  Learning transferable features in deep convolutional neural networks for diagnosing unseen machine conditions. , 2019, ISA transactions.

[10]  Konstantinos Gryllias,et al.  A deep learning method for bearing fault diagnosis based on Cyclic Spectral Coherence and Convolutional Neural Networks , 2020 .

[11]  Lei Deng,et al.  Fault diagnosis for a wind turbine transmission system based on manifold learning and Shannon wavelet support vector machine , 2014 .

[12]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[13]  K. A. Adu-Poku,et al.  Flow theory in the side chambers of the radial pumps: A review , 2020 .

[14]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[15]  Yong Zhu,et al.  Extraction method for signal effective component based on extreme-point symmetric mode decomposition and Kullback–Leibler divergence , 2019, Journal of the Brazilian Society of Mechanical Sciences and Engineering.

[16]  Shunming Li,et al.  Batch-normalized deep neural networks for achieving fast intelligent fault diagnosis of machines , 2019, Neurocomputing.

[17]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[18]  Ming J. Zuo,et al.  Joint amplitude and frequency demodulation analysis based on local mean decomposition for fault diagnosis of planetary gearboxes , 2013 .

[19]  Janani Shruti Rapur,et al.  Automation of multi-fault diagnosing of centrifugal pumps using multi-class support vector machine with vibration and motor current signals in frequency domain , 2018 .

[20]  Yi Wang,et al.  Deep balanced domain adaptation neural networks for fault diagnosis of planetary gearboxes with limited labeled data , 2020 .

[21]  Weiming Shen,et al.  Online Fault Diagnosis Method Based on Transfer Convolutional Neural Networks , 2020, IEEE Transactions on Instrumentation and Measurement.

[22]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[23]  Xin Huang,et al.  Intelligent fault diagnosis method of planetary gearboxes based on convolution neural network and discrete wavelet transform , 2019, Comput. Ind..

[24]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[25]  Jianbo Yu,et al.  A selective deep stacked denoising autoencoders ensemble with negative correlation learning for gearbox fault diagnosis , 2019, Comput. Ind..

[26]  Sethuraman Panchanathan,et al.  Deep-Learning Systems for Domain Adaptation in Computer Vision: Learning Transferable Feature Representations , 2017, IEEE Signal Processing Magazine.

[27]  Hee-Jun Kang,et al.  Rolling element bearing fault diagnosis using convolutional neural network and vibration image , 2019, Cognitive Systems Research.

[28]  Baeksuk Chu,et al.  Development of Fault Diagnosis Technology Based on Spectrum Analysis of Acceleration Signal for Paper Cup Forming Machine , 2016 .

[29]  Haibo He,et al.  Stacked Multilevel-Denoising Autoencoders: A New Representation Learning Approach for Wind Turbine Gearbox Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.

[30]  Jing Yuan,et al.  Multiwavelet transform and its applications in mechanical fault diagnosis – A review , 2014 .

[31]  Jianjun Hu,et al.  An Ensemble Deep Convolutional Neural Network Model with Improved D-S Evidence Fusion for Bearing Fault Diagnosis , 2017, Sensors.

[32]  Minqiang Xu,et al.  A fault diagnosis scheme for rotating machinery using hierarchical symbolic analysis and convolutional neural network. , 2019, ISA transactions.

[33]  Janani Shruti Rapur,et al.  On-line Time Domain Vibration and Current Signals Based Multi-fault Diagnosis of Centrifugal Pumps Using Support Vector Machines , 2018, Journal of Nondestructive Evaluation.

[34]  Takehisa Yairi,et al.  A review on the application of deep learning in system health management , 2018, Mechanical Systems and Signal Processing.

[35]  Niaoqing Hu,et al.  A deep convolutional neural network based fusion method of two-direction vibration signal data for health state identification of planetary gearboxes , 2019, Measurement.

[36]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[37]  Shijie Deng.  Fault Diagnosis Technology of Plunger Pump based on EMMD-Teager , 2019 .

[38]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[39]  Haidong Shao,et al.  Electric Locomotive Bearing Fault Diagnosis Using a Novel Convolutional Deep Belief Network , 2018, IEEE Transactions on Industrial Electronics.

[40]  Shuhui Wang,et al.  A minimum entropy deconvolution-enhanced convolutional neural networks for fault diagnosis of axial piston pumps , 2019, Soft Computing.

[41]  David He,et al.  Gear pitting fault diagnosis with mixed operating conditions based on adaptive 1D separable convolution with residual connection , 2020 .

[42]  Lei Wang,et al.  Comparison of random forest, artificial neural networks and support vector machine for intelligent diagnosis of rotating machinery , 2018, Trans. Inst. Meas. Control.

[43]  Liang Gao,et al.  A New Two-Level Hierarchical Diagnosis Network Based on Convolutional Neural Network , 2020, IEEE Transactions on Instrumentation and Measurement.

[44]  David Zhang,et al.  LSDT: Latent Sparse Domain Transfer Learning for Visual Adaptation , 2016, IEEE Transactions on Image Processing.

[45]  Minqiang Xu,et al.  Symbolic Important Point Perceptually and Hidden Markov Model Based Hydraulic Pump Fault Diagnosis Method , 2018, Sensors.

[46]  Huaqing Wang,et al.  Underdetermined Source Separation of Bearing Faults Based on Optimized Intrinsic Characteristic-Scale Decomposition and Local Non-Negative Matrix Factorization , 2019, IEEE Access.

[47]  Xinyu Shao,et al.  Stacked pruning sparse denoising autoencoder based intelligent fault diagnosis of rolling bearings , 2020, Appl. Soft Comput..

[48]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[49]  Konstantinos Gryllias,et al.  Mechanical fault diagnosis using Convolutional Neural Networks and Extreme Learning Machine , 2019, Mechanical Systems and Signal Processing.

[50]  Qingbo He,et al.  Energy-Fluctuated Multiscale Feature Learning With Deep ConvNet for Intelligent Spindle Bearing Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.

[51]  Yang Xiao,et al.  Fault Diagnosis Using a Joint Model Based on Sparse Representation and SVM , 2016, IEEE Transactions on Instrumentation and Measurement.

[52]  Wanlu Jiang,et al.  Amplitude-frequency characteristics analysis for vertical vibration of hydraulic AGC system under nonlinear action , 2019, AIP Advances.

[53]  Jong-Myon Kim,et al.  Automated bearing fault diagnosis scheme using 2D representation of wavelet packet transform and deep convolutional neural network , 2019, Comput. Ind..

[54]  Li Deng,et al.  A tutorial survey of architectures, algorithms, and applications for deep learning , 2014, APSIPA Transactions on Signal and Information Processing.

[55]  Yang Song,et al.  Improving the Robustness of Deep Neural Networks via Stability Training , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Yan Han,et al.  An enhanced convolutional neural network with enlarged receptive fields for fault diagnosis of planetary gearboxes , 2019, Comput. Ind..

[57]  Liang Guo,et al.  A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines , 2018, Neurocomputing.

[58]  Steven X. Ding,et al.  Real-time fault diagnosis and fault-tolerant control , 2015, IEEE Transactions on Industrial Electronics.

[59]  Pengcheng Jiang,et al.  Intelligent fault diagnosis of rotating machinery based on one-dimensional convolutional neural network , 2019, Comput. Ind..

[60]  Helio Fiori de Castro,et al.  Uncertainty quantification in deep convolutional neural network diagnostics of journal bearings with ovalization fault , 2020 .

[61]  Ming J. Zuo,et al.  Vibration signal models for fault diagnosis of planetary gearboxes , 2012 .

[62]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[63]  Ming J. Zuo,et al.  A windowing and mapping strategy for gear tooth fault detection of a planetary gearbox , 2016 .

[64]  Myeongsu Kang,et al.  Deep Residual Networks With Dynamically Weighted Wavelet Coefficients for Fault Diagnosis of Planetary Gearboxes , 2018, IEEE Transactions on Industrial Electronics.

[65]  Awais Ahmad,et al.  Deep learning in big data Analytics: A comparative study , 2017, Comput. Electr. Eng..

[66]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[67]  Zhijun Wang,et al.  Feature Extraction Method for Hydraulic Pump Fault Signal Based on Improved Empirical Wavelet Transform , 2019, Processes.

[68]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[69]  M S Safizadeh,et al.  Pump cavitation detection through fusion of support vector machine classifier data associated with vibration and motor current signature , 2017 .

[70]  Xinjun Peng,et al.  A spheres-based support vector machine for pattern classification , 2017, Neural Computing and Applications.

[71]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[72]  Yong Zhu,et al.  Deep Learning-Based Intelligent Fault Diagnosis Methods Toward Rotating Machinery , 2020, IEEE Access.

[73]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[74]  Shibin Wang,et al.  Time-frequency atoms-driven support vector machine method for bearings incipient fault diagnosis , 2016 .

[75]  Yong Zhu,et al.  Fault Diagnosis Method for Hydraulic Directional Valves Integrating PCA and XGBoost , 2019, Processes.

[76]  Fangyi Wan,et al.  Rotating machinery fault diagnosis based on convolutional neural network and infrared thermal imaging , 2020, Chinese Journal of Aeronautics.

[77]  Ying Zhang,et al.  An enhanced convolutional neural network for bearing fault diagnosis based on time–frequency image , 2020, Measurement.

[78]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[79]  Weidong Shi,et al.  Numerical and experimental study on the pressure fluctuation, vibration, and noise of multistage pump with radial diffuser , 2018, Journal of the Brazilian Society of Mechanical Sciences and Engineering.

[80]  Yan Han,et al.  Multi-level wavelet packet fusion in dynamic ensemble convolutional neural network for fault diagnosis , 2018, Measurement.

[81]  Yingkui Gu,et al.  A deep convolutional neural networks model for intelligent fault diagnosis of a gearbox under different operational conditions , 2019, Measurement.

[82]  Xiaoqiang Yang,et al.  Research on fault diagnosis of hydraulic pump using convolutional neural network , 2016 .

[83]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[84]  Bernard Kamsu-Foguem,et al.  Deep neural networks with transfer learning in millet crop images , 2019, Comput. Ind..

[85]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[86]  Chao Liu,et al.  Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application , 2018, ISA transactions.

[87]  Theodoros Loutas,et al.  Rolling element bearings diagnostics using the Symbolic Aggregate approXimation , 2015 .

[88]  J. Watton,et al.  Axial piston pump grooved slipper analysis by CFD simulation of three-dimensional NVS equation in cylindrical coordinates , 2009 .

[89]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[90]  Steven Euijong Whang,et al.  A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective , 2018, IEEE Transactions on Knowledge and Data Engineering.

[91]  Binqiang Chen,et al.  An Intelligent Gear Fault Diagnosis Methodology Using a Complex Wavelet Enhanced Convolutional Neural Network , 2017, Materials.

[92]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[93]  Hongkai Jiang,et al.  An adaptive deep convolutional neural network for rolling bearing fault diagnosis , 2017 .

[94]  Min Xia,et al.  Fault Diagnosis for Rotating Machinery Using Multiple Sensors and Convolutional Neural Networks , 2018, IEEE/ASME Transactions on Mechatronics.

[95]  Huan Wang,et al.  A Novel Deeper One-Dimensional CNN With Residual Learning for Fault Diagnosis of Wheelset Bearings in High-Speed Trains , 2019, IEEE Access.

[96]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[97]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[98]  Jing Yuan,et al.  Wavelet transform based on inner product in fault diagnosis of rotating machinery: A review , 2016 .

[99]  Jiangtao Wen,et al.  Intelligent Bearing Fault Diagnosis Method Combining Compressed Data Acquisition and Deep Learning , 2018, IEEE Transactions on Instrumentation and Measurement.

[100]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[101]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[102]  Lei Zeng,et al.  Bearing fault diagnosis with varying conditions using angular domain resampling technology, SDP and DCNN , 2020 .

[103]  Tara N. Sainath,et al.  Deep Convolutional Neural Networks for Large-scale Speech Tasks , 2015, Neural Networks.

[104]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[105]  Biao Wang,et al.  LiftingNet: A Novel Deep Learning Network With Layerwise Feature Learning From Noisy Mechanical Data for Fault Classification , 2018, IEEE Transactions on Industrial Electronics.

[106]  Qinkai Han,et al.  Vibration based condition monitoring and fault diagnosis of wind turbine planetary gearbox: A review , 2019, Mechanical Systems and Signal Processing.

[107]  Wanlu Jiang,et al.  Bifurcation Characteristic Research on the Load Vertical Vibration of a Hydraulic Automatic Gauge Control System , 2019, Processes.

[108]  Mir Mohammad Ettefagh,et al.  Diagnosis of combined faults in Rotary Machinery by Non-Naive Bayesian approach , 2017 .

[109]  Chuang Sun,et al.  Discriminative Deep Belief Networks with Ant Colony Optimization for Health Status Assessment of Machine , 2017, IEEE Transactions on Instrumentation and Measurement.

[110]  Sushil Kumar,et al.  The effect of piston grooves performance in an axial piston pumps via CFD analysis , 2013 .

[111]  Peng Fan,et al.  A sparse stacked denoising autoencoder with optimized transfer learning applied to the fault diagnosis of rolling bearings , 2019, Measurement.

[112]  Haidong Shao,et al.  An enhancement deep feature fusion method for rotating machinery fault diagnosis , 2017, Knowl. Based Syst..

[113]  Fang Deng,et al.  Sensor Multifault Diagnosis With Improved Support Vector Machines , 2017, IEEE Transactions on Automation Science and Engineering.

[114]  Xinyu Li,et al.  A semi-supervised convolutional neural network-based method for steel surface defect recognition , 2020, Robotics Comput. Integr. Manuf..

[115]  Yaguo Lei,et al.  Applications of machine learning to machine fault diagnosis: A review and roadmap , 2020 .

[116]  Jianbin Xiong,et al.  Fault Diagnosis of Rotation Machinery Based on Support Vector Machine Optimized by Quantum Genetic Algorithm , 2018, IEEE Access.

[117]  Xinlei Wang,et al.  Gradual fault early stage diagnosis for air source heat pump system using deep learning techniques , 2019, International Journal of Refrigeration.