Data Preprocessing Techniques in Convolutional Neural Network Based on Fault Diagnosis Towards Rotating Machinery

Rotating machinery plays a critical role in many significant fields. However, the unpredictable machinery faults may lead to the severe damage and losses. Hence, it is of great value to explore the precise approaches for fault diagnosis. With the development of the intelligent fault diagnosis methods based on deep learning, convolutional neural network (CNN) has aroused the attention of researchers in machinery fault diagnosis. In the light of the reduction of difficulty in feature learning and the improvement of final diagnosis accuracy, data preprocessing is necessary and crucial in CNN-based fault diagnosis methods. This review focuses on CNN-based fault diagnosis approaches in rotating machinery. Firstly, data preprocessing methods are overviewed. Then, we emphatically analyze and discuss several main techniques applied in CNN-based intelligent diagnosis, principally including the fast Fourier transform, wavelet transform, data augmentation, S-transform, and cyclic spectral analysis. Finally, the potential challenges and research objects are prospected on data preprocessing in intelligent fault diagnosis of rotary machinery.

[1]  Liang Gao,et al.  A New Two-Level Hierarchical Diagnosis Network Based on Convolutional Neural Network , 2020, IEEE Transactions on Instrumentation and Measurement.

[2]  Xiaoqi Wang,et al.  A novel method of combining nonlinear frequency spectrum and deep learning for complex system fault diagnosis , 2020 .

[3]  Myeongsu Kang,et al.  Deep Residual Networks With Dynamically Weighted Wavelet Coefficients for Fault Diagnosis of Planetary Gearboxes , 2018, IEEE Transactions on Industrial Electronics.

[4]  Gaoliang Peng,et al.  A deep convolutional neural network with new training methods for bearing fault diagnosis under noisy environment and different working load , 2018, Mechanical Systems and Signal Processing.

[5]  Sukhjeet Singh,et al.  Detection of Bearing Faults in Mechanical Systems Using Stator Current Monitoring , 2017, IEEE Transactions on Industrial Informatics.

[6]  Changqing Shen,et al.  Fault diagnosis of rotating machines based on the EMD manifold , 2020 .

[7]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[8]  Tang Tang,et al.  A simple data augmentation algorithm and a self-adaptive convolutional architecture for few-shot fault diagnosis under different working conditions , 2020 .

[9]  Kay Hameyer,et al.  Fault Diagnosis of Bearing Damage by Means of the Linear Discriminant Analysis of Stator Current Features From the Frequency Selection , 2016, IEEE Transactions on Industry Applications.

[10]  Sanjay H Upadhyay,et al.  Bearing performance degradation assessment based on a combination of empirical mode decomposition and k-medoids clustering , 2017 .

[11]  Konstantinos Gryllias,et al.  Mechanical fault diagnosis using Convolutional Neural Networks and Extreme Learning Machine , 2019, Mechanical Systems and Signal Processing.

[12]  Hee-Jun Kang,et al.  A survey on Deep Learning based bearing fault diagnosis , 2019, Neurocomputing.

[13]  Zihan Zhang,et al.  Compound Fault Diagnosis of Gearboxes via Multi-label Convolutional Neural Network and Wavelet Transform , 2019, Comput. Ind..

[14]  Bernard Kamsu-Foguem,et al.  Deep neural networks with transfer learning in millet crop images , 2019, Comput. Ind..

[15]  Dongyang Dou,et al.  Multi-fault diagnosis of rotating machinery based on deep convolution neural network and support vector machine , 2020 .

[16]  Junyu Qi Enhanced Particle Filter and Cyclic Spectral Coherence based Prognostics of Rolling Element Bearings , 2018 .

[17]  Enrico Zio,et al.  Artificial intelligence for fault diagnosis of rotating machinery: A review , 2018, Mechanical Systems and Signal Processing.

[18]  Geoffrey E. Hinton,et al.  Acoustic Modeling Using Deep Belief Networks , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[19]  Wei Gao,et al.  A Novel Fault Diagnosis Method for Rotating Machinery Based on a Convolutional Neural Network , 2018, Sensors.

[20]  Minqiang Xu,et al.  A fault diagnosis scheme for planetary gearboxes using modified multi-scale symbolic dynamic entropy and mRMR feature selection , 2017 .

[21]  Faliang Chang,et al.  Bearing Fault Classification Based on Convolutional Neural Network in Noise Environment , 2019, IEEE Access.

[22]  Li Xiang,et al.  Fault diagnosis for rolling bearing based on VMD-FRFT , 2020, Measurement.

[23]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[24]  Haibo He,et al.  Stacked Multilevel-Denoising Autoencoders: A New Representation Learning Approach for Wind Turbine Gearbox Fault Diagnosis , 2017, IEEE Transactions on Instrumentation and Measurement.

[25]  Shouqi Yuan,et al.  Convolutional Neural Network in Intelligent Fault Diagnosis Toward Rotatory Machinery , 2020, IEEE Access.

[26]  Fangyi Wan,et al.  Rotating machinery fault diagnosis based on convolutional neural network and infrared thermal imaging , 2020, Chinese Journal of Aeronautics.

[27]  K. I. Ramachandran,et al.  A multi-sensor information fusion for fault diagnosis of a gearbox utilizing discrete wavelet features , 2019, Measurement Science and Technology.

[28]  Ying Zhang,et al.  An enhanced convolutional neural network for bearing fault diagnosis based on time–frequency image , 2020, Measurement.

[29]  Pietro Borghesani,et al.  Automated assessment of gear wear mechanism and severity using mould images and convolutional neural networks , 2020 .

[30]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[31]  Peng Chen,et al.  Vibration-Based Intelligent Fault Diagnosis for Roller Bearings in Low-Speed Rotating Machinery , 2018, IEEE Transactions on Instrumentation and Measurement.

[32]  Jaskaran Singh,et al.  Multisensor data fusion for gearbox fault diagnosis using 2-D convolutional neural network and motor current signature analysis , 2020 .

[33]  Robert B. Randall,et al.  Bearing diagnostics under strong electromagnetic interference based on Integrated Spectral Coherence , 2020, Mechanical Systems and Signal Processing.

[34]  Satinder Singh,et al.  Bearing damage assessment using Jensen-Rényi Divergence based on EEMD , 2017 .

[35]  Robert B. Randall,et al.  The spectral kurtosis: application to the vibratory surveillance and diagnostics of rotating machines , 2006 .

[36]  Ruixin Wang,et al.  An enhanced selective ensemble deep learning method for rolling bearing fault diagnosis with beetle antennae search algorithm , 2020 .

[37]  Lalu Mansinha,et al.  Localization of the complex spectrum: the S transform , 1996, IEEE Trans. Signal Process..

[38]  Robert X. Gao,et al.  Wavelets for fault diagnosis of rotary machines: A review with applications , 2014, Signal Process..

[39]  Goran Nenadic,et al.  Machine learning methods for wind turbine condition monitoring: A review , 2019, Renewable Energy.

[40]  Hee-Jun Kang,et al.  Rolling element bearing fault diagnosis using convolutional neural network and vibration image , 2019, Cognitive Systems Research.

[41]  Niaoqing Hu,et al.  A deep convolutional neural network based fusion method of two-direction vibration signal data for health state identification of planetary gearboxes , 2019, Measurement.

[42]  Chao Liu,et al.  A novel adversarial learning framework in deep convolutional neural network for intelligent diagnosis of mechanical faults , 2019, Knowl. Based Syst..

[43]  Xiaodong Cui,et al.  Data augmentation for deep convolutional neural network acoustic modeling , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[44]  Pietro Borghesani,et al.  Application of surface replication combined with image analysis to investigate wear evolution on gear teeth – A case study , 2019, Wear.

[45]  Xin Huang,et al.  Intelligent fault diagnosis method of planetary gearboxes based on convolution neural network and discrete wavelet transform , 2019, Comput. Ind..

[46]  Wanlu Jiang,et al.  Amplitude-frequency characteristics analysis for vertical vibration of hydraulic AGC system under nonlinear action , 2019, AIP Advances.

[47]  Lei Zeng,et al.  Bearing fault diagnosis with varying conditions using angular domain resampling technology, SDP and DCNN , 2020 .

[48]  Weihua Li,et al.  Gearbox fault classification using S-transform and convolutional neural network , 2016, 2016 10th International Conference on Sensing Technology (ICST).

[49]  Junsheng Cheng,et al.  Rolling bearing fault diagnosis and performance degradation assessment under variable operation conditions based on nuisance attribute projection , 2019, Mechanical Systems and Signal Processing.

[50]  Huijun Gao,et al.  A convolutional neural network based on a capsule network with strong generalization for bearing fault diagnosis , 2019, Neurocomputing.

[51]  Robert B. Randall,et al.  Vibration Based Condition Monitoring of Planetary Gearboxes Operating Under Speed Varying Operating Conditions Based on Cyclo-non-stationary Analysis , 2018, Mechanisms and Machine Science.

[52]  Shouqi Yuan,et al.  Energy loss evaluation in a side channel pump under different wrapping angles using entropy production method , 2020 .

[53]  Chenglin Wen,et al.  Deep learning fault diagnosis method based on global optimization GAN for unbalanced data , 2020, Knowl. Based Syst..

[54]  Paolo Pennacchi,et al.  A new procedure for using envelope analysis for rolling element bearing diagnostics in variable operating conditions , 2013 .

[55]  Minqiang Xu,et al.  A fault diagnosis scheme for rotating machinery using hierarchical symbolic analysis and convolutional neural network. , 2019, ISA transactions.

[56]  Yangyang Wang,et al.  Signal-Based Intelligent Hydraulic Fault Diagnosis Methods: Review and Prospects , 2019, Chinese Journal of Mechanical Engineering.

[57]  Tianrui Li,et al.  Fault analysis of High Speed Train with DBN hierarchical ensemble , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[58]  Jing Yuan,et al.  Wavelet transform based on inner product in fault diagnosis of rotating machinery: A review , 2016 .

[59]  Robert X. Gao,et al.  Machine health monitoring based on locally linear embedding with kernel sparse representation for neighborhood optimization , 2019, Mechanical Systems and Signal Processing.

[60]  Takehisa Yairi,et al.  A review on the application of deep learning in system health management , 2018, Mechanical Systems and Signal Processing.

[61]  Samuel Case Bradford,et al.  Time-Frequency Analysis of Systems with Changing Dynamic Properties , 2006 .

[62]  Chao Liu,et al.  An adaptive spatiotemporal feature learning approach for fault diagnosis in complex systems , 2019, Mechanical Systems and Signal Processing.

[63]  Qicai Zhou,et al.  Fault Diagnosis of Rotating Machinery under Noisy Environment Conditions Based on a 1-D Convolutional Autoencoder and 1-D Convolutional Neural Network , 2019, Sensors.

[64]  Jing Lin,et al.  A multivariate encoder information based convolutional neural network for intelligent fault diagnosis of planetary gearboxes , 2018, Knowl. Based Syst..

[65]  Haidong Shao,et al.  Rolling bearing fault diagnosis using an optimization deep belief network , 2015 .

[66]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[67]  Cong Wang,et al.  Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings , 2016 .

[68]  K. I. Ramachandran,et al.  Incipient gear box fault diagnosis using discrete wavelet transform (DWT) for feature extraction and classification using artificial neural network (ANN) , 2010, Expert Syst. Appl..

[69]  Ming J. Zuo,et al.  GEARBOX FAULT DIAGNOSIS USING ADAPTIVE WAVELET FILTER , 2003 .

[70]  Jing Na,et al.  Planetary-Gearbox Fault Classification by Convolutional Neural Network and Recurrence Plot , 2020 .

[71]  Liang Guo,et al.  A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines , 2018, Neurocomputing.

[72]  Jun Wang,et al.  An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition , 2018, Neurocomputing.

[73]  Keegan J. Moore,et al.  Wavelet-bounded empirical mode decomposition for measured time series analysis , 2018 .

[74]  Steven X. Ding,et al.  Real-time fault diagnosis and fault-tolerant control , 2015, IEEE Transactions on Industrial Electronics.

[75]  Helio Fiori de Castro,et al.  Uncertainty quantification in deep convolutional neural network diagnostics of journal bearings with ovalization fault , 2020 .

[76]  Jérôme Antoni,et al.  Cyclostationary modelling of rotating machine vibration signals , 2004 .

[77]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[78]  Jian-Da Wu,et al.  An automotive generator fault diagnosis system using discrete wavelet transform and artificial neural network , 2009, Expert Syst. Appl..

[79]  Jiaxu Wang,et al.  An integrated approach to planetary gearbox fault diagnosis using deep belief networks , 2017 .

[80]  Hongmei Liu,et al.  Rolling Bearing Fault Diagnosis Based on STFT-Deep Learning and Sound Signals , 2016 .

[81]  Xinyu Li,et al.  A semi-supervised convolutional neural network-based method for steel surface defect recognition , 2020, Robotics Comput. Integr. Manuf..

[82]  Yaguo Lei,et al.  Applications of machine learning to machine fault diagnosis: A review and roadmap , 2020 .

[83]  Yan Wang,et al.  An integrated multi-sensor fusion-based deep feature learning approach for rotating machinery diagnosis , 2018 .

[84]  Tara N. Sainath,et al.  Deep Convolutional Neural Networks for Large-scale Speech Tasks , 2015, Neural Networks.

[85]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[86]  Biao Wang,et al.  LiftingNet: A Novel Deep Learning Network With Layerwise Feature Learning From Noisy Mechanical Data for Fault Classification , 2018, IEEE Transactions on Industrial Electronics.

[87]  Wanlu Jiang,et al.  Bifurcation Characteristic Research on the Load Vertical Vibration of a Hydraulic Automatic Gauge Control System , 2019, Processes.

[88]  Noureddine Guersi,et al.  Rolling element bearing fault diagnosis for rotating machinery using vibration spectrum imaging and convolutional neural networks , 2019, The International Journal of Advanced Manufacturing Technology.

[89]  P. Tse,et al.  Singularity analysis of the vibration signals by means of wavelet modulus maximal method , 2007 .

[90]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[91]  Jian-Bo Yu,et al.  Evolutionary manifold regularized stacked denoising autoencoders for gearbox fault diagnosis , 2019, Knowl. Based Syst..

[92]  Gang Tang,et al.  Underdetermined blind separation of bearing faults in hyperplane space with variational mode decomposition , 2019, Mechanical Systems and Signal Processing.

[93]  Haiyang Pan,et al.  Symplectic geometry mode decomposition and its application to rotating machinery compound fault diagnosis , 2019, Mechanical Systems and Signal Processing.

[94]  Hongli Gao,et al.  A new bearing fault diagnosis method based on modified convolutional neural networks , 2020, Chinese Journal of Aeronautics.

[95]  Jun-Geol Baek,et al.  A Novel Image Feature for the Remaining Useful Lifetime Prediction of Bearings Based on Continuous Wavelet Transform and Convolutional Neural Network , 2018, Applied Sciences.

[96]  Mohammad Zareinejad,et al.  Leakage fault detection in Electro-Hydraulic Servo Systems using a nonlinear representation learning approach. , 2018, ISA transactions.

[97]  Jimeng Li,et al.  An enhanced rolling bearing fault detection method combining sparse code shrinkage denoising with fast spectral correlation. , 2020, ISA transactions.

[98]  Baoping Tang,et al.  A novel fault diagnosis model for gearbox based on wavelet support vector machine with immune genetic algorithm , 2013 .

[99]  Changqing Shen,et al.  Stacked Sparse Autoencoder-Based Deep Network for Fault Diagnosis of Rotating Machinery , 2017, IEEE Access.

[100]  Yong Zhu,et al.  Extraction method for signal effective component based on extreme-point symmetric mode decomposition and Kullback–Leibler divergence , 2019, Journal of the Brazilian Society of Mechanical Sciences and Engineering.

[101]  Mohammad Modarres,et al.  Deep Learning Enabled Fault Diagnosis Using Time-Frequency Image Analysis of Rolling Element Bearings , 2017 .

[102]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[103]  Yi Wang,et al.  M-band flexible wavelet transform and its application to the fault diagnosis of planetary gear transmission systems , 2019 .

[104]  Konstantinos Gryllias,et al.  A semi-supervised Support Vector Data Description-based fault detection method for rolling element bearings based on cyclic spectral analysis , 2020, Mechanical Systems and Signal Processing.

[105]  Fang Deng,et al.  Data augmentation in fault diagnosis based on the Wasserstein generative adversarial network with gradient penalty , 2020, Neurocomputing.

[106]  Minping Jia,et al.  A new Local-Global Deep Neural Network and its application in rotating machinery fault diagnosis , 2019, Neurocomputing.

[107]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[108]  Sanjay H Upadhyay,et al.  A review on signal processing techniques utilized in the fault diagnosis of rolling element bearings , 2016 .

[109]  Tianrui Li,et al.  Learning features from High Speed Train vibration signals with Deep Belief Networks , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[110]  Chao Liu,et al.  Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application , 2018, ISA transactions.

[111]  Shaohui Liu,et al.  Bearing Fault Diagnosis Using Fully-Connected Winner-Take-All Autoencoder , 2018, IEEE Access.

[112]  Wentao Mao,et al.  A novel deep output kernel learning method for bearing fault structural diagnosis , 2019, Mechanical Systems and Signal Processing.