An Enhanced Intelligent Diagnosis Method Based on Multi-Sensor Image Fusion via Improved Deep Learning Network

An enhanced intelligent diagnosis method for rotary equipment is proposed based on multi-sensor data-fusion and an improved deep convolutional neural network (CNN) models. An improved CNN based on LeNet-5 is constructed which can enhance the features of the samples by stacking bottleneck layers without changing the size of the samples. A new conversion approaches are also proposed for converting multi-sensor vibration signals into color images, and it can refine features and enlarge the differences between different types of fault signals by the fused images transformed in red–green–blue (RGB) color space. In the last stage of network learning, visual clustering is realized with t-distributed stochastic neighbor embedding (t-SNE) to evaluate the performance of the network. To verify the effectiveness of the proposed method, examples in practice such as the diagnosis for the wind power test rigs and industrial fan system are provided with the prediction accuracies of 99.89% and 99.77%, respectively. In addition, the efficiency of other comparative baseline approaches such as the deep belief network and support vector machine (SVM) is evaluated. In conclusion, the proposed intelligent diagnosis method based on multi-sensor data-fusion and CNN shows higher prediction accuracy and more obvious visualization clustering effects.

[1]  Sabina Jeschke,et al.  Industrial Internet of Things: Cybermanufacturing Systems , 2016 .

[2]  Xin Wang,et al.  Improved Fault Size Estimation Method for Rolling Element Bearings Based on Concatenation Dictionary , 2019, IEEE Access.

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Peng Chen,et al.  Vibration-Based Intelligent Fault Diagnosis for Roller Bearings in Low-Speed Rotating Machinery , 2018, IEEE Transactions on Instrumentation and Measurement.

[6]  Dong Wang,et al.  K-nearest neighbors based methods for identification of different gear crack levels under different motor speeds and loads: Revisited , 2016 .

[7]  Shi Li,et al.  A novel convolutional neural network based fault recognition method via image fusion of multi-vibration-signals , 2019, Comput. Ind..

[8]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Hong Jiang,et al.  A novel Switching Unscented Kalman Filter method for remaining useful life prediction of rolling bearing , 2019, Measurement.

[10]  Robert X. Gao,et al.  A Deep Learning Approach for Fault Diagnosis of Induction Motors in Manufacturing , 2017, Chinese Journal of Mechanical Engineering.

[11]  Yu Peng,et al.  An On-Line State of Health Estimation of Lithium-Ion Battery Using Unscented Particle Filter , 2018, IEEE Access.

[12]  B. Frey,et al.  Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning , 2015, Nature Biotechnology.

[13]  Xuefeng Chen,et al.  Dislocated Time Series Convolutional Neural Architecture: An Intelligent Fault Diagnosis Approach for Electric Machine , 2017, IEEE Transactions on Industrial Informatics.

[14]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[15]  Wenjun Sun,et al.  Induction Motor Fault Diagnosis Based on Deep Neural Network of Sparse Auto-encoder , 2016 .

[16]  Peng Chen,et al.  Step-by-Step Fuzzy Diagnosis Method for Equipment Based on Symptom Extraction and Trivalent Logic Fuzzy Diagnosis Theory , 2018, IEEE Transactions on Fuzzy Systems.

[17]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[18]  Huaqing Wang,et al.  A Novel Feature Enhancement Method Based on Improved Constraint Model of Online Dictionary Learning , 2019, IEEE Access.

[19]  Bin Zhang,et al.  Bearing performance degradation assessment using long short-term memory recurrent network , 2019, Comput. Ind..

[20]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[21]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[22]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[23]  Qiang Guo,et al.  Convolutional feature learning and Hybrid CNN-HMM for scene number recognition , 2016, Neurocomputing.

[24]  Dawn Song,et al.  Robust Physical-World Attacks on Deep Learning Models , 2017, 1707.08945.

[25]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .

[26]  Li Lin,et al.  Fault diagnosis and remaining useful life estimation of aero engine using LSTM neural network , 2016, 2016 IEEE International Conference on Aircraft Utility Systems (AUS).

[27]  Gopika Vinod,et al.  Application of artificial neural networks to nuclear power plant transient diagnosis , 2007, Reliab. Eng. Syst. Saf..

[28]  Robert X. Gao,et al.  Virtualization and deep recognition for system fault classification , 2017 .

[29]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[30]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[31]  Huaqing Wang,et al.  Fuzzy Diagnosis Method for Rotating Machinery in Variable Rotating Speed , 2011, IEEE Sensors Journal.

[32]  Shibin Wang,et al.  Time-frequency atoms-driven support vector machine method for bearings incipient fault diagnosis , 2016 .

[33]  Ruyi Huang,et al.  Deep Decoupling Convolutional Neural Network for Intelligent Compound Fault Diagnosis , 2019, IEEE Access.

[34]  Hai Huang,et al.  A method of real-time fault diagnosis for power transformers based on vibration analysis , 2015 .

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Suxia Cui,et al.  Industrial Internet of Things , 2018 .

[37]  Peng Chen,et al.  Intelligent diagnosis method for machinery by sequential auto-reorganization of histogram. , 2019, ISA transactions.

[38]  Geoffrey E. Hinton,et al.  Restricted Boltzmann machines for collaborative filtering , 2007, ICML '07.

[39]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[41]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[42]  Deyong You,et al.  WPD-PCA-Based Laser Welding Process Monitoring and Defects Diagnosis by Using FNN and SVM , 2015, IEEE Transactions on Industrial Electronics.

[43]  Xinqing Wang,et al.  A hydraulic fault diagnosis method based on sliding-window spectrum feature and deep belief network , 2017 .

[44]  Geoffrey E. Hinton,et al.  Deep Belief Networks for phone recognition , 2009 .