Multi-scale deep coupling convolutional neural network with heterogeneous sensor data for intelligent fault diagnosis

With the innovation and development of detection technology, various types of sensors are installed to monitor the operating status of equipment in modern industry. Compared with the same type of sensors for monitoring, heterogeneous sensors can collect more comprehensive complementary fault information. Due to the large distribution differences and serious noise pollution of heterogeneous sensor data collected in industrial sites, this brings certain challenges to the development of heterogeneous data fusion strategies. In view of the large distribution difference in the feature spatial of heterogeneous data and the difficulty of effective fusion of fault information, this paper presents a multi-scale deep coupling convolutional neural network (MDCN), which is used to map the heterogeneous fault information from different feature spaces to the common spaces for full fusion. Specifically, a multi-scale convolution module (MSC) with multiple filters of different sizes is adopted to extract multi-scale fault features of heterogeneous sensor data. Then, the maximum mean discrepancy (MMD) is applied to measure the distance between different spatial features in the coupling layer, and the common failure information in the heterogeneous data is mined by minimizing MMD to fuse effectively in order to identify the failure state of the device. The validity of this method is verified by the data collected on a first-level parallel gearbox mixed fault experiment platform.

[1]  Houguang Liu,et al.  Optimal IMF selection and unknown fault feature extraction for rolling bearings with different defect modes , 2020, Measurement.

[2]  Dongying Han,et al.  A Novel Rotating Machinery Fault Diagnosis Method Based on Adaptive Deep Belief Network Structure and Dynamic Learning Rate Under Variable Working Conditions , 2021, IEEE Access.

[3]  Yili Hong,et al.  Reliability Meets Big Data: Opportunities and Challenges , 2014 .

[4]  Tara N. Sainath,et al.  FUNDAMENTAL TECHNOLOGIES IN MODERN SPEECH RECOGNITION Digital Object Identifier 10.1109/MSP.2012.2205597 , 2012 .

[5]  Haidong Shao,et al.  Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing , 2018 .

[6]  Rongrong Fu,et al.  A sparse auto-encoder method based on compressed sensing and wavelet packet energy entropy for rolling bearing intelligent fault diagnosis , 2020 .

[7]  Shen Yin,et al.  Real-Time Monitoring and Control of Industrial Cyberphysical Systems: With Integrated Plant-Wide Monitoring and Control Framework , 2019, IEEE Industrial Electronics Magazine.

[8]  Weihua Li,et al.  Multisensor Feature Fusion for Bearing Fault Diagnosis Using Sparse Autoencoder and Deep Belief Network , 2017, IEEE Transactions on Instrumentation and Measurement.

[9]  Chuang Sun,et al.  Deep Coupling Autoencoder for Fault Diagnosis With Multimodal Sensory Data , 2018, IEEE Transactions on Industrial Informatics.

[10]  Jianjun Shi,et al.  A Data-Level Fusion Model for Developing Composite Health Indices for Degradation Modeling and Prognostic Analysis , 2013, IEEE Transactions on Automation Science and Engineering.

[11]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[12]  Jyoti K. Sinha,et al.  An improved data fusion technique for faults diagnosis in rotating machines , 2014 .

[13]  Okyay Kaynak,et al.  A Review on Soft Sensors for Monitoring, Control, and Optimization of Industrial Processes , 2021, IEEE Sensors Journal.

[14]  Okyay Kaynak,et al.  Data-Driven Monitoring and Safety Control of Industrial Cyber-Physical Systems: Basics and Beyond , 2018, IEEE Access.

[15]  Marinka Zitnik,et al.  Data Fusion by Matrix Factorization , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[17]  Na Zhao,et al.  Gear fault feature extraction and diagnosis method under different load excitation based on EMD, PSO-SVM and fractal box dimension , 2019, Journal of Mechanical Science and Technology.

[18]  Yaguo Lei.  Research Advances of Fault Diagnosis Technique for Planetary Gearboxes , 2011 .

[19]  Radu Marculescu,et al.  Multi-Scale Compositionality: Identifying the Compositional Structures of Social Dynamics Using Deep Learning , 2015, PloS one.

[20]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[21]  Praveen Chopra,et al.  Fault detection and classification by unsupervised feature extraction and dimensionality reduction , 2015, Complex & Intelligent Systems.

[22]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[23]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[24]  Niaoqing Hu,et al.  A deep convolutional neural network based fusion method of two-direction vibration signal data for health state identification of planetary gearboxes , 2019, Measurement.

[25]  Tonghai Wu,et al.  Full-life dynamic identification of wear state based on on-line wear debris image features , 2014 .

[26]  Peiming Shi,et al.  An Intelligent Fault Diagnosis Method of Variable Condition Gearbox Based on Improved DBN Combined With WPEE and MPE , 2020, IEEE Access.

[27]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[28]  Delbert Tesar,et al.  Simultaneous Sensor and Process Fault Detection and Isolation in Multiple-Input–Multiple-Output Systems , 2015, IEEE Systems Journal.

[29]  Jay Lee,et al.  Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications , 2014 .

[30]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[31]  Kai Liang,et al.  Intelligent fault diagnosis of rotating machinery based on deep learning with feature selection , 2020, Journal of Low Frequency Noise, Vibration and Active Control.

[32]  Swagatam Das,et al.  Multi-sensor data fusion using support vector machine for motor fault detection , 2012, Inf. Sci..

[33]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.