Transfer Learning Based Fault Diagnosis with Missing Data Due to Multi-Rate Sampling

Deep learning is an effective feature extraction method widely applied in fault diagnosis fields since it can extract fault features potentially involved in multi-sensor data. But different sensors equipped in the system may sample data at different sampling rates, which will inevitably result in a problem that a very small number of samples with a complete structure can be used for deep learning since the input of a deep neural network (DNN) is required to be a structurally complete sample. On the other hand, a large number of samples are required to ensure the efficiency of deep learning based fault diagnosis methods. To solve the problem that a structurally complete sample size is too small, this paper proposes a fault diagnosis framework of missing data based on transfer learning which makes full use of a large number of structurally incomplete samples. By designing suitable transfer learning mechanisms, extra useful fault features can be extracted to improve the accuracy of fault diagnosis based simply on structural complete samples. Thus, online fault diagnosis, as well as an offline learning scheme based on deep learning of multi-rate sampling data, can be developed. The efficiency of the proposed method is demonstrated by utilizing data collected from the QPZZ- II rotating machinery vibration experimental platform system.

[1]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part II: Fault Diagnosis With Knowledge-Based and Hybrid/Active Approaches , 2015, IEEE Transactions on Industrial Electronics.

[2]  Liang Guo,et al.  A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines , 2018, Neurocomputing.

[3]  Bo Jin,et al.  Sequential Fault Diagnosis Based on LSTM Neural Network , 2018, IEEE Access.

[4]  Changqing Shen,et al.  Wayside Bearing Fault Diagnosis Based on a Data-Driven Doppler Effect Eliminator and Transient Model Analysis , 2014, Sensors.

[5]  Xindong Wu,et al.  10 Challenging Problems in Data Mining Research , 2006, Int. J. Inf. Technol. Decis. Mak..

[6]  Ran Zhang,et al.  Transfer Learning With Neural Networks for Bearing Fault Diagnosis in Changing Working Conditions , 2017, IEEE Access.

[7]  Deniz Yuret,et al.  Transfer Learning for Low-Resource Neural Machine Translation , 2016, EMNLP.

[8]  Zhi Wei,et al.  Transfer Learning Approaches to Improve Drug Sensitivity Prediction in Multiple Myeloma Patients , 2017, IEEE Access.

[9]  Jie Chen,et al.  Robust Model-Based Fault Diagnosis for Dynamic Systems , 1998, The International Series on Asian Studies in Computer and Information Science.

[10]  Peter W. Tse,et al.  A One-Versus-All Class Binarization Strategy for Bearing Diagnostics of Concurrent Defects , 2014, Sensors.

[11]  Martin O. Hofmann,et al.  Model-based diagnosis of the space shuttle main engine , 1992, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[12]  Chen Lu,et al.  Fault diagnosis of rotary machinery components using a stacked denoising autoencoder-based health state identification , 2017, Signal Process..

[13]  Zhiqiang Chen,et al.  Deep neural networks-based rolling bearing fault diagnosis , 2017, Microelectron. Reliab..

[14]  Qinghua Hu,et al.  Transfer learning for short-term wind speed prediction with deep neural networks , 2016 .

[15]  Sylvain Verron,et al.  Bridging data-driven and model-based approaches for process fault diagnosis and health monitoring: A review of researches and future challenges , 2016, Annu. Rev. Control..

[16]  Yun Fu,et al.  Robust Transfer Metric Learning for Image Classification , 2017, IEEE Transactions on Image Processing.

[17]  Hao Wu,et al.  An adaptive confidence limit for periodic non-steady conditions fault detection , 2016 .

[18]  Zhiqiang Ge,et al.  Review and big data perspectives on robust data mining approaches for industrial process modeling with outliers and missing data , 2018, Annu. Rev. Control..

[19]  Myung-Geun Chun,et al.  Knowledge-Based Faults Diagnosis System for Wastewater Treatment , 2005, FSKD.

[20]  Jiangtao Wen,et al.  Intelligent Bearing Fault Diagnosis Method Combining Compressed Data Acquisition and Deep Learning , 2018, IEEE Transactions on Instrumentation and Measurement.

[21]  Zhanpeng Zhang,et al.  A deep belief network based fault diagnosis model for complex chemical processes , 2017, Comput. Chem. Eng..

[22]  Robert Sabourin,et al.  Improve the performance of transfer learning without fine-tuning using dissimilarity-based multi-view learning for breast cancer histology images , 2018, ICIAR.

[23]  Jiafu Wan,et al.  Industrial Big Data for Fault Diagnosis: Taxonomy, Review, and Applications , 2017, IEEE Access.

[24]  Tao Liu,et al.  The fault detection and diagnosis in rolling element bearings using frequency band entropy , 2013 .

[25]  Christina G. Siontorou,et al.  A Knowledge-Based Approach to Online Fault Diagnosis of FET Biosensors , 2010, IEEE Transactions on Instrumentation and Measurement.

[26]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[27]  Jong-Myon Kim,et al.  A Hybrid Feature Model and Deep-Learning-Based Bearing Fault Diagnosis , 2017, Sensors.

[28]  Albert Ali Salah,et al.  Video-based emotion recognition in the wild using deep transfer learning and score fusion , 2017, Image Vis. Comput..

[29]  Wenjun Sun,et al.  Induction Motor Fault Diagnosis Based on Deep Neural Network of Sparse Auto-encoder , 2016 .

[30]  Chenglin Wen,et al.  Fault diagnosis based on deep learning , 2016, 2016 American Control Conference (ACC).

[31]  Liang Chen,et al.  An End-to-End Model Based on Improved Adaptive Deep Belief Network and Its Application to Bearing Fault Diagnosis , 2018, IEEE Access.

[32]  Weiguo Fan,et al.  A new image classification method using CNN transfer learning and web data augmentation , 2018, Expert Syst. Appl..

[33]  Dongrui Wu,et al.  Online and Offline Domain Adaptation for Reducing BCI Calibration Effort , 2017, IEEE Transactions on Human-Machine Systems.

[34]  Jiong Tang,et al.  Preprocessing-Free Gear Fault Diagnosis Using Small Datasets With Deep Convolutional Neural Network-Based Transfer Learning , 2017, IEEE Access.

[35]  Zhaohong Deng,et al.  Multitask TSK Fuzzy System Modeling by Mining Intertask Common Hidden Structure , 2015, IEEE Transactions on Cybernetics.

[36]  Hong Liu,et al.  A performance comparison of low- and high-level features learned by deep convolutional neural networks in epithelium and stroma classification , 2018, Medical Imaging.

[37]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[38]  Hao Wu,et al.  Deep convolutional neural network model based chemical process fault diagnosis , 2018, Comput. Chem. Eng..

[39]  Bart De Schutter,et al.  Bayesian and Dempster-Shafer reasoning for knowledge-based fault diagnosis-A comparative study , 2017, Eng. Appl. Artif. Intell..

[40]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part I: Fault Diagnosis With Model-Based and Signal-Based Approaches , 2015, IEEE Transactions on Industrial Electronics.

[41]  Chao Liu,et al.  Deep Transfer Network with Joint Distribution Adaptation: A New Intelligent Fault Diagnosis Framework for Industry Application , 2018, ISA transactions.

[42]  Craig MacDonald,et al.  Transfer Learning for Multi-language Twitter Election Classification , 2017, ASONAM.

[43]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[44]  Wentian Zhao,et al.  Fault diagnosis network design for vehicle on-board equipments of high-speed railway: A deep learning approach , 2016, Eng. Appl. Artif. Intell..

[45]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[46]  Haidong Shao,et al.  Electric Locomotive Bearing Fault Diagnosis Using a Novel Convolutional Deep Belief Network , 2018, IEEE Transactions on Industrial Electronics.

[47]  Pengjiang Qian,et al.  Seizure Classification From EEG Signals Using Transfer Learning, Semi-Supervised Learning and TSK Fuzzy System , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.