DGTL-Net: A Deep Generative Transfer Learning Network for Fault Diagnostics on New Hard Disks

Abstract Intelligent fault diagnosis of hard disks becomes significantly important to guarantee reliability of current cloud-based industrial systems. Most intelligent diagnostic methods are commonly based on assumptions that data from different disks are subject to the same distribution and there are sufficient faulty samples for training the models. However, in reality, there are types of hard disks from different manufacturers and their SMART encoding varies widely across manufacturers. It results in distribution discrepancy among disks and influences the generalization of machine learning methods. Moreover, hard disks usually work in healthy state that faulty events rarely happen on most of them, or especially never occur on new ones. Thus, this paper proposes a deep generative transfer learning network (DGTL-Net) for intelligent fault diagnostics on new hard disks. The DGTL-Net combines the deep generative network that generates fake faulty samples and the deep transfer network that solves the problem of distribution discrepancy between hard disks. An iterative end-end training strategy is also proposed for DGTL-Net to get the most optimal parameters of generative and transfer network simultaneously. Experiments have been conducted to prove that our method achieves better performance.

[1]  Wei Xu,et al.  What Can We Learn from Four Years of Data Center Hardware Failures? , 2017, 2017 47th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN).

[2]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[3]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[4]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[5]  Xiang Li,et al.  Diagnosing Rotating Machines With Weakly Supervised Data Using Deep Transfer Learning , 2020, IEEE Transactions on Industrial Informatics.

[6]  Francisco de Assis Boldt,et al.  An experimental methodology to evaluate machine learning methods for fault diagnosis based on vibration signals , 2020, Expert Syst. Appl..

[7]  Yang Ji,et al.  A Weighted Deep Domain Adaptation Method for Industrial Fault Prognostics According to Prior Distribution of Complex Working Conditions , 2019, IEEE Access.

[8]  Enrico Zio,et al.  A scalable fuzzy support vector machine for fault detection in transportation systems , 2018, Expert Syst. Appl..

[9]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[10]  Wenjun Yang,et al.  Hard Drive Failure Prediction Using Big Data , 2015, 2015 IEEE 34th Symposium on Reliable Distributed Systems Workshop (SRDSW).

[11]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[12]  Tao Zhang,et al.  Deep Model Based Domain Adaptation for Fault Diagnosis , 2017, IEEE Transactions on Industrial Electronics.

[13]  Xiang Li,et al.  Deep Learning-Based Machinery Fault Diagnostics With Domain Adaptation Across Sensors at Different Places , 2020, IEEE Transactions on Industrial Electronics.

[14]  Bin Yang,et al.  An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings , 2019, Mechanical Systems and Signal Processing.

[15]  Zhiyu Liu,et al.  Transfer learning with convolutional neural networks for small sample size problem in machinery fault diagnosis , 2019, Proceedings of the Institution of Mechanical Engineers, Part C: Journal of Mechanical Engineering Science.

[16]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[17]  Javam C. Machado,et al.  Transfer Learning for Bayesian Networks with Application on Hard Disk Drives Failure Prediction , 2017, 2017 Brazilian Conference on Intelligent Systems (BRACIS).

[18]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[19]  Jasmina Bogojeska,et al.  Predicting Disk Replacement towards Reliable Data Centers , 2016, KDD.

[20]  Yi Wang,et al.  A study on adaptation lightweight architecture based deep learning models for bearing fault diagnosis under varying working conditions , 2020, Expert Syst. Appl..

[21]  Krishnendu Chakrabarty,et al.  System-level hardware failure prediction using deep learning , 2019, 2019 56th ACM/IEEE Design Automation Conference (DAC).

[22]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..