Generative Adversarial Networks for Failure Prediction

Prognostics and Health Management (PHM) is an emerging engineering discipline which is concerned with the analysis and prediction of equipment health and performance. One of the key challenges in PHM is to accurately predict impending failures in the equipment. In recent years, solutions for failure prediction have evolved from building complex physical models to the use of machine learning algorithms that leverage the data generated by the equipment. However, failure prediction problems pose a set of unique challenges that make direct application of traditional classification and prediction algorithms impractical. These challenges include the highly imbalanced training data, the extremely high cost of collecting more failure samples, and the complexity of the failure patterns. Traditional oversampling techniques will not be able to capture such complexity and accordingly result in overfitting the training data. This paper addresses these challenges by proposing a novel algorithm for failure prediction using Generative Adversarial Networks (GAN-FP). GAN-FP first utilizes two GAN networks to simultaneously generate training samples and build an inference network that can be used to predict failures for new samples. GAN-FP first adopts an infoGAN to generate realistic failure and non-failure samples, and initialize the weights of the first few layers of the inference network. The inference network is then tuned by optimizing a weighted loss objective using only real failure and non-failure samples. The inference network is further tuned using a second GAN whose purpose is to guarantee the consistency between the generated samples and corresponding labels. GAN-FP can be used for other imbalanced classification problems as well.

[1]  Giorgio Terracina,et al.  Biomedical Data Augmentation Using Generative Adversarial Neural Networks , 2017, ICANN.

[2]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[3]  Junhee Seok,et al.  Controllable Generative Adversarial Network , 2017, IEEE Access.

[4]  Chris H. Q. Ding,et al.  Kernel Alignment Inspired Linear Discriminant Analysis , 2014, ECML/PKDD.

[5]  Yan Wang,et al.  DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Liana L. Fong,et al.  Analysis and Modeling of Social Influence in High Performance Computing Workloads , 2011, Euro-Par.

[7]  Feiping Nie,et al.  Regularized Singular Value Decomposition and Application to Recommender System , 2018, ArXiv.

[8]  Feiping Nie,et al.  A Harmonic Mean Linear Discriminant Analysis for Robust Image Classification , 2016, 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI).

[9]  Gustavo Carneiro,et al.  A Bayesian Data Augmentation Approach for Learning Deep Models , 2017, NIPS.

[10]  Yi Yang,et al.  Camera Style Adaptation for Person Re-identification , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[12]  Michael G. Pecht,et al.  A prognostics and health management roadmap for information and electronics-rich systems , 2010, Microelectron. Reliab..

[13]  Chris H. Q. Ding,et al.  Accelerating Deep Learning with Shrinkage and Recall , 2016, 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS).

[14]  Shuai Zheng,et al.  Minimal Support Vector Machine , 2018, ArXiv.

[15]  Chetan Gupta,et al.  Long Short-Term Memory Network for Remaining Useful Life estimation , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[16]  Haibo He,et al.  ADASYN: Adaptive synthetic sampling approach for imbalanced learning , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[17]  Pieter Abbeel,et al.  InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets , 2016, NIPS.

[18]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[19]  Feiping Nie,et al.  Harmonic Mean Linear Discriminant Analysis , 2019, IEEE Transactions on Knowledge and Data Engineering.

[20]  Shuai Zheng,et al.  Machine Learning: Several Advances in Linear Discriminant Analysis, Multi-View Regression and Support Vector Machine , 2017 .

[21]  Yanqing Zhang,et al.  SVMs Modeling for Highly Imbalanced Classification , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Hamid Parvin,et al.  Using sub-sampling and ensemble clustering techniques to improve performance of imbalanced classification , 2018, Neurocomputing.

[23]  P. Lall,et al.  Prognostics and health management of electronics , 2006, 2006 11th International Symposium on Advanced Packaging Materials: Processes, Properties and Interface.

[24]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[25]  Feiping Nie,et al.  A Closed Form Solution to Multi-View Low-Rank Regression , 2015, AAAI.

[26]  Chris Ding,et al.  Sparse classification using Group Matching Pursuit , 2019, Neurocomputing.

[27]  Abhinav Saxena,et al.  Damage propagation modeling for aircraft engine run-to-failure simulation , 2008, 2008 International Conference on Prognostics and Health Management.

[28]  Fan Yang,et al.  Good Semi-supervised Learning That Requires a Bad GAN , 2017, NIPS.

[29]  Thomas Lu,et al.  Predicting Rapid Fire Growth (Flashover) Using Conditional Generative Adversarial Networks , 2018, IRIACV.

[30]  Noureddine Zerhouni,et al.  Data-driven prognostic method based on Bayesian approaches for direct remaining useful life prediction , 2016, J. Intell. Manuf..

[31]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[32]  Haizhou Li,et al.  A Cost-Sensitive Deep Belief Network for Imbalanced Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Dumitru Erhan,et al.  Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).