Temporal convolution-based transferable cross-domain adaptation approach for remaining useful life estimation under variable failure behaviors

Abstract Many data-driven models normally assume that the training and test data are independent and identically distributed to predict the remaining useful life (RUL) of industrial machines. However, different failure models caused by variable failure behaviors may lead to a domain shift. Meanwhile, conventional methods lack comprehensive attention to temporal information, resulting in a limitation. To handle the aforementioned challenges, a transferable cross-domain approach for RUL estimation is proposed. The hidden features are extracted adaptively by a temporal convolution network in which residual self-attention is able to fully consider the contextual degradation information. Furthermore, a new cross-domain adaption architecture with the contrastive loss and multi-kernel maximum mean discrepancy is designed to learn the domain invariant features. The effectiveness and superiority of the proposed method are proved by the case study on IEEE PHM challenge 2012 bearing dataset and the comparison with other methods.

[1]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[2]  Uzay Kaymak,et al.  Remaining Useful Lifetime Prediction via Deep Domain Adaptation , 2019, Reliab. Eng. Syst. Saf..

[3]  Weiwen Peng,et al.  A novel deep convolutional neural network-bootstrap integrated method for RUL prediction of rolling bearing , 2021, Journal of Manufacturing Systems.

[4]  Jun Zhu,et al.  A new data-driven transferable remaining useful life prediction approach for bearing under different working conditions , 2020 .

[5]  Thorsteinn S. Rögnvaldsson,et al.  Transfer learning for Remaining Useful Life Prediction Based on Consensus Self-Organizing Models , 2019, Reliab. Eng. Syst. Saf..

[6]  Pradeep Kundu,et al.  Multiple failure behaviors identification and remaining useful life prediction of ball bearings , 2019, J. Intell. Manuf..

[7]  Cheng Han,et al.  Transferable convolutional neural network based remaining useful life prediction of bearing under multiple failure behaviors , 2021, Measurement.

[8]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[9]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Jialin Li,et al.  A Bayesian Optimization AdaBN-DCNN Method With Self-Optimized Structure and Hyperparameters for Domain Adaptation Remaining Useful Life Prediction , 2020, IEEE Access.

[11]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[12]  Bo Zhao,et al.  A method for rapidly evaluating reliability and predicting remaining useful life using two-dimensional convolutional neural network with signal conversion , 2019, Journal of Mechanical Science and Technology.

[13]  Jafar Tahmoresnezhad,et al.  Visual domain adaptation via transfer feature learning , 2017, Knowledge and Information Systems.

[14]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[15]  Hong-Zhong Huang,et al.  A Bidirectional LSTM Prognostics Method Under Multiple Operational Conditions , 2019, IEEE Transactions on Industrial Electronics.

[16]  Bin Liang,et al.  Remaining useful life prediction of aircraft engine based on degradation pattern learning , 2017, Reliab. Eng. Syst. Saf..

[17]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[18]  Zhenghua Chen,et al.  Contrastive Adversarial Domain Adaptation for Machine Remaining Useful Life Prediction , 2021, IEEE Transactions on Industrial Informatics.

[19]  Wentao Mao,et al.  Predicting Remaining Useful Life of Rolling Bearings Based on Deep Feature Representation and Transfer Learning , 2020, IEEE Transactions on Instrumentation and Measurement.

[20]  Minping Jia,et al.  Remaining useful life estimation using deep metric transfer learning for kernel regression , 2021, Reliab. Eng. Syst. Saf..

[21]  Biqing Huang,et al.  Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit , 2021, Journal of Intelligent Manufacturing.

[22]  Peng Ding,et al.  Transfer learning for remaining useful life prediction of multi-conditions bearings based on bidirectional-GRU network , 2021, Measurement.

[23]  Peng Ding,et al.  Stationary subspaces-vector autoregressive with exogenous terms methodology for degradation trend estimation of rolling and slewing bearings , 2021 .

[24]  Zhibin Zhao,et al.  Deep Transfer Learning Based on Sparse Autoencoder for Remaining Useful Life Prediction of Tool in Manufacturing , 2019, IEEE Transactions on Industrial Informatics.

[25]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[26]  Enrico Zio,et al.  Remaining Useful Life Prediction Based on a Double-Convolutional Neural Network Architecture , 2019, IEEE Transactions on Industrial Electronics.

[27]  Yan Dong,et al.  A new ensemble residual convolutional neural network for remaining useful life estimation. , 2019, Mathematical biosciences and engineering : MBE.

[28]  Zhenyu Wu,et al.  A Domain Adaptive Convolutional LSTM Model for Prognostic Remaining Useful Life Estimation Under Variant Conditions , 2019, 2019 Prognostics and System Health Management Conference (PHM-Paris).

[29]  Peng Ding,et al.  Mechatronics Equipment Performance Degradation Assessment Using Limited and Unlabeled Data , 2021, IEEE Transactions on Industrial Informatics.