Uncovering the Underlying Physics of Degrading System Behavior Through a Deep Neural Network Framework: The Case of Remaining Useful Life Prognosis

Deep learning (DL) has become an essential tool in prognosis and health management (PHM), commonly used as a regression algorithm for the prognosis of a system's behavior. One particular metric of interest is the remaining useful life (RUL) estimated using monitoring sensor data. Most of these deep learning applications treat the algorithms as black-box functions, giving little to no control of the data interpretation. This becomes an issue if the models break the governing laws of physics or other natural sciences when no constraints are imposed. The latest research efforts have focused on applying complex DL models to achieve a low prediction error rather than studying how the models interpret the behavior of the data and the system itself. In this paper, we propose an open-box approach using a deep neural network framework to explore the physics of degradation through partial differential equations (PDEs). The framework has three stages, and it aims to discover a latent variable and corresponding PDE to represent the health state of the system. Models are trained as a supervised regression and designed to output the RUL as well as a latent variable map that can be used and interpreted as the system's health indicator.

[1]  Zhiyu Zhu,et al.  A novel deep learning method based on attention mechanism for bearing remaining useful life prediction , 2020, Appl. Soft Comput..

[2]  Joeri Van Mierlo,et al.  Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review , 2019, Renewable and Sustainable Energy Reviews.

[3]  Enrique López Droguett,et al.  Condition-Based Maintenance with Reinforcement Learning for Dry Gas Pipeline Subject to Internal Corrosion , 2020, Sensors.

[4]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[5]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[6]  Enrico Zio,et al.  Towards Developing a Novel Framework for Practical PHM: a Sequential Decision Problem solved by Reinforcement Learning and Artificial Neural Networks , 2020 .

[7]  Roger Nkambou,et al.  IMPROVING ADAM OPTIMIZER , 2018 .

[8]  Byeng D. Youn,et al.  A comprehensive review of artificial intelligence-based approaches for rolling element bearing PHM: shallow and deep learning , 2019, JMST Advances.

[9]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[10]  Amir Asif,et al.  A multimodal and hybrid deep neural network model for Remaining Useful Life estimation , 2019, Comput. Ind..

[11]  Lang Xu,et al.  A new method for the estimation of bearing health state and remaining useful life based on the moving average cross-correlation of power spectral density , 2020, Mechanical Systems and Signal Processing.

[12]  Yong Yu,et al.  Averaged Bi-LSTM networks for RUL prognostics with non-life-cycle labeled dataset , 2020, Neurocomputing.

[13]  Beitong Zhou,et al.  Remaining useful life prediction of lithium-ion batteries based on false nearest neighbors and a hybrid neural network , 2019, Applied Energy.

[14]  Huihui Miao,et al.  Joint Learning of Degradation Assessment and RUL Prediction for Aeroengines via Dual-Task Deep LSTM Networks , 2019, IEEE Transactions on Industrial Informatics.

[15]  Bin Liang,et al.  Remaining useful life prediction of aircraft engine based on degradation pattern learning , 2017, Reliab. Eng. Syst. Saf..

[16]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[17]  Weixiong Wu,et al.  Remaining useful life prediction of lithium-ion battery based on improved cuckoo search particle filter and a novel state of charge estimation method , 2020 .

[18]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[19]  Michael Pecht,et al.  Remaining useful life estimation of lithium-ion cells based on k-nearest neighbor regression with differential evolution optimization , 2020 .

[20]  Soumaya Yacout,et al.  Bidirectional handshaking LSTM for remaining useful life prediction , 2019, Neurocomputing.

[21]  Jian Ma,et al.  Cycle life test optimization for different Li-ion power battery formulations using a hybrid remaining-useful-life prediction method , 2020 .

[22]  Donghua Zhou,et al.  Remaining useful life estimation - A review on the statistical data driven approaches , 2011, Eur. J. Oper. Res..

[23]  Linxia Liao,et al.  Review of Hybrid Prognostics Approaches for Remaining Useful Life Prediction of Engineered Systems, and an Application to Battery Life Prediction , 2014, IEEE Transactions on Reliability.

[24]  Wei Zhang,et al.  Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction , 2019, Reliab. Eng. Syst. Saf..

[25]  Yaguo Lei,et al.  An Improved Exponential Model for Predicting Remaining Useful Life of Rolling Element Bearings , 2015, IEEE Transactions on Industrial Electronics.

[26]  Jun Zhu,et al.  A new data-driven transferable remaining useful life prediction approach for bearing under different working conditions , 2020 .

[27]  M. Dubarry,et al.  Perspective on State-of-Health Determination in Lithium-Ion Batteries , 2019, Journal of Electrochemical Energy Conversion and Storage.

[28]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[29]  Kai Goebel,et al.  Damage Propagation Modeling for Aircraft Engine Prognostics , 2008 .

[30]  Manuel Esperon-Miguez,et al.  A review of physics-based models in prognostics: Application to gears and bearings of rotating machinery , 2016 .

[31]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[32]  Yaguo Lei,et al.  Machinery health prognostics: A systematic review from data acquisition to RUL prediction , 2018 .