Bidirectional handshaking LSTM for remaining useful life prediction

Abstract Unpredictable failures and unscheduled maintenance of physical systems increases production resources, produces more harmful waste for the environment, and increases system life cycle costs. Efficient remaining useful life (RUL) estimation can alleviate such an issue. The RUL is predicted by making use of the data collected from several types of sensors that continuously record different indicators about a working asset, such as vibration intensity or exerted pressure. This type of continuous monitoring data is sequential in time, as it is collected at a certain rate from the sensors during the asset's work. Long Short-Term Memory (LSTM) neural network models have been demonstrated to be efficient throughout the literature when dealing with sequential data because of their ability to retain a lot of information over time about previous states of the system. This paper proposes using a new LSTM architecture for predicting the RUL when given short sequences of monitored observations with random initial wear. By using LSTM, this paper proposes a new objective function that is suitable for the RUL estimation problem, as well as a new target generation approach for training LSTM networks, which requires making lesser assumptions about the actual degradation of the system.

[1]  K. Goebel,et al.  Metrics for evaluating performance of prognostic techniques , 2008, 2008 International Conference on Prognostics and Health Management.

[2]  A. Hess,et al.  Challenges, issues, and lessons learned chasing the "Big P". Real predictive prognostics. Part 1 , 2005, 2005 IEEE Aerospace Conference.

[3]  Enrico Zio,et al.  Ensemble of optimized echo state networks for remaining useful life prediction , 2017, Neurocomputing.

[4]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[5]  Shen Yin,et al.  Comparison of KPI related fault detection algorithms using a newly developed MATLAB toolbox: DB-KIT , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[6]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[7]  Jay Lee,et al.  Self-maintenance and engineering immune systems: Towards smarter machines and manufacturing systems , 2011, Annu. Rev. Control..

[8]  F.O. Heimes,et al.  Recurrent neural networks for remaining useful life estimation , 2008, 2008 International Conference on Prognostics and Health Management.

[9]  Tianyou Zhang,et al.  Health Index-Based Prognostics for Remaining Useful Life Predictions in Electrical Machines , 2016, IEEE Transactions on Industrial Electronics.

[10]  Donghua Zhou,et al.  Remaining useful life estimation - A review on the statistical data driven approaches , 2011, Eur. J. Oper. Res..

[11]  Noureddine Zerhouni,et al.  State of the art and taxonomy of prognostics approaches, trends of prognostics applications and open issues towards maturity at different technology readiness levels , 2017 .

[12]  Lin Ma,et al.  Prognostic modelling options for remaining useful life estimation by industry , 2011 .

[13]  Noureddine Zerhouni,et al.  A New Multivariate Approach for Prognostics Based on Extreme Learning Machine and Fuzzy Clustering , 2015, IEEE Transactions on Cybernetics.

[14]  Venkat Venkatasubramanian,et al.  Prognostic and diagnostic monitoring of complex systems for product lifecycle management: Challenges and opportunities , 2005, Comput. Chem. Eng..

[15]  Guoqiang Peter Zhang,et al.  Trend Time–Series Modeling and Forecasting With Neural Networks , 2008, IEEE Transactions on Neural Networks.

[16]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[17]  Chetan Gupta,et al.  Long Short-Term Memory Network for Remaining Useful Life estimation , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[18]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[19]  Yuan Fuqing,et al.  RUL prediction using moving trajectories between SVM hyper planes , 2012, 2012 Proceedings Annual Reliability and Maintainability Symposium.

[20]  Brigitte Chebel-Morello,et al.  Direct Remaining Useful Life Estimation Based on Support Vector Regression , 2017, IEEE Transactions on Industrial Electronics.

[21]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Shen Yin,et al.  Recent results on key performance indicator oriented fault detection using the DB-KIT toolbox , 2017, IECON 2017 - 43rd Annual Conference of the IEEE Industrial Electronics Society.

[24]  Biqing Huang,et al.  Approach for fault prognosis using recurrent neural network , 2018, J. Intell. Manuf..

[25]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[26]  Kai Goebel,et al.  Damage Propagation Modeling for Aircraft Engine Prognostics , 2008 .

[27]  Joseph Mathew,et al.  Intelligent condition-based prediction of machinery reliability , 2009 .

[28]  Wenyuan Lv,et al.  A novel method using adaptive hidden semi-Markov model for multi-sensor monitoring equipment health prognosis , 2015 .

[29]  Sankalita Saha,et al.  Metrics for Offline Evaluation of Prognostic Performance , 2021, International Journal of Prognostics and Health Management.

[30]  Dawn An,et al.  Practical options for selecting data-driven or physics-based prognostics algorithms with reviews , 2015, Reliab. Eng. Syst. Saf..

[31]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[32]  Tak-Chung Fu,et al.  A review on time series data mining , 2011, Eng. Appl. Artif. Intell..

[33]  Emmanuel Ramasso,et al.  Investigating Computational Geometry for Failure Prognostics in Presence of Imprecise Health Indicator: Results and Comparisons on C-MAPSS Datasets , 2014 .

[34]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[35]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[36]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[37]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.