Long Short-Term Memory Recurrent Neural Network for Remaining Useful Life Prediction of Lithium-Ion Batteries

Remaining useful life (RUL) prediction of lithium-ion batteries can assess the battery reliability to determine the advent of failure and mitigate battery risk. The existing RUL prediction techniques for lithium-ion batteries are inefficient for learning the long-term dependencies among the capacity degradations. This paper investigates deep-learning-enabled battery RUL prediction. The long short-term memory (LSTM) recurrent neural network (RNN) is employed to learn the long-term dependencies among the degraded capacities of lithium-ion batteries. The LSTM RNN is adaptively optimized using the resilient mean square back-propagation method, and a dropout technique is used to address the overfitting problem. The developed LSTM RNN is able to capture the underlying long-term dependencies among the degraded capacities and construct an explicitly capacity-oriented RUL predictor, whose long-term learning performance is contrasted to the support vector machine model, the particle filter model, and the simple RNN model. Monte Carlo simulation is combined to generate a probabilistic RUL prediction. Experimental data from multiple lithium-ion cells at two different temperatures is deployed for model construction, verification, and comparison. The developed method is able to predict the battery's RUL independent of offline training data, and when some offline data is available, the RUL can be predicted earlier than in the traditional methods.

[1]  Chao Lyu,et al.  Remaining capacity estimation of Li-ion batteries based on temperature sample entropy and particle filter , 2014 .

[2]  Junwei Han,et al.  Particle Learning Framework for Estimating the Remaining Useful Life of Lithium-Ion Batteries , 2017, IEEE Transactions on Instrumentation and Measurement.

[3]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[4]  Alex Graves,et al.  Generating Sequences With Recurrent Neural Networks , 2013, ArXiv.

[5]  Xiaohong Su,et al.  Interacting multiple model particle filter for prognostics of lithium-ion batteries , 2017, Microelectron. Reliab..

[6]  Kyomin Jung,et al.  Efficient Transfer Learning Schemes for Personalized Language Modeling using Recurrent Neural Network , 2017, AAAI Workshops.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Bhaskar Saha,et al.  An Adaptive Recurrent Neural Network for Remaining Useful Life Prediction of Lithium-ion Batteries , 2010 .

[9]  Michael Buchholz,et al.  Health diagnosis and remaining useful life prognostics of lithium-ion batteries using data-driven methods , 2013 .

[10]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[11]  Jay Lee,et al.  A review on prognostics and health monitoring of Li-ion battery , 2011 .

[12]  Andreas Jossen,et al.  Comprehensive Modeling of Temperature-Dependent Degradation Mechanisms in Lithium Iron Phosphate Batteries , 2017 .

[13]  Hongwen He,et al.  Lithium-Ion Battery Pack State of Charge and State of Energy Estimation Algorithms Using a Hardware-in-the-Loop Validation , 2017, IEEE Transactions on Power Electronics.

[14]  Karl Aberer,et al.  Robust Online Time Series Prediction with Recurrent Neural Networks , 2016, 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA).

[15]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[16]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[17]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[18]  Hongwen He,et al.  A Double-Scale, Particle-Filtering, Energy State Prediction Algorithm for Lithium-Ion Batteries , 2018, IEEE Transactions on Industrial Electronics.

[19]  Mohammad Rezvani,et al.  A Comparative Analysis of Techniques for Electric Vehicle Battery Prognostics and Health Management (PHM) , 2011 .

[20]  Lixin Wang,et al.  A lead-acid battery's remaining useful life prediction by using electrochemical model in the Particle Filtering framework , 2017 .

[21]  Kwok-Leung Tsui,et al.  An ensemble model for predicting the remaining useful performance of lithium-ion batteries , 2013, Microelectron. Reliab..

[22]  Zhang Chao,et al.  Short-term prediction of wind power based on deep Long Short-Term Memory , 2016, 2016 IEEE PES Asia-Pacific Power and Energy Engineering Conference (APPEEC).

[23]  Qiang Miao,et al.  Prognostics of lithium-ion batteries based on relevance vectors and a conditional three-parameter capacity degradation model , 2013 .

[24]  Alaa Mohamed Riad,et al.  Prognostics: a literature review , 2016, Complex & Intelligent Systems.

[25]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[26]  M. Verbrugge,et al.  Degradation of lithium ion batteries employing graphite negatives and nickel-cobalt-manganese oxide + spinel manganese oxide positives: Part 1, aging mechanisms and life estimation , 2014 .

[27]  A. Tikhonov On the stability of inverse problems , 1943 .

[28]  Sebastian Ruder,et al.  An overview of gradient descent optimization algorithms , 2016, Vestnik komp'iuternykh i informatsionnykh tekhnologii.

[29]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Ye Tao,et al.  A novel health indicator for on-line lithium-ion batteries remaining useful life prediction , 2016 .

[31]  Fei-Yue Wang,et al.  Travel time prediction with LSTM neural network , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[32]  Oleg Wasynczuk,et al.  Physically-based reduced-order capacity loss model for graphite anodes in Li-ion battery cells , 2017 .

[33]  Taejung Yeo,et al.  A novel multistage Support Vector Machine based approach for Li ion battery remaining useful life estimation , 2015 .

[34]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[35]  Christian Fleischer,et al.  Critical review of the methods for monitoring of lithium-ion batteries in electric and hybrid vehicles , 2014 .

[36]  Michael Osterman,et al.  Prognostics of lithium-ion batteries based on DempsterShafer theory and the Bayesian Monte Carlo me , 2011 .