Cubic spline approximations of the Dynamic Programming cost-to-go in HEV energy management problems

The energy management problem of a hybrid electric vehicle (HEV) is a non-linear and mixed integer optimization problem. The problem can be solved with Dynamic Programming (DP), but the algorithm requires the problem to be gridded in time, states and control signals. To ensure a high accuracy of the solution the grid must be dense, meaning that the cost-to-go can require several megabytes of memory. The scope of this paper is therefore twofold. The first topic is a sensitivity study, where the effect of a sparsely gridded state is investigated, both for an HEV and a plug-in HEV (PHEV). The study shows that it is possible to use a sparse grid for an HEV, but not for a PHEV. The second topic and the main contribution is a method to approximate the DP cost-to-go with cubic splines. The results indicate that it is possible to use only a few splines, if the knot points are determined based on the characteristics of the cost-to-go. Thereby it is possible to significantly reduce the memory requirements, without any noticeable increase in simulated fuel consumption.

[1]  Giorgio Rizzoni,et al.  A-ECMS: An Adaptive Algorithm for Hybrid Electric Vehicle Energy Management , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[2]  Anders Grauers,et al.  Optimal Sizing of a Parallel PHEV Powertrain , 2013, IEEE Transactions on Vehicular Technology.

[3]  Lino Guzzella,et al.  Optimal control of parallel hybrid electric vehicles , 2004, IEEE Transactions on Control Systems Technology.

[4]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[5]  Xiaosong Hu,et al.  A comparative study of equivalent circuit models for Li-ion batteries , 2012 .

[6]  L. Johannesson,et al.  Approximate Dynamic Programming Applied to Parallel Hybrid Powertrains , 2008 .

[7]  Ying Li,et al.  Numerical Solution of Continuous-State Dynamic Programs Using Linear and Spline Interpolation , 1993, Oper. Res..

[8]  Bo Egardt,et al.  Predictive energy management of a 4QT series-parallel hybrid electric bus , 2009 .

[9]  Erik Hellström,et al.  Design of an efficient algorithm for fuel-optimal look-ahead control , 2010 .

[10]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[11]  K. Judd,et al.  Dynamic programming with shape-preserving rational spline Hermite interpolation , 2012 .

[12]  Sten Karlsson,et al.  Commuter Route Optimized Energy Management of Hybrid Electric Vehicles , 2014, IEEE Transactions on Intelligent Transportation Systems.

[13]  Chen Zhang,et al.  Route Preview in Energy Management of Plug-in Hybrid Vehicles , 2012, IEEE Transactions on Control Systems Technology.