Fast Learning-based Control for Energy Management of Hybrid Electric Vehicles

Abstract In this paper, a fast learning-based control method is proposed for energy management of hy-brid electric vehicles. First, the modeling of a parallel hybrid electric vehicle (HEV) is introduced. Energy management of the parallel HEV is constructed as an optimal control problem. Then, the reinforcement learning (RL) framework is depicted and a learning-based approach named Dyna-H algorithm is illustrated via incorporating a heuristic planning strategy into a Dyna agent. Finally, the proposed energy management strategy is compared with the benchmark methods to show its merits. Results indicate that the learning-based controls have better performance in fuel economy and calculation speed.

[1]  Kao-Shing Hwang,et al.  Pheromone-Based Planning Strategies in Dyna-Q Learning , 2017, IEEE Transactions on Industrial Informatics.

[2]  Bo Gao,et al.  Energy Management in Plug-in Hybrid Electric Vehicles: Recent Progress and a Connected Vehicles Perspective , 2017, IEEE Transactions on Vehicular Technology.

[3]  Yuan Zou,et al.  Reinforcement Learning of Adaptive Energy Management With Transition Probability for a Hybrid Electric Tracked Vehicle , 2015, IEEE Transactions on Industrial Electronics.

[4]  Simona Onori,et al.  A Comparative Analysis of Energy Management Strategies for Hybrid Electric Vehicles , 2011 .

[5]  Valerie H. Johnson,et al.  Battery performance models in ADVISOR , 2002 .

[6]  Yuan Zou,et al.  Reinforcement learning-based real-time energy management for a hybrid tracked vehicle , 2016 .

[7]  Dongpu Cao,et al.  Reinforcement Learning Optimized Look-Ahead Energy Management of a Parallel Hybrid Electric Vehicle , 2017, IEEE/ASME Transactions on Mechatronics.

[8]  Teng Liu,et al.  A Bi-Level Control for Energy Efficiency Improvement of a Hybrid Tracked Vehicle , 2018, IEEE Transactions on Industrial Informatics.

[9]  Bo Geng,et al.  Energy Management Control of Microturbine-Powered Plug-In Hybrid Electric Vehicles Using the Telemetry Equivalent Consumption Minimization Strategy , 2011, IEEE Transactions on Vehicular Technology.

[10]  H. JoséAntonioMartín,et al.  Dyna-H: A heuristic planning reinforcement learning algorithm applied to role-playing game strategy decision systems , 2011, Knowl. Based Syst..

[11]  Simona Onori,et al.  Adaptive Pontryagin’s Minimum Principle supervisory controller design for the plug-in hybrid GM Chevrolet Volt , 2015 .

[12]  P. Goulart,et al.  High-Speed Finite Control Set Model Predictive Control for Power Electronics , 2015, IEEE Transactions on Power Electronics.

[13]  Richard S. Sutton,et al.  Dyna, an integrated architecture for learning, planning, and reacting , 1990, SGAR.

[14]  Hamid Khayyam,et al.  Adaptive intelligent energy management system of plug-in hybrid electric vehicle , 2014 .