Power management for Plug-in Hybrid Electric Vehicles using Reinforcement Learning with trip information

In this paper, we present a new method of power management for Plug-in Hybrid Electric Vehicles (PHEVs) using Reinforcement Learning technique combined with trip information. Our new control strategy uses the remaining travel distance, which can be easily obtained from today's Global Positioning System (GPS), for the energy optimization of PHEVs. For a given trip, the remaining distance is highly correlated to the future energy consumption, a quantity our controller tries to learn and optimize continuously. The simulation results confirm the self-improving capability of our reinforcement learning controller and show that our controller outperforms the rule-based controller with respect to a defined reward function.

[1]  Qing Wang,et al.  Intelligent Hybrid Vehicle Power Control—Part II: Online Intelligent Energy Management , 2013, IEEE Transactions on Vehicular Technology.

[2]  Thierry-Marie Guerra,et al.  Equivalent consumption minimization strategy for parallel hybrid powertrains , 2002, Vehicular Technology Conference. IEEE 55th Vehicular Technology Conference. VTC Spring 2002 (Cat. No.02CH37367).

[3]  Huei Peng,et al.  A stochastic control strategy for hybrid electric vehicles , 2004, Proceedings of the 2004 American Control Conference.

[4]  Yan Yang,et al.  Analytical Approach for the Power Management of Blended-Mode Plug-In Hybrid Electric Vehicles , 2012, IEEE Transactions on Vehicular Technology.

[5]  Warren B. Powell,et al.  Approximate Dynamic Programming - Solving the Curses of Dimensionality , 2007 .

[6]  Yaoyu Li,et al.  Computationally efficient optimal power management for plug-in hybrid electric vehicles based on spatial-domain two-scale dynamic programming , 2008, 2008 IEEE International Conference on Vehicular Electronics and Safety.

[7]  Yangsheng Xu,et al.  Dynamic energy management for hybrid electric vehicle based on adaptive dynamic programming , 2008, 2008 IEEE International Conference on Industrial Technology.

[8]  Mutasim A. Salman,et al.  Fuzzy logic control for parallel hybrid vehicles , 2002, IEEE Trans. Control. Syst. Technol..

[9]  Yi Lu Murphey,et al.  Intelligent Hybrid Vehicle Power Control—Part I: Machine Learning of Optimal Vehicle Power , 2012, IEEE Transactions on Vehicular Technology.

[10]  Chunting Chris Mi,et al.  Charge-Depleting Control Strategies and Fuel Optimization of Blended-Mode Plug-In Hybrid Electric Vehicles , 2011, IEEE Transactions on Vehicular Technology.

[11]  Dominik Karbowski,et al.  "Fair" Comparison of Powertrain Configurations for Plug-In Hybrid Operation Using Global Optimization , 2009 .

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Hosam K. Fathy,et al.  A Stochastic Optimal Control Approach for Power Management in Plug-In Hybrid Electric Vehicles , 2008 .