Adaptive Hierarchical Energy Management Design for a Plug-In Hybrid Electric Vehicle

To promote the real-time application of the advanced energy management system in hybrid electric vehicles (HEVs), this paper proposes an adaptive hierarchical energy management strategy for a plug-in HEV. In this paper, deep learning (DL) and genetic algorithm (GA) are synthesized to derive the power split controls between the battery and internal combustion engine. First, the architecture of the multimode powertrain is founded, wherein the particular control actions, state variables, and optimization objective are explained. Then, the hierarchical framework for control actions generation is introduced. GA is utilized to search the global optimal controls based on the powertrain model provided in MATLAB/Simulink. DL is applied to train the neural network model that is connecting the inputs and control actions. Finally, the effectiveness of the presented integrated energy management strategy is validated via comparing with the original charge depleting/charge sustaining policy. Simulation results indicate that the proposed technique can highly improve the fuel economy. Furthermore, a hardware-in-the-loop is conducted to evaluate the adaptive and real-time characteristics of the designed energy management system.

[1]  Datong Qin,et al.  Energy Management for Plug-In Hybrid Electric Vehicle Based on Adaptive Simplified-ECMS , 2018, Sustainability.

[2]  Kaamran Raahemifar,et al.  Artificial neural network (ANN) based model predictive control (MPC) and optimization of HVAC systems: A state of the art review and case study of a residential HVAC system , 2017 .

[3]  Weihao Hu,et al.  A Heuristic Planning Reinforcement Learning-Based Energy Management for Power-Split Plug-in Hybrid Electric Vehicles , 2019, IEEE Transactions on Industrial Informatics.

[4]  Xiaofeng Yin,et al.  Stochastic Optimal Energy Management of Smart Home With PEV Energy Storage , 2018, IEEE Transactions on Smart Grid.

[5]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[6]  Laurent Mora,et al.  Model predictive control of a thermally activated building system to improve energy management of an experimental building: Part II - Potential of predictive strategy , 2018 .

[7]  Reza Langari,et al.  Intelligent energy management agent for a parallel hybrid vehicle-part I: system architecture and design of the driving situation identification process , 2005, IEEE Transactions on Vehicular Technology.

[8]  Sohrab Asgarpoor,et al.  Reinforcement Learning Approach for Optimal Distributed Energy Management in a Microgrid , 2018, IEEE Transactions on Power Systems.

[9]  Alain Bouscayrol,et al.  IEEE VTS Motor Vehicles Challenge 2018 - Energy Management of a Range Extender Electric Vehicle , 2017, 2017 IEEE Vehicle Power and Propulsion Conference (VPPC).

[10]  Bo Gao,et al.  Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey , 2018, IEEE Transactions on Intelligent Transportation Systems.

[11]  Teng Liu,et al.  A Bi-Level Control for Energy Efficiency Improvement of a Hybrid Tracked Vehicle , 2018, IEEE Transactions on Industrial Informatics.

[12]  X. Roboam,et al.  Optimized fuzzy rule-based energy management for a battery-less PV/wind-BWRO desalination system , 2018, Energy.

[13]  Ahmed Al-Durra,et al.  A comparative study of extremum seeking methods applied to online energy management strategy of fuel cell hybrid electric vehicles , 2017 .

[14]  Yuan Zou,et al.  Reinforcement Learning of Adaptive Energy Management With Transition Probability for a Hybrid Electric Tracked Vehicle , 2015, IEEE Transactions on Industrial Electronics.

[15]  Maciej Wieczorek,et al.  A mathematical representation of an energy management strategy for hybrid energy storage system in electric vehicle and real time optimization using a genetic algorithm , 2017 .

[16]  Simona Onori,et al.  Adaptive Pontryagin’s Minimum Principle supervisory controller design for the plug-in hybrid GM Chevrolet Volt , 2015 .

[17]  Teng Liu,et al.  Energy management for battery electric vehicle with automated mechanical transmission , 2015 .

[18]  Reza Langari,et al.  Intelligent energy management agent for a parallel hybrid vehicle-part II: torque distribution, charge sustenance strategies, and performance results , 2005, IEEE Transactions on Vehicular Technology.

[19]  Yuan Zou,et al.  A Real-Time Markov Chain Driver Model for Tracked Vehicles and Its Validation: Its Adaptability via Stochastic Dynamic Programming , 2017, IEEE Transactions on Vehicular Technology.

[20]  Hong Wang,et al.  Cyber-Physical Predictive Energy Management for Through-the-Road Hybrid Vehicles , 2019, IEEE Transactions on Vehicular Technology.

[21]  Yechen Qin,et al.  Online Energy Management for Multimode Plug-In Hybrid Electric Vehicles , 2019, IEEE Transactions on Industrial Informatics.

[22]  Heath Hofmann,et al.  Sliding-mode and Lyapunov function-based control for battery/supercapacitor hybrid energy storage system used in electric vehicles , 2017 .

[23]  Haisheng Yu,et al.  Research on the energy control of a dual-motor hybrid vehicle during engine start-stop process , 2019, Energy.

[24]  Hong Wang,et al.  Cyber-Physical Control for Energy Management of Off-Road Vehicles With Hybrid Energy Storage Systems , 2018, IEEE/ASME Transactions on Mechatronics.

[25]  Alain Bouscayrol,et al.  Energy Management in Fuel-Cell\/Battery Vehicles: Key Issues Identified in the IEEE Vehicular Technology Society Motor Vehicle Challenge 2017 , 2018, IEEE Vehicular Technology Magazine.

[26]  Naehyuck Chang,et al.  A deep reinforcement learning framework for optimizing fuel economy of hybrid electric vehicles , 2018, 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC).

[27]  Liang Li,et al.  Temporal-Difference Learning-Based Stochastic Energy Management for Plug-in Hybrid Electric Buses , 2019, IEEE Transactions on Intelligent Transportation Systems.

[28]  Bo Wang,et al.  Online Markov Chain-based energy management for a hybrid tracked vehicle with speedy Q-learning , 2018, Energy.

[29]  Yuan Zou,et al.  Reinforcement learning-based real-time energy management for a hybrid tracked vehicle , 2016 .

[30]  Chenming Li,et al.  Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning , 2018 .

[31]  Dongpu Cao,et al.  Reinforcement Learning Optimized Look-Ahead Energy Management of a Parallel Hybrid Electric Vehicle , 2017, IEEE/ASME Transactions on Mechatronics.

[32]  Huei Peng,et al.  Comparative Study of Dynamic Programming and Pontryagin’s Minimum Principle on Energy Management for a Parallel Hybrid Electric Vehicle , 2013 .

[33]  Datong Qin,et al.  Rule-corrected energy management strategy for hybrid electric vehicles based on operation-mode prediction , 2018, Journal of Cleaner Production.

[34]  Ahmed Al-Durra,et al.  Online Energy Management Strategy of Fuel Cell Hybrid Electric Vehicles: A Fractional-Order Extremum Seeking Method , 2018, IEEE Transactions on Industrial Electronics.