Towards a Smarter Energy Management System for Hybrid Vehicles: A Comprehensive Review of Control Strategies

This paper presents a comprehensive review of energy management control strategies utilized in hybrid electric vehicles (HEVs). These can be categorized as rule-based strategies and optimization-based strategies. Rule-based strategies, as the most basic strategy, are widely used due to their simplicity and practical application. The focus of rule-based strategies is to determine and optimize the optimal threshold for mode switching; however, they fall into a local optimal solutions. To have better performance in energy management, optimization-based strategies were developed. The categories of the existing optimization-based strategies are identified from the latest literature, and a brief study of each strategy is discussed, which consists of the main research ideas, the research focus, advantages, disadvantages and improvements to ameliorate optimality and real-time performance. Deterministic dynamic programming strategy is regarded as a benchmark. Based on neural network and the large data processing technology, data-driven strategies are put forward due to their approximate optimality and high computational efficiency. Finally, the comprehensive performance of each control strategy is analyzed with respect to five aspects. This paper not only provides a comprehensive analysis of energy management control strategies for HEVs, but also presents the emphasis in the future.

[1]  Zhipeng Liu,et al.  Driver Behavior Characteristics Identification Strategies Based on Bionic Intelligent Algorithms , 2018, IEEE Transactions on Human-Machine Systems.

[2]  Mattias Hovgard,et al.  Cooperative energy management of electrified vehicles on hilly roads , 2018 .

[3]  Jiayi Cao,et al.  Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle , 2018 .

[4]  Mohammad J. Mahjoob,et al.  Optimal energy management in a dual-storage fuel-cell hybrid vehicle using multi-dimensional dynamic programming , 2014 .

[5]  Bob McQueen,et al.  Intelligent transportation systems architectures , 1999 .

[6]  Yong Huang,et al.  Data-driven hierarchical control for online energy management of plug-in hybrid electric city bus , 2018 .

[7]  Junqi Yang,et al.  Model Predictive Control for Connected Hybrid Electric Vehicles , 2015 .

[8]  Mahdi Shahbakhti,et al.  Fuel consumption assessment of an electrified powertrain with a multi-mode high-efficiency engine in various levels of hybridization , 2018 .

[9]  Junqiang Xi,et al.  Driving-Style-Oriented Adaptive Equivalent Consumption Minimization Strategies for HEVs , 2018, IEEE Transactions on Vehicular Technology.

[10]  Naehyuck Chang,et al.  A deep reinforcement learning framework for optimizing fuel economy of hybrid electric vehicles , 2018, 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC).

[11]  Maciej Wieczorek,et al.  A mathematical representation of an energy management strategy for hybrid energy storage system in electric vehicle and real time optimization using a genetic algorithm , 2017 .

[12]  Shuo Zhang,et al.  Adaptive energy management of a plug-in hybrid electric vehicle based on driving pattern recognition and dynamic programming , 2015 .

[13]  Dirk Söffker,et al.  Realtime Application of Progressive Optimal Search and Adaptive Dynamic Programming in Multi-Source HEVs , 2017 .

[14]  Shuo Zhang,et al.  Pontryagin’s Minimum Principle-based power management of a dual-motor-driven electric bus , 2015 .

[15]  Zhen Wu,et al.  Research on energy optimization control strategy of the hybrid electric vehicle based on Pontryagin's minimum principle , 2018, Comput. Electr. Eng..

[16]  Aymeric Rousseau,et al.  Plug-in Hybrid Electric Vehicle Control Strategy: Comparison between EV and Charge-Depleting Options , 2008 .

[17]  Chao Yang,et al.  Driving-behavior-aware stochastic model predictive control for plug-in hybrid electric buses , 2016 .

[18]  Ali Emadi,et al.  ADVISOR-based model of a battery and an ultra-capacitor energy source for hybrid electric vehicles , 2004, IEEE Transactions on Vehicular Technology.

[19]  Warren B. Powell.  Introduction to Markov Decision Processes , 2007 .

[20]  Feng Ding,et al.  Energy management of a dual-mode power-split hybrid electric vehicle based on velocity prediction and nonlinear model predictive control , 2017 .

[21]  Chen Wei-qiang.  Energy Management Strategy for Series Hybrid Electric Vehicle , 2013 .

[22]  Yi Yang,et al.  A Two-Stage Method for UCAV TF/TA Path Planning Based on Approximate Dynamic Programming , 2018 .

[23]  Jian Song,et al.  Two-step optimal energy management strategy for single-shaft series-parallel powertrain , 2016 .

[24]  Haibo He,et al.  Novel iterative neural dynamic programming for data-based approximate optimal control design , 2017, Autom..

[25]  Feng Jifeng,et al.  Research on the energy management of composite energy storage system in electric vehicles , 2018 .

[26]  Timothy C. Havens,et al.  Fuzzy logic controller for energy management of power split hybrid electrical vehicle transmission , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[27]  Suk Won Cha,et al.  Co-state variable determination in Pontryagin’s Minimum Principle for energy management of hybrid vehicles , 2016 .

[28]  Zhuoping Yu,et al.  Optimization of Key Parameters of Energy Management Strategy for Hybrid Electric Vehicle Using DIRECT Algorithm , 2016 .

[29]  Emmanuel Vinot,et al.  Time Reduction of the Dynamic programming computation in the case of hybrid vehicle , 2014 .

[30]  D. Clodic,et al.  Optimized energy management control for the Toyota Hybrid System using dynamic programming on a predicted route with short computation time , 2012 .

[31]  Chao Yang,et al.  Hybrid genetic algorithm-based optimization of powertrain and control parameters of plug-in hybrid electric bus , 2015, J. Frankl. Inst..

[32]  Chunting Chris Mi,et al.  Charge-Depleting Control Strategies and Fuel Optimization of Blended-Mode Plug-In Hybrid Electric Vehicles , 2011, IEEE Transactions on Vehicular Technology.

[33]  Xiaosong Hu,et al.  Energy efficiency analysis of a series plug-in hybrid electric bus with different energy management strategies and battery sizes , 2013 .

[34]  Hewu Wang,et al.  Battery degradation minimization oriented energy management strategy for plug-in hybrid electric bus with multi-energy storage system , 2018, Energy.

[35]  Ramon Gonzalez,et al.  Energy management strategy for plug-in hybrid electric vehicles. A comparative study , 2014 .

[36]  Huaguang Zhang,et al.  Neural-Network-Based Constrained Optimal Control Scheme for Discrete-Time Switched Nonlinear System Using Dual Heuristic Programming , 2014, IEEE Transactions on Automation Science and Engineering.

[37]  Naehyuck Chang,et al.  Optimizing fuel economy of hybrid electric vehicles using a Markov decision process model , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[38]  Hongwen He,et al.  An energy management strategy based on stochastic model predictive control for plug-in hybrid electric buses , 2017 .

[39]  Hongwen He,et al.  Continuous reinforcement learning of energy management with deep Q network for a power split hybrid electric bus , 2018, Applied Energy.

[40]  Bo Gao,et al.  Energy Management in Plug-in Hybrid Electric Vehicles: Recent Progress and a Connected Vehicles Perspective , 2017, IEEE Transactions on Vehicular Technology.

[41]  Tingwen Huang,et al.  Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems , 2017, Inf. Sci..

[42]  Hongwen He,et al.  Model Predictive Control for Energy Management of a Plug-in Hybrid Electric Bus☆ , 2016 .

[43]  Hosam K. Fathy,et al.  Tradeoffs between battery energy capacity and stochastic optimal power management in plug-in hybrid electric vehicles , 2010 .

[44]  Xiaosong Hu,et al.  Comparison of power-split and parallel hybrid powertrain architectures with a single electric machine: Dynamic programming approach , 2016 .

[45]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[46]  Chunting Chris Mi,et al.  A novel energy management method for series plug-in hybrid electric vehicles , 2015 .

[47]  Chun Wang,et al.  An on-line predictive energy management strategy for plug-in hybrid electric vehicles to counter the uncertain prediction of the driving cycle , 2017 .

[48]  M. Becherif,et al.  Energy Management Improvement of Hybrid Electric Vehicles via Combined GPS/Rule-Based Methodology , 2017, IEEE Transactions on Automation Science and Engineering.

[49]  Dunant Halim,et al.  Study of HEV power management control strategy based on driving pattern recognition , 2016 .

[50]  Zheng Chen,et al.  Energy Management for a Power-Split Plug-In Hybrid Electric Vehicle Based on Reinforcement Learning , 2018, Applied Sciences.

[51]  Yan Yang,et al.  Analytical Approach for the Power Management of Blended-Mode Plug-In Hybrid Electric Vehicles , 2012, IEEE Transactions on Vehicular Technology.

[52]  Aiguo Song,et al.  Iterative GDHP-based approximate optimal tracking control for a class of discrete-time nonlinear systems , 2016, Neurocomputing.

[53]  Andreas A. Malikopoulos.  Supervisory Power Management Control Algorithms for Hybrid Electric Vehicles: A Survey , 2014, IEEE Transactions on Intelligent Transportation Systems.

[54]  Huei Peng,et al.  Optimal Control of Hybrid Electric Vehicles Based on Pontryagin's Minimum Principle , 2011, IEEE Transactions on Control Systems Technology.

[55]  Jeffrey B. Burl,et al.  Estimation of the ECMS Equivalent Factor Bounds for Hybrid Electric Vehicles , 2018, IEEE Transactions on Control Systems Technology.

[56]  Sousso Kelouwani,et al.  Optimal economy-based battery degradation management dynamics for fuel-cell plug-in hybrid electric vehicles , 2015 .

[57]  Liang Chu,et al.  Research on Control Strategies of an Open-End Winding Permanent Magnet Synchronous Driving Motor (OW-PMSM)-Equipped Dual Inverter with a Switchable Winding Mode for Electric Vehicles , 2017 .

[58]  Yi Lu Murphey,et al.  Intelligent Hybrid Vehicle Power Control—Part I: Machine Learning of Optimal Vehicle Power , 2012, IEEE Transactions on Vehicular Technology.

[59]  Weiwen Deng,et al.  Typical-driving-style-oriented Personalized Adaptive Cruise Control design based on human driving data , 2019, Transportation Research Part C: Emerging Technologies.

[60]  Junmin Wang,et al.  A Parallel Hybrid Electric Vehicle Energy Management Strategy Using Stochastic Model Predictive Control With Road Grade Preview , 2015, IEEE Transactions on Control Systems Technology.

[61]  Haibo He,et al.  Data-Driven Finite-Horizon Approximate Optimal Control for Discrete-Time Nonlinear Systems Using Iterative HDP Approach , 2018, IEEE Transactions on Cybernetics.

[62]  Jingyuan Zhan,et al.  An On-Line Energy Management Strategy Based on Trip Condition Prediction for Commuter Plug-In Hybrid Electric Vehicles , 2018, IEEE Transactions on Vehicular Technology.

[63]  Yangsheng Xu,et al.  Online learning control for hybrid electric vehicle , 2012 .

[64]  Nan Xu,et al.  Optimal energy management strategy for parallel plug-in hybrid electric vehicle based on driving behavior analysis and real time traffic information prediction , 2017 .

[65]  Xiaosong Hu,et al.  Pontryagin’s Minimum Principle based model predictive control of energy management for a plug-in hybrid electric bus , 2019, Applied Energy.

[66]  Mohd Fua'ad Rahmat,et al.  Improved Fuel Economy of Through-the-Road Hybrid Electric Vehicle with Fuzzy Logic-Based Energy Management Strategy , 2018, Int. J. Fuzzy Syst..

[67]  Jun Wang,et al.  Research on the optimal power management strategy for a hybrid electric bus , 2015 .

[68]  M. Ouyang,et al.  Approximate Pontryagin’s minimum principle applied to the energy management of plug-in hybrid electric vehicles , 2014 .

[69]  Luigi Fortuna,et al.  Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control , 2009 .

[70]  Huei Peng,et al.  Supervisory Control of Parallel Hybrid Electric Vehicles for Fuel and Emission Reduction , 2011 .

[71]  Wencong Su,et al.  Distance-Based Ecological Driving Scheme Using a Two-Stage Hierarchy for Long-Term Optimization and Short-Term Adaptation , 2017, IEEE Transactions on Vehicular Technology.

[72]  Yuan Zou,et al.  Real-time control for a parallel hybrid electric vehicle based on Pontryagin's Minimum Principle , 2014, 2014 IEEE Conference and Expo Transportation Electrification Asia-Pacific (ITEC Asia-Pacific).

[73]  Jianqiu Li,et al.  Optimization for a hybrid energy storage system in electric vehicles using dynamic programing approach , 2015 .

[74]  Alain Desrochers,et al.  Fuzzy-based blended control for the energy management of a parallel plug-in hybrid electric vehicle , 2015 .

[75]  Guoqing Xu,et al.  An Online Energy Management Control for Hybrid Electric Vehicles Based on Neuro-Dynamic Programming , 2018, Algorithms.

[76]  Fengchun Sun,et al.  Investigating adaptive-ECMS with velocity forecast ability for hybrid electric vehicles , 2017 .

[77]  Frank L. Lewis,et al.  Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[78]  Tae-Kyung Lee,et al.  Synthesis of Real-World Driving Cycles and Their Use for Estimating PHEV Energy Consumption and Charging Opportunities: Case Study for Midwest/U.S. , 2011, IEEE Transactions on Vehicular Technology.

[79]  Yanjun Huang,et al.  Model predictive control power management strategies for HEVs: A review , 2017 .

[80]  Jeffrey B. Burl,et al.  Catch energy saving opportunity (CESO), an instantaneous optimal energy management strategy for series hybrid electric vehicles , 2017 .

[81]  Dongpu Cao,et al.  Reinforcement Learning Optimized Look-Ahead Energy Management of a Parallel Hybrid Electric Vehicle , 2017, IEEE/ASME Transactions on Mechatronics.

[82]  Srdjan M. Lukic,et al.  Energy Storage Systems for Automotive Applications , 2008, IEEE Transactions on Industrial Electronics.

[83]  Ali Emadi,et al.  Classification and Review of Control Strategies for Plug-In Hybrid Electric Vehicles , 2011, IEEE Transactions on Vehicular Technology.

[84]  Tielong Shen,et al.  SDP Policy Iteration-Based Energy Management Strategy Using Traffic Information for Commuter Hybrid Electric Vehicles , 2014 .

[85]  Hongwen He,et al.  Rule based energy management strategy for a series–parallel plug-in hybrid electric bus optimized by dynamic programming , 2017 .

[86]  Jeffrey B. Burl,et al.  A New Real-Time Optimal Energy Management Strategy for Parallel Hybrid Electric Vehicles , 2019, IEEE Transactions on Control Systems Technology.

[87]  Hewu Wang,et al.  Energy management of plug-in hybrid electric vehicles with unknown trip length , 2015, J. Frankl. Inst..

[88]  Dirk Söffker,et al.  Optimal Rule-Based Power Management for Online, Real-Time Applications in HEVs with Multiple Sources and Objectives: A Review , 2015 .

[89]  Cong Zhang,et al.  A Single-Degree-of-Freedom Energy Optimization Strategy for Power-Split Hybrid Electric Vehicles , 2017 .

[90]  Paul J. Werbos,et al.  Approximate dynamic programming for real-time control and neural modeling , 1992 .

[91]  Shivanand Balram,et al.  Internet GIS: Distributed Geographic Information Services for the Internet and Wireless Networks , 2004 .

[92]  Yaobin Chen,et al.  A rule-based energy management strategy for Plug-in Hybrid Electric Vehicle (PHEV) , 2009, 2009 American Control Conference.

[93]  Derong Liu,et al.  Neural-network-based optimal tracking control scheme for a class of unknown discrete-time nonlinear systems using iterative ADP algorithm , 2014, Neurocomputing.

[94]  Hong Chen,et al.  Optimal Energy Management for HEVs in Eco-Driving Applications Using Bi-Level MPC , 2017, IEEE Transactions on Intelligent Transportation Systems.

[95]  Ahmed M. Ali,et al.  Realtime Power Management of a Multi-Source HEV Using Adaptive Dynamic Programing and Probabilistic Drive State Model , 2017 .

[96]  Stefano Di Cairano,et al.  MPC-Based Energy Management of a Power-Split Hybrid Electric Vehicle , 2012, IEEE Transactions on Control Systems Technology.

[97]  Hao Ying,et al.  Fuzzy Rule-Based Driver Advisory System for Fuel Economy Improvement in a Hybrid Electric Vehicle , 2007, NAFIPS 2007 - 2007 Annual Meeting of the North American Fuzzy Information Processing Society.

[98]  Samir Jemei,et al.  Nonlinear autoregressive neural network in an energy management strategy for battery/ultra-capacitor hybrid electrical vehicles , 2016 .

[99]  Alberto Bemporad,et al.  Stochastic MPC With Learning for Driver-Predictive Vehicle Control and its Application to HEV Energy Management , 2014, IEEE Transactions on Control Systems Technology.

[100]  Hongwen He,et al.  Battery SOC constraint comparison for predictive energy management of plug-in hybrid electric bus , 2017 .

[101]  Yugong Luo,et al.  Predictive Energy Management Strategy for Fully Electric Vehicles Based on Preceding Vehicle Movement , 2017, IEEE Transactions on Intelligent Transportation Systems.

[102]  Chenming Li,et al.  Energy Management Strategy for a Hybrid Electric Vehicle Based on Deep Reinforcement Learning , 2018 .

[103]  Yong Huang,et al.  A length ratio based neural network energy management strategy for online control of plug-in hybrid electric city bus , 2016 .

[104]  Hongwen He,et al.  A Comparative Study of Supervisory Control Strategies for a Series Hybrid Electric Vehicle , 2009, 2009 Asia-Pacific Power and Energy Engineering Conference.

[105]  Datong Qin,et al.  Rule-corrected energy management strategy for hybrid electric vehicles based on operation-mode prediction , 2018, Journal of Cleaner Production.

[106]  Bo-Chiuan Chen,et al.  Design and analysis of power management strategy for range extended electric vehicle using dynamic programming , 2014 .

[107]  Hongwen He,et al.  Application Study on the Dynamic Programming Algorithm for Energy Management of Plug-in Hybrid Electric Vehicles , 2015 .

[108]  Dongsuk Kum,et al.  Synthesis of Predictive Equivalent Consumption Minimization Strategy for Hybrid Electric Vehicles Based on Closed-Form Solution of Optimal Equivalence Factor , 2017, IEEE Transactions on Vehicular Technology.

[109]  Hongwen He,et al.  Plug-In Hybrid Electric Bus Energy Management Based on Stochastic Model Predictive Control , 2017 .

[110]  Sam Akehurst,et al.  Stochastic Dynamic Programming in the Real-World Control of Hybrid Electric Vehicles , 2016, IEEE Transactions on Control Systems Technology.

[111]  Bing Xia,et al.  Energy management of power-split plug-in hybrid electric vehicles based on simulated annealing and Pontryagin's minimum principle , 2014 .