Optimal Control of Multi-Source Electric Vehicles in Real Time Using Advisory Dynamic Programming

This paper presents a novel method, advisory dynamic programming (AD-DP), for power management of a fuel cell hybrid vehicle (FCHEV). The presented method embraces a new understanding of vehicle states as driver-dependent and -independent states in time domain to define a suitable state space to be used for dynamic programming. Driver-dependent states are defined in terms of multiple characteristic parameters for vehicle speed and power demand, corporately. Driver-independent states are defined in terms of discrete values for supercapacitor's state of charge $SoC_{sc}$. Transition costs between all states in the state space are calculated offline and tabulated in look-up tables for online implementation. A state predictive model is developed based on the transition statistics of driver-dependent states for a suitable number of driving cycles. Backward calculation of the total transition cost for the predicted horizon in state space is used to define optimal power split strategy for the powertrain. The formulation of optimal control problem, in terms of situation-based solutions related to vehicle states, enables a significant reduction of computational steps and hence addresses the main challenge of real-time applications. The algorithm is adapted in terms of optimization horizon and number of discrete states for DIS to suit the real-time application. Experimental application of AD-DP, using an emulation test-rig, is conducted over different driving cycles. The obtained results reveal an improvement in energy efficiency up to 29% compared to the adaptive rule-based method. The contribution of this paper can be identified as: first, development of a corporate definition for vehicle states, that can be further implemented in optimization-based power management methods. Second, the formulation of an adaptive DP that requires lower computational steps and hence suits real-time applications in hybrid electric vehicles.

[1]  Pierluigi Pisu,et al.  Dynamic Modeling of a Hybrid Electric Drivetrain for Fuel Economy, Performance and Driveability Evaluations , 2003 .

[2]  Lino Guzzella,et al.  Convex Optimization for the Energy Management of Hybrid Electric Vehicles Considering Engine Start and Gearshift Costs , 2014 .

[3]  Pei Zhang,et al.  A comprehensive analysis of energy management strategies for hybrid electric vehicles based on bibliometrics , 2015 .

[4]  M. Marx,et al.  Optimization of the powerflow control of a hybrid electric powertrain including load profile prediction , 2012, 2012 IEEE Vehicle Power and Propulsion Conference.

[5]  Bernard Bäker,et al.  Optimal Energy Management and Velocity Control of Hybrid Electric Vehicles , 2018, IEEE Transactions on Vehicular Technology.

[6]  G. Rizzoni,et al.  Energy Management and Drivability Control Problems for Hybrid Electric Vehicles , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[7]  Matthias Marx,et al.  Modeling and control of a PEM fuel cell system: A practical study based on experimental defined component behavior , 2013 .

[8]  Giorgio Rizzoni,et al.  Objective Metrics of Fuel Economy, Performance and Driveability - A Review , 2004 .

[9]  Pierluigi Pisu,et al.  Hierarchical Energy Management Control of Connected Hybrid Electric Vehicles on Urban Roads With Efficiencies Feedback , 2016 .

[10]  Abdellatif Miraoui,et al.  Control Strategies for Fuel-Cell-Based Hybrid Electric Vehicles: From Offline to Online and Experimental Results , 2012, IEEE Transactions on Vehicular Technology.

[11]  Joao P. Trovao,et al.  A Model Predictive Control with Non-Uniform Sampling Times for a Hybrid Energy Storage System in Electric Vehicle Application , 2015, 2015 IEEE Vehicle Power and Propulsion Conference (VPPC).

[12]  Bo Gu,et al.  An Adaptive Algorithm for Hybrid Electric Vehicle Energy Management Based on Driving Pattern Recognition , 2006 .

[13]  Junqiang Xi,et al.  Real-Time Energy Management Strategy Based on Velocity Forecasts Using V2V and V2I Communications , 2017, IEEE Transactions on Intelligent Transportation Systems.

[14]  Dirk Uwe Sauer,et al.  Optimized operation of hybrid battery systems for electric vehicles using deterministic and stochastic dynamic programming , 2017 .

[15]  Bin Yan,et al.  An Online Rolling Optimal Control Strategy for Commuter Hybrid Electric Vehicles Based on Driving Condition Learning and Prediction , 2016, IEEE Transactions on Vehicular Technology.

[16]  Giorgio Rizzoni,et al.  A-ECMS: An Adaptive Algorithm for Hybrid Electric Vehicle Energy Management , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[17]  Bo Gao,et al.  Energy Management in Plug-in Hybrid Electric Vehicles: Recent Progress and a Connected Vehicles Perspective , 2017, IEEE Transactions on Vehicular Technology.

[18]  Dirk Soeffker,et al.  Development and Improvement of a Situation-Based Power Management Method for Multi-Source Electric Vehicles , 2018, 2018 IEEE Vehicle Power and Propulsion Conference (VPPC).

[19]  Junmin Wang,et al.  A Parallel Hybrid Electric Vehicle Energy Management Strategy Using Stochastic Model Predictive Control With Road Grade Preview , 2015, IEEE Transactions on Control Systems Technology.

[20]  Ahmed Ketfi-Cherif,et al.  Implementation of an Energy Management Strategy for Hybrid Electric Vehicles Including Drivability Constraints , 2016, IEEE Transactions on Vehicular Technology.

[21]  Bulent Sarlioglu,et al.  Driving Toward Accessibility: A Review of Technological Improvements for Electric Machines, Power Electronics, and Batteries for Electric and Hybrid Vehicles , 2017, IEEE Industry Applications Magazine.

[22]  Bo Egardt,et al.  Assessing the potential of predictive control for hybrid vehicle powertrains using stochastic dynamic programming , 2005 .

[23]  Stephan Terwen,et al.  Predictive Powertrain Control for Hybrid Electric Vehicles , 2004 .

[24]  Dirk Söffker,et al.  Online Power Management with Embedded Offline-Optimized Parameters for a Three-Source Hybrid Powertrain with an Experimental Emulation Application , 2016 .

[25]  Xiaoyong Wang,et al.  An Energy Management Controller to Optimally Trade Off Fuel Economy and Drivability for Hybrid Vehicles , 2012, IEEE Transactions on Control Systems Technology.

[26]  Dirk Söffker,et al.  Observer-Based Power Management for Multi-Source Electric Vehicles Using Optimized Splitting Ratios , 2018, Volume 3: 20th International Conference on Advanced Vehicle Technologies; 15th International Conference on Design Education.

[27]  M Maarten Steinbuch,et al.  Rule-based energy management strategies for hybrid vehicles , 2007 .

[28]  R Bellman,et al.  DYNAMIC PROGRAMMING AND LAGRANGE MULTIPLIERS. , 1956, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Youngki Kim,et al.  Hardware-in-the-Loop Validation of a Power Management Strategy for Hybrid Powertrains , 2014 .

[30]  Yi Zhang,et al.  Internet-Distributed Vehicle-in-the-Loop Simulation for HEVs , 2018, IEEE Transactions on Vehicular Technology.

[31]  Guillaume Colin,et al.  Optimal predictive eco-driving cycles for conventional and electric cars , 2018, 2018 Annual American Control Conference (ACC).

[32]  Qi Li,et al.  Power Management Strategy Based on Adaptive Droop Control for a Fuel Cell-Battery-Supercapacitor Hybrid Tramway , 2018, IEEE Transactions on Vehicular Technology.

[33]  Brayima Dakyo,et al.  Energy Management Based on Frequency Approach for Hybrid Electric Vehicle Applications: Fuel-Cell/Lithium-Battery and Ultracapacitors , 2012, IEEE Transactions on Vehicular Technology.

[34]  Giorgio Rizzoni,et al.  Modeling for drivability and drivability improving control of HEV , 2018 .

[35]  Shuo Zhang,et al.  Adaptive energy management of a plug-in hybrid electric vehicle based on driving pattern recognition and dynamic programming , 2015 .

[36]  Xi Wei,et al.  Modeling and control of a hybrid electric drivetrain for optimum fuel economy, performance and driveability , 2004 .

[37]  Zhiguo Zhao,et al.  Particle swarm optimization of driving torque demand decision based on fuel economy for plug-in hybrid electric vehicle , 2017 .

[38]  Hongwen He,et al.  Application Study on the Dynamic Programming Algorithm for Energy Management of Plug-in Hybrid Electric Vehicles , 2015 .

[39]  Junmin Wang,et al.  Integrated Power Management and Aftertreatment System Control for Hybrid Electric Vehicles With Road Grade Preview , 2017, IEEE Transactions on Vehicular Technology.

[40]  Hengbing Zhao,et al.  Fuel Cell Powered Vehicles Using Supercapacitors–Device Characteristics, Control Strategies, and Simulation Results , 2010 .

[41]  Yi Lu Murphey,et al.  Intelligent vehicle power management using machine learning and fuzzy logic , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[42]  Alberto Bemporad,et al.  Stochastic MPC With Learning for Driver-Predictive Vehicle Control and its Application to HEV Energy Management , 2014, IEEE Transactions on Control Systems Technology.

[43]  Simona Onori,et al.  Energy Management Strategy for HEVs Including Battery Life Optimization , 2015, IEEE Transactions on Transportation Electrification.

[44]  Dirk Söffker,et al.  Towards Optimal Power Management of Hybrid Electric Vehicles in Real-Time: A Review on Methods, Challenges, and State-Of-The-Art Solutions , 2018 .

[45]  Tielong Shen,et al.  Real-Time Fuel Economy Optimization With Nonlinear MPC for PHEVs , 2016, IEEE Transactions on Control Systems Technology.

[46]  Chen Zhang,et al.  Role of Terrain Preview in Energy Management of Hybrid Electric Vehicles , 2010, IEEE Transactions on Vehicular Technology.

[47]  Lounis Adouane,et al.  Energy Management and Powersplit for Hybrid Electric Bus Using DP-Based Optimal Profiles Database , 2017, 2017 IEEE Vehicle Power and Propulsion Conference (VPPC).

[48]  M Debert,et al.  Predictive energy management for hybrid electric vehicles - Prediction horizon and battery capacity sensitivity , 2010 .

[49]  Viktor Larsson,et al.  Analytic Solutions to the Dynamic Programming Subproblem in Hybrid Vehicle Energy Management , 2015, IEEE Transactions on Vehicular Technology.

[50]  S. Kutter,et al.  Predictive online control for hybrids: Resolving the conflict between global optimality, robustness and real-time capability , 2010, 2010 IEEE Vehicle Power and Propulsion Conference.

[51]  Morteza Montazeri-Gh,et al.  Development a new power management strategy for power split hybrid electric vehicles , 2015 .

[52]  Olle Sundström,et al.  A generic dynamic programming Matlab function , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[53]  Naehyuck Chang,et al.  Optimizing fuel economy of hybrid electric vehicles using a Markov decision process model , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[54]  S Latham,et al.  A reference book of driving cycles for use in the measurement of road vehicle emissions , 2009 .

[55]  Pierluigi Pisu,et al.  Hierarchical control strategies for energy management of connected hybrid electric vehicles in urban roads , 2016 .

[56]  Wencong Su,et al.  Hierarchical Energy Management for Power-Split Plug-In HEVs Using Distance-Based Optimized Speed and SOC Profiles , 2018, IEEE Transactions on Vehicular Technology.

[57]  Hans-Georg Herzog,et al.  Multi-objective optimization of a parallel hybrid electric drive train , 2011, 2011 IEEE Vehicle Power and Propulsion Conference.

[58]  Jingyuan Zhan,et al.  Hybrid-Trip-Model-Based Energy Management of a PHEV With Computation-Optimized Dynamic Programming , 2018, IEEE Transactions on Vehicular Technology.

[59]  Yaoyu Li,et al.  Trip based optimal power management of plug-in hybrid electric vehicle with advanced traffic modeling , 2008 .

[60]  Andrew F. Burke,et al.  Batteries and Ultracapacitors for Electric, Hybrid, and Fuel Cell Vehicles , 2007, Proceedings of the IEEE.

[61]  Ali Emadi,et al.  Classification and Review of Control Strategies for Plug-In Hybrid Electric Vehicles , 2011, IEEE Transactions on Vehicular Technology.

[62]  Michael Back,et al.  PREDICTIVE CONTROL OF DRIVETRAINS , 2002 .

[63]  Volkan Sezer,et al.  A Novel ECMS and Combined Cost Map Approach for High-Efficiency Series Hybrid Electric Vehicles , 2011, IEEE Transactions on Vehicular Technology.

[64]  Zheng Chen,et al.  Energy Management for a Power-Split Plug-in Hybrid Electric Vehicle Based on Dynamic Programming and Neural Networks , 2014, IEEE Transactions on Vehicular Technology.

[65]  T. Hofman,et al.  Hybrid Vehicle Optimal Control: Linear Interpolation and Singular Control , 2014, 2014 IEEE Vehicle Power and Propulsion Conference (VPPC).

[66]  Jeffrey B. Burl,et al.  Estimation of the ECMS Equivalent Factor Bounds for Hybrid Electric Vehicles , 2018, IEEE Transactions on Control Systems Technology.

[67]  Kumeresan A. Danapalasingam,et al.  A review on hybrid electric vehicles architecture and energy management strategies , 2016 .

[68]  Bernard Bäker,et al.  Combined power train and thermal management optimization using an extended dynamic programming , 2016 .