Game Theory Controller for Hybrid Electric Vehicles

This paper describes the development and experimental implementation of an energy management controller for hybrid electric vehicles (HEVs) based on the application of game theory (GT). This controller is constructed as a feedback Stackelberg equilibrium in the noncooperative game between the driver and the powertrain with the cost penalizing fuel consumption, NOx emissions, battery state of charge deviation, and vehicle operating conditions deviation. This control policy is drive-cycle and time independent. A description of the controller implementation with ancillary strategy elements is given. Experimental results from tests in a parallel HEV prototype vehicle are presented and compared with the existing baseline controller in terms of fuel consumption and NOx emissions. The HEV powertrain configuration is advanced and includes a high-speed diesel engine, two electric motors, and automated converterless transmission. Over the New European Driving Cycle (NEDC), the GT controller, with minimal calibration effort, demonstrates better performance than the existing baseline controller that is calibrated from the deterministic dynamic programing solution over NEDC. We also demonstrate that the GT controller substantially outperforms the baseline controller over other real-world-focused driving cycles while providing good drivability.

[1]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[2]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[3]  I. V. Kolmanovsky,et al.  Hybrid Electric Vehicle Energy Management Using Game Theory , 2008 .

[4]  Ilya Kolmanovsky,et al.  Optimization of powertrain operating policy for feasibility assessment and calibration: stochastic dynamic programming approach , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[5]  L. Guzzella,et al.  Control of hybrid electric vehicles , 2007, IEEE Control Systems.

[6]  Heinrich von Stackelberg,et al.  Stackelberg (Heinrich von) - The Theory of the Market Economy, translated from the German and with an introduction by Alan T. PEACOCK. , 1953 .

[7]  Bo Egardt,et al.  Assessing the Potential of Predictive Control for Hybrid Vehicle Powertrains Using Stochastic Dynamic Programming , 2005, IEEE Transactions on Intelligent Transportation Systems.

[8]  R. Trigui,et al.  Predictive energy management of hybrid vehicle , 2008, 2008 IEEE Vehicle Power and Propulsion Conference.

[9]  A. I. Subbotin,et al.  Game-Theoretical Control Problems , 1987 .

[10]  Mehrdad Ehsani,et al.  Hybrid Electric Vehicles: Architecture and Motor Drives , 2007, Proceedings of the IEEE.

[11]  I. Kolmanovsky,et al.  Optimization of complex powertrain systems for fuel economy and emissions , 1999, Proceedings of the 1999 IEEE International Conference on Control Applications (Cat. No.99CH36328).

[12]  G Ripaccioli,et al.  A stochastic model predictive control approach for series hybrid electric vehicle power management , 2010, Proceedings of the 2010 American Control Conference.

[13]  Marco Sorrentino,et al.  Analysis of a rule-based control strategy for on-board energy management of series hybrid vehicles , 2011 .

[14]  Ilya Kolmanovsky,et al.  An Integrated Software Environment For Powertrain Feasibility Assessment Using Optimization And Optimal Control , 2006 .

[15]  Giorgio Rizzoni,et al.  Optimal energy management in series hybrid electric vehicles , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[16]  Ilya Kolmanovsky,et al.  Approximate dynamic programming solutions for lean burn engine aftertreatment , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[17]  Keith Wipke,et al.  HEV Control Strategy for Real-Time Optimization of Fuel Economy and Emissions , 2000 .

[18]  Judy Che,et al.  Control System Development for the Dual Drive Hybrid System , 2009 .

[19]  Alexandre Chasse,et al.  Supervisory control of hybrid powertrains: An experimental benchmark of offline optimization and online energy management , 2009 .

[20]  Zoran Filipi,et al.  Self-Learning Neural controller for Hybrid Power Management using Neuro-Dynamic Programming , 2011 .

[21]  Huei Peng,et al.  Shortest path stochastic control for hybrid electric vehicles , 2008 .

[22]  Bengt J H Jacobson,et al.  Gearshift sequence optimisation for vehicles with automated non-powershifting transmissions , 2003 .

[23]  Philippe Moulin,et al.  Energy management strategy for Diesel hybrid electric vehicle , 2011, 2011 IEEE Vehicle Power and Propulsion Conference.

[24]  Danil V. Prokhorov.  Approximating optimal controls with recurrent neural networks for automotive systems , 2006, 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control.

[25]  Wei Liang,et al.  Power Smoothing Energy Management and Its Application to a Series Hybrid Powertrain , 2013, IEEE Transactions on Control Systems Technology.

[26]  C. C. Chan,et al.  The State of the Art of Electric, Hybrid, and Fuel Cell Vehicles , 2007, Proceedings of the IEEE.

[27]  Danil V. Prokhorov.  Training Recurrent Neurocontrollers for Real-Time Applications , 2007, IEEE Transactions on Neural Networks.

[28]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[29]  J. E. Auiler,et al.  Optimization of Automotive Engine Calibration for Better Fuel Economy-Methods and Applications , 1977 .

[30]  Xiaoyong Wang,et al.  An Energy Management Controller to Optimally Trade Off Fuel Economy and Drivability for Hybrid Vehicles , 2012, IEEE Transactions on Control Systems Technology.

[31]  Huei Peng,et al.  A stochastic control strategy for hybrid electric vehicles , 2004, Proceedings of the 2004 American Control Conference.

[32]  Ilya Kolmanovsky,et al.  Feasibility assessment and operating policy optimization of automotive powertrains with uncertainties using game theory , 2001 .

[33]  C. D. Tether,et al.  Optimal Control of Cold Automobile Engines , 1984 .

[34]  I. Kolmanovsky,et al.  Approaches to energy management of hybrid electric vehicles: Experimental comparison , 2010 .

[35]  Bo Egardt,et al.  Predictive energy management of a 4QT series-parallel hybrid electric bus , 2009 .