Stochastic MPC With Learning for Driver-Predictive Vehicle Control and its Application to HEV Energy Management

This paper develops an approach for driver-aware vehicle control based on stochastic model predictive control with learning (SMPCL). The framework combines the on-board learning of a Markov chain that represents the driver behavior, a scenario-based approach for stochastic optimization, and quadratic programming. By using quadratic programming, SMPCL can handle, in general, larger state dimension models than stochastic dynamic programming, and can reconfigure in real-time for accommodating changes in driver behavior. The SMPCL approach is demonstrated in the energy management of a series hybrid electrical vehicle, aimed at improving fuel efficiency while enforcing constraints on battery state of charge and power. The SMPCL controller allocates the power from the battery and the engine to meet the driver power request. A Markov chain that models the power request dynamics is learned in real-time to improve the prediction capabilities of model predictive control (MPC). Because of exploiting the learned pattern of the driver behavior, the proposed approach outperforms conventional model predictive control and shows performance close to MPC with full knowledge of future driver power request in standard and real-world driving cycles.

[1]  Uwe Kiencke,et al.  Modeling and performance analysis of a hybrid driver model , 1998 .

[2]  George A. Bekey,et al.  Identification of human driver models in car following , 1974 .

[3]  C. Mészáros The BPMPD interior point solver for convex quadratic problems , 1999 .

[4]  Alberto Bemporad,et al.  Stabilizing Model Predictive Control of Stochastic Constrained Linear Systems , 2012, IEEE Transactions on Automatic Control.

[5]  S. A. Hassan,et al.  The Application of Linear Optimal Control Theory to the Design of Active Automotive Suspensions , 1986 .

[6]  Stefano Di Cairano,et al.  Engine power smoothing energy management strategy for a series hybrid electric vehicle , 2011, Proceedings of the 2011 American Control Conference.

[7]  G Ripaccioli,et al.  A stochastic model predictive control approach for series hybrid electric vehicle power management , 2010, Proceedings of the 2010 American Control Conference.

[8]  Sophie Keller Automotive Control Systems For Engine Driveline And Vehicle , 2016 .

[9]  Alberto Bemporad,et al.  Model Predictive Idle Speed Control: Design, Analysis, and Experimental Evaluation , 2012, IEEE Transactions on Control Systems Technology.

[10]  Mazen Alamir,et al.  Unified MPC strategy for idle-speed control, vehicle start-up and gearing applied to an Automated Manual Transmission , 2008 .

[11]  Giorgio Rizzoni,et al.  A-ECMS: An Adaptive Algorithm for Hybrid Electric Vehicle Energy Management , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[12]  Alberto Bemporad,et al.  An accelerated dual gradient-projection algorithm for linear model predictive control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[13]  Francesco Borrelli,et al.  Predictive Active Steering Control for Autonomous Vehicle Systems , 2007, IEEE Transactions on Control Systems Technology.

[14]  Giorgio Rizzoni,et al.  Optimal energy management in series hybrid electric vehicles , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[15]  Alberto Bemporad,et al.  Vehicle Yaw Stability Control by Coordinated Active Front Steering and Differential Braking in the Tire Sideslip Angles Domain , 2013, IEEE Transactions on Control Systems Technology.

[16]  Stefano Di Cairano,et al.  MPC-Based Energy Management of a Power-Split Hybrid Electric Vehicle , 2012, IEEE Transactions on Control Systems Technology.

[17]  Charles C. MacAdam,et al.  Understanding and Modeling the Human Driver , 2003 .

[18]  Masayuki Fujita,et al.  Explicit Receding Horizon Control of Automobiles with Continuously Variable Transmissions , 2009 .

[19]  Ilya Kolmanovsky,et al.  Optimization of powertrain operating policy for feasibility assessment and calibration: stochastic dynamic programming approach , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[20]  Francesco Borrelli,et al.  A model predictive control framework for industrial turbodiesel engine control , 2008, 2008 47th IEEE Conference on Decision and Control.

[21]  Wei Liang,et al.  Power Smoothing Energy Management and Its Application to a Series Hybrid Powertrain , 2013, IEEE Transactions on Control Systems Technology.

[22]  Dimitar Filev,et al.  Stochastic optimal control of systems with soft constraints and opportunities for automotive applications , 2009, 2009 IEEE Control Applications, (CCA) & Intelligent Control, (ISIC).

[23]  Basil Kouvaritakis,et al.  Stochastic MPC with inequality stability constraints , 2006, Autom..

[24]  Alberto Bemporad,et al.  Hybrid Modeling, Identification, and Predictive Control: An Application to Hybrid Electric Vehicle Energy Management , 2009, HSCC.

[25]  Manfred Morari,et al.  Computational Complexity Certification for Real-Time MPC With Input Constraints Based on the Fast Gradient Method , 2012, IEEE Transactions on Automatic Control.

[26]  Alberto Bemporad,et al.  Optimal Control of Discrete Hybrid Stochastic Automata , 2005, HSCC.

[27]  L. Guzzella,et al.  Control of hybrid electric vehicles , 2007, IEEE Control Systems.

[28]  A. Pentland,et al.  Towards real-time recognition of driver intentions , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[29]  Hosam K. Fathy,et al.  A Stochastic Optimal Control Approach for Power Management in Plug-In Hybrid Electric Vehicles , 2008 .

[30]  Huei Peng,et al.  A stochastic control strategy for hybrid electric vehicles , 2004, Proceedings of the 2004 American Control Conference.

[31]  Stefano Di Cairano,et al.  Projection-free parallel quadratic programming for linear model predictive control , 2013, Int. J. Control.

[32]  O. Bosgra,et al.  A conic reformulation of Model Predictive Control including bounded and stochastic disturbances under state and input constraints , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[33]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[34]  Lino Guzzella,et al.  Vehicle Propulsion Systems: Introduction to Modeling and Optimization , 2005 .

[35]  James A. Primbs,et al.  Stochastic Receding Horizon Control of Constrained Linear Systems With State and Control Multiplicative Noise , 2007, IEEE Transactions on Automatic Control.

[36]  Bo Egardt,et al.  Assessing the potential of predictive control for hybrid vehicle powertrains using stochastic dynamic programming , 2005 .

[37]  G. Ripaccioli,et al.  Stochastic model predictive control with driver behavior learning for improved powertrain control , 2010, 49th IEEE Conference on Decision and Control (CDC).

[38]  Alberto Bemporad,et al.  Model predictive control of magnetically actuated mass spring dampers for automotive applications , 2007, Int. J. Control.

[39]  Tony Markel,et al.  Dynamic Programming Applied to Investigate Energy Management Strategies for a Plug-in HEV , 2006 .

[40]  Stefano Di Cairano,et al.  Driver-assist steering by active front steering and differential braking: Design, implementation and experimental evaluation of a switched model predictive control approach , 2010, 49th IEEE Conference on Decision and Control (CDC).

[41]  Günther Prokop,et al.  Modeling Human Vehicle Driving by Model Predictive Online Optimization , 2001 .

[42]  Uwe Kiencke,et al.  Modeling and performance analysis of a hybrid driver model , 1998 .

[43]  Alberto Bemporad,et al.  Model-Predictive Control of Discrete Hybrid Stochastic Automata , 2011, IEEE Transactions on Automatic Control.

[44]  Rory A. Cooper System identification of human performance models , 1991, IEEE Trans. Syst. Man Cybern..

[45]  Alberto Bemporad,et al.  An Accelerated Dual Gradient-Projection Algorithm for Embedded Linear Model Predictive Control , 2014, IEEE Transactions on Automatic Control.

[46]  Luigi del Re,et al.  Predictive Control of a Diesel Engine Air Path , 2007, IEEE Transactions on Control Systems Technology.