Model Predictive Control with Uncertainty in Human Driven Systems

Human driven systems present a unique optimization challenge for robot control. Generally, operators of these systems behave rationally given environmental factors and desired goals. However, information available to subsystem controllers is often incomplete, and the operator becomes more difficult to model without this input information. In this work we present a data-driven, nonparametric model to capture both expectation and uncertainty of the upcoming duty for a subsystem controller. This model is a modified k-nearest neighbor regressor used to generate weighted samples from a distribution of upcoming duty, which are then exploited to generate an optimal control. We test the model on a simulated heterogeneous energy pack manager in an Electric Vehicle operated by a human driver. For this domain, upcoming load on the energy pack strongly affects the optimal use and charging strategy of the pack. Given incomplete information, there is a natural uncertainty in upcoming duty due to traffic, destination, signage, and other factors. We test against a dataset of real driving data gathered from volunteers, and compare the results other models and the optimal upper bound.

[1]  Gregg Podnar,et al.  Active management of a heterogeneous energy store for electric vehicles , 2011, 2011 IEEE Forum on Integrated and Sustainable Transportation Systems.

[2]  Huei Peng,et al.  Power management strategy for a parallel hybrid electric truck , 2003, IEEE Trans. Control. Syst. Technol..

[3]  Hosam K. Fathy,et al.  A Stochastic Optimal Control Approach for Power Management in Plug-In Hybrid Electric Vehicles , 2011, IEEE Transactions on Control Systems Technology.

[4]  David L. Kleinman,et al.  An optimal control model of human response part I: Theory and validation , 1970 .

[5]  Mascha C. van der Voort,et al.  A prototype fuel-efficiency support tool , 2001 .

[6]  Liviu Iftode,et al.  Context-aware Battery Management for Mobile Phones , 2008, 2008 Sixth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom).

[7]  Deborah Estrin,et al.  Smart Screen Management on Mobile Phones , 2009 .

[8]  M Morari,et al.  Energy efficient building climate control using Stochastic Model Predictive Control and weather predictions , 2010, Proceedings of the 2010 American Control Conference.

[9]  Günther Prokop,et al.  Modeling Human Vehicle Driving by Model Predictive Online Optimization , 2001 .

[10]  Alex Pentland,et al.  Modeling and Prediction of Human Behavior , 1999, Neural Computation.

[11]  Bart Selman,et al.  Learning policies for battery usage optimization in electric vehicles , 2012, Machine Learning.

[12]  Haralambos Sarimveis,et al.  Nonlinear model predictive control for distributed parameter systems using data driven artificial neural network models , 2008, Comput. Chem. Eng..