A nonlinear model predictive control framework approximating noise corrupted systems with hybrid transition densities

In this paper, a framework for nonlinear model predictive control (NMPC) for heavily noise-affected systems is presented. Within this framework, the noise influence, which originates from uncertainties during model identification or measurement, is explicitly considered. This leads to a significant increase in the control quality. One part of the proposed framework is the efficient state prediction, which is necessary for NMPC. It is based on transition density approximation by hybrid transition densities, which allows efficient closed-form state prediction of time-variant nonlinear systems with continuous state spaces in discrete time. Another part of the framework is a versatile value function representation using Gaussian mixtures, Dirac mixtures, and even a combination of both. Based on these methods, an efficient closed-form algorithm for calculating an approximate value function of the NMPC optimal control problem employing dynamic programming is presented. Thus, also very long optimization horizons can be used and furthermore it is possible to calculate the value function off-line, which reduces the on-line computational burden significantly. The capabilities of the framework and especially the benefits that can be gained by incorporating the noise in the controller are illustrated by the example of a miniature walking robot following a given path.

[1]  Ying He,et al.  Sensor scheduling for target tracking in sensor networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[2]  Uwe D. Hanebeck,et al.  The hybrid density filter for nonlinear estimation based on hybrid conditional density approximation , 2007, 2007 10th International Conference on Information Fusion.

[3]  T. A. Badgwell,et al.  An Overview of Industrial Model Predictive Control Technology , 1997 .

[4]  Frank Allgöwer,et al.  An Introduction to Nonlinear Model Predictive Control , 2002 .

[5]  Jay H. Lee,et al.  Extended Kalman Filter Based Nonlinear Model Predictive Control , 1993, 1993 American Control Conference.

[6]  Marco F. Huber,et al.  Efficient Control of Nonlinear Noise-Corrupted Systems Using a Novel Model Predictive Control Framework , 2007, 2007 American Control Conference.

[7]  U. Hanebeck,et al.  Online-computation approach to optimal control of noise-affected nonlinear systems with continuous state and control spaces , 2007, 2007 European Control Conference (ECC).

[8]  V. Maz'ya,et al.  On approximate approximations using Gaussian kernels , 1996 .

[9]  Uwe D. Hanebeck,et al.  Test-environment based on a team of miniature walking robots for evaluation of collaborative control methods , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Marko Bacic,et al.  Model predictive control , 2003 .

[11]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[12]  Daniel N. Nikovski,et al.  Non-Linear Stochastic Control in Continuous State Spaces by Exact Integration in Bellman's Equations , 2003 .

[13]  Robin J. Evans,et al.  The problem of optimal robust sensor scheduling , 2001, Syst. Control. Lett..

[14]  Basil Kouvaritakis,et al.  Recent developments in stochastic MPC and sustainable development , 2004, Annu. Rev. Control..

[15]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[16]  Toshiyuki Ohtsuka,et al.  A continuation/GMRES method for fast computation of nonlinear receding horizon control , 2004, Autom..

[17]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .