Stochastic viability and dynamic programming

This paper deals with the stochastic control of nonlinear systems in the presence of state and control constraints, for uncertain discrete-time dynamics in finite dimensional spaces. In the deterministic case, the viability kernel is known to play a basic role for the analysis of such problems and the design of viable control feedbacks. In the present paper, we show how a stochastic viability kernel and viable feedbacks relying on probability (or chance) constraints can be defined and computed by a dynamic programming equation. An example illustrates most of the assertions.

[1]  Jean-Pierre Aubin,et al.  Viability and invariance kernels of impulse differential inclusions , 2001, Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228).

[2]  George L. Nemhauser,et al.  Handbooks in operations research and management science , 1989 .

[3]  K. T. Tan,et al.  Linear systems with state and control constraints: the theory and application of maximal output admissible sets , 1991 .

[4]  Lucas Reijnders,et al.  Sustainable Management of Natural Resources , 2004 .

[5]  Jean-Pierre Aubin,et al.  The viability theorem for stochastic differential inclusions 2 , 1998 .

[6]  Michel,et al.  Monotonic properties for the viable control of discrete time systems , 2006 .

[7]  Marc Quincampoix,et al.  Controlled Stochastic Differential Equations under Constraints in Infinite Dimensional Spaces , 2008, SIAM J. Control. Optim..

[8]  G. Bitsoris.  On the positive invariance of polyhedral sets for discrete-time systems , 1988 .

[9]  Luc Doyen,et al.  Monotonicity properties for the viable control of discrete-time systems , 2007, Syst. Control. Lett..

[10]  Jean-Pierre Aubin,et al.  Viability theory , 1991 .

[11]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[12]  Yu. S. Ledyaev,et al.  Qualitative properties of trajectories of control systems: A survey , 1995 .

[13]  L. Doyen.  Guaranteed Output Feedback Control for Uncertain Systems under Control and State Constraints , 2000 .

[14]  Marc Quincampoix,et al.  An Algorithm for Viability Kernels in H?lderian Case: Approximation by Discrete Dynamical Systems , 1993 .

[15]  M. Quincampoix,et al.  Stochastic Control with Exit Time and Constraints, Application to Small Time Attainability of Sets , 2004 .

[16]  S. Vajda,et al.  Probabilistic Programming , 1972 .

[17]  John Lygeros,et al.  Controlled Invariance of Discrete Time Systems , 2000, HSCC.

[18]  Luc Doyen,et al.  Sustainable Management of Natural Resources: Mathematical Models and Methods , 2008 .

[19]  R. Tyrrell Rockafellar,et al.  Coherent Approaches to Risk in Optimization Under Uncertainty , 2007 .

[20]  Franco Blanchini,et al.  Set invariance in control , 1999, Autom..