A Dynamic Programming Approach to Viability Problems

Viability theory considers the problem of maintaining a system under a set of viability constraints. The main tool for solving viability problems lies in the construction of the viability kernel, defined as the set of initial states from which there exists a trajectory that remains in the set of constraints indefinitely. The theory is very elegant and appears naturally in many applications. Unfortunately, the current numerical approaches suffer from low computational efficiency, which limits the potential range of applications of this domain. In this paper we show that the viability kernel is the zero-level set of a related dynamic programming problem, which opens promising research directions for numerical approximation of the viability kernel using tools from approximate dynamic programming. We illustrate the approach using k-nearest neighbors on a toy problem in two dimensions and on a complex dynamical model for anaerobic digestion process in four dimensions

[1]  Sophie Martin,et al.  Defining yield policies in a viability approach , 2008 .

[2]  Sophie Martin,et al.  The Cost of Restoration as a Way of Defining Resilience: a Viability Approach Applied to a Model of Lake Eutrophication , 2004 .

[3]  Jean-Pierre Aubin,et al.  Viability theory , 1991 .

[4]  P. Saint-Pierre.  Approximation of the viability kernel , 1994 .

[5]  A Genovesi,et al.  Dynamical model development and parameter identification for an anaerobic wastewater treatment process. , 2001, Biotechnology and bioengineering.

[6]  R. Munos,et al.  An anti-diffusive scheme for viability problems , 2006 .

[7]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[8]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[9]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1990, 29th IEEE Conference on Decision and Control.

[10]  Christophe Béné,et al.  A viability analysis for a bio-economic model , 2001 .

[11]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[12]  Jurg Keller,et al.  Mathematical Modelling of Two-Stage Anaerobic Digestion using IWA Anaerobic Digestion Model No.1 (ADM1) , 2002 .

[13]  Christian Mullon,et al.  VIABILITY MODEL OF TROPHIC INTERACTIONS IN MARINE ECOSYSTEMS , 2004 .

[14]  R. DeVore,et al.  Nonlinear approximation , 1998, Acta Numerica.

[15]  P Gras,et al.  Evaluation of a four year experience with a fully instrumented anaerobic digestion process. , 2002, Water science and technology : a journal of the International Association on Water Pollution Research.