Pathwise Stochastic Optimal Control

This paper approaches optimal control problems for discrete-time controlled Markov processes by representing the value of the problem in a dual Lagrangian form; the value is expressed as an infimum over a family of Lagrangian martingales of an expectation of a pathwise supremum of the objective adjusted by the Lagrangian martingale term. This representation opens up the possibility of numerical methods based on Monte Carlo simulation, which may be advantageous in high-dimensional problems or in problems with complicated constraints.

[1]  A. S. Manne.  Linear Programming and Sequential Decisions , 1960 .

[2]  Kerry Back,et al.  The shadow price of information in continuous time decision problems , 1987 .

[3]  Mark Broadie,et al.  A Primal-Dual Simulation Algorithm for Pricing Multi-Dimensional American Options , 2001 .

[4]  R. Rockafellar,et al.  Nonanticipativity and L1-martingales in stochastic optimization problems , 1976 .

[5]  Peter Whittle,et al.  Probability, statistics and optimisation : a tribute to Peter Whittle , 1995 .

[6]  T. Kurtz,et al.  Existence of Markov Controls and Characterization of Optimal Markov Controls , 1998 .

[7]  Mark H. A. Davis,et al.  A deterministic approach to optimal stopping with application to a prophet inequality , 1993 .

[8]  V. Borkar,et al.  Occupation measures for controlled Markov processes: characterization and optimality , 1996 .

[9]  Francis A. Longstaff,et al.  Valuing American Options by Simulation: A Simple Least-Squares Approach , 2001 .

[10]  Martin B. Haugh,et al.  Pricing American Options: A Duality Approach , 2001, Oper. Res..

[11]  Farshid Jamshidian,et al.  Numeraire-invariant option pricing & american, bermudan, and trigger stream rollover , 2004 .

[12]  Farshid Jamshidian.  Numeraire-invariant option pricing and american, bermudan, trigger stream rollover , 2004 .

[13]  Mark H. A. Davis,et al.  A Deterministic Approach To Stochastic Optimal Control With Application To Anticipative Control , 1992 .

[14]  David Lamper,et al.  Monte Carlo valuation of American Options , 2004 .

[15]  Roger J.-B. Wets,et al.  On the Relation between Stochastic and Deterministic Optimization , 1975 .