A Pair of Explicitly Solvable Singular Stochastic Control Problems

Abstract. We consider a general model of singular stochastic control with infinite time horizon and we prove a ``verification theorem'' under the assumption that the Hamilton—Jacobi—Bellman (HJB) equation has a C2 solution. In the one-dimensional case, under the assumption that the HJB equation has a solution in Wloc2,p(R) with $p \geq 1$ , we prove a very general ``verification theorem'' by employing the generalized Meyer—Ito change of variables formula with local times. In what follows, we consider two special cases which we explicitly solve. These are the formal equivalent of the one-dimensional infinite time horizon LQG problem and a simple example with radial symmetry in an arbitrary Euclidean space. The value function of either of these problems is C2 and is expressed in terms of special functions, and, in particular, the confluent hypergeometric function and the modified Bessel function of the first kind, respectively.

[1]  Herman Chernoff,et al.  Sequential decisions in the control of a spaceship , 1967 .

[2]  N. Krylov Controlled Diffusion Processes , 1980 .

[3]  G. A. Watson A treatise on the theory of Bessel functions , 1944 .

[4]  Hang Zhu,et al.  Generalized solution in singular stochastic control: The nondegenerate problem , 1992 .

[5]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[6]  J. Michael Harrison,et al.  Instantaneous Control of Brownian Motion , 1983, Math. Oper. Res..

[7]  H. Witsenhausen,et al.  Some solvable stochastic control problemst , 1980 .

[8]  D. P. Gaver,et al.  Optimal Consumption for General Diffusions with Absorbing and Reflecting Barriers , 1984 .

[9]  Eugene P. Wigner,et al.  Formulas and Theorems for the Special Functions of Mathematical Physics , 1966 .

[10]  P. Lions,et al.  Stochastic differential equations with reflecting boundary conditions , 1984 .

[11]  P. Chow,et al.  Additive control of stochastic linear systems with finite horizon , 1985 .

[12]  Ioannis Karatzas,et al.  Brownian Motion and Stochastic Calculus , 1987 .

[13]  S. Shreve,et al.  Multi-dimensional finite-fuel singular stochastic control , 1992 .

[14]  I. Karatzas A class of singular stochastic control problems , 1983, Advances in Applied Probability.

[15]  H. Soner,et al.  Regularity of the value function for a two-dimensional singular stochastic control problem , 1989 .

[16]  A. Shiryaev,et al.  Limit Theorems for Stochastic Processes , 1987 .

[17]  S. Min Singular control problems in bounded intervals , 1987 .

[18]  Jin Ma,et al.  On the principle of smooth fit for a class of singular stochastic control problems for diffusions , 1992 .