Stochastic Control for Linear Systems Driven by Fractional Noises

This paper is concerned with optimal control of stochastic linear systems involving fractional Brownian motion (FBM). First, as a prerequisite for studying the underlying control problems, some new results on stochastic integrals and stochastic differential equations associated with FBM are established. Then, three control models are formulated and studied. In the first two models, the state is scalar-valued and the control is taken as Markovian. Either the problems are completely solved based on a Riccati equation (for model 1, where the cost is a quadratic functional on state and control variables) or optimality is characterized (for model 2, where the cost is a power functional). The last control model under investigation is a general one, where the system involves the Stratonovich integral with respect to FBM, the state is multidimensional, and the admissible controls are not limited to being Markovian. A new Riccati-type equation, which is a backward stochastic differential equation involving both FBM and normal Brownian motion, is introduced. Optimal control and optimal value of the model are explicitly obtained based on the solution to this Riccati-type equation.

[1]  B. Øksendal,et al.  OPTIMAL CONSUMPTION AND PORTFOLIO IN A BLACK–SCHOLES MARKET DRIVEN BY FRACTIONAL BROWNIAN MOTION , 2003 .

[2]  Xun Yu Zhou,et al.  Relationship Between Backward Stochastic Differential Equations and Stochastic Controls: A Linear-Quadratic Approach , 2000, SIAM J. Control. Optim..

[3]  M. Viot,et al.  About the linear-quadratic regulator problem under a fractional brownian perturbation , 2003 .

[4]  B. Øksendal,et al.  A stochastic maximum principle for processes driven by fractional Brownian motion , 2002 .

[5]  David D. Yao,et al.  Stochastic Linear-Quadratic Control via Semidefinite Programming , 2001, SIAM J. Control. Optim..

[6]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[7]  Yaozhong Hu.  Integral Transformations and Anticipative Calculus for Fractional Brownian Motions , 2005 .

[8]  B. Øksendal,et al.  FRACTIONAL WHITE NOISE CALCULUS AND APPLICATIONS TO FINANCE , 2003 .

[9]  John B. Moore,et al.  Indefinite Stochastic Linear Quadratic Control and Generalized Differential Riccati Equation , 2002, SIAM J. Control. Optim..

[10]  C. C. Heyde,et al.  Itô's formula with respect to fractional Brownian motion and its application , 1996 .

[11]  S. J. Lin,et al.  Stochastic analysis of fractional brownian motions , 1995 .

[12]  L. Rogers.  Stochastic differential equations and diffusion processes: Nobuyuki Ikeda and Shinzo Watanabe North-Holland, Amsterdam, 1981, xiv + 464 pages, Dfl.175.00 , 1982 .

[13]  C. Tudor,et al.  Fractional Bilinear Stochastic Equations with the Drift in the First Fractional Chaos , 2004 .

[14]  L. Decreusefond,et al.  Stochastic Analysis of the Fractional Brownian Motion , 1999 .

[15]  Yaozhong Hu.  Prediction and Translation of Fractional Brownian Motions , 2001 .

[16]  Yaozhong Hu,et al.  Probability structure preserving and absolute continuity , 2002 .

[17]  I. Norros,et al.  An elementary approach to a Girsanov formula and other analytical results on fractional Brownian motions , 1999 .

[18]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .