Pointwise Second-Order Necessary Conditions for Stochastic Optimal Controls, Part II: The General Case

This paper is the second part of our series of work to establish pointwise second-order necessary conditions for stochastic optimal controls. In this part, we consider the general cases, i.e., the control region is allowed to be nonconvex, and the control variable enters into both the drift and the diffusion terms of the control systems. By introducing four variational equations and four adjoint equations, we obtain the desired necessary conditions for stochastic singular optimal controls in the sense of Pontryagin-type maximum principle.

[1]  S. Mitter.  Lectures on nonlinear filtering and stochastic control , 1982 .

[2]  J. Bismut.  An Introductory Approach to Duality in Optimal Stochastic Control , 1978 .

[3]  Françoise Lamnabhi-Lagarrigue,et al.  Singular optimal control problems: On the order of a singular arc , 1987 .

[4]  F. M. Kirillova,et al.  High Order Necessary Conditions for Optimality , 1972 .

[5]  J. Frédéric Bonnans,et al.  First and Second Order Necessary Conditions for Stochastic Optimal Control Problems , 2012, Applied Mathematics & Optimization.

[6]  Yuh-tai Ju.  SINGULAR OPTIMAL CONTROL , 1980 .

[7]  D. Nualart.  The Malliavin Calculus and Related Topics , 1995 .

[8]  B. Goh.  Necessary Conditions for Singular Extremals Involving Multiple Control Variables , 1966 .

[9]  Brian D. O. Anderson,et al.  Singular Optimal Control: The Linear-Quadratic Problem , 1978 .

[10]  Marie-Claire Quenez.  Backward Stochastic Differential Equations , 2010 .

[11]  J. Ma,et al.  Forward-Backward Stochastic Differential Equations and their Applications , 2007 .

[12]  Hélène Frankowska,et al.  Pointwise Second-Order Necessary Optimality Conditions for the Mayer Problem with Control Constraints , 2013, SIAM J. Control. Optim..

[13]  M. L. Chambers.  The Mathematical Theory of Optimal Processes , 1965 .

[14]  Xu Zhang,et al.  Pointwise Second-order Necessary Conditions for Stochastic Optimal Controls, Part I: The Case of Convex Control Constraint , 2015, SIAM J. Control. Optim..

[15]  U. Haussmann.  General necessary conditions for optimal control of stochastic systems , 1976 .

[16]  J. Frédéric Bonnans,et al.  Second-order analysis for optimal control problems with pure state constraints and mixed control-state constraints , 2009 .

[17]  Boris N. Kiforenko,et al.  Singular Optimal Controls of Rocket Motion (Survey) , 2017 .

[18]  Daniel Hoehener,et al.  Variational Approach to Second-Order Optimality Conditions for Control Problems with Pure State Constraints , 2012, SIAM J. Control. Optim..

[19]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[20]  Shanjian Tang.  A second-order maximum principle for singular optimal stochastic controls , 2010 .

[21]  Jiongmin Yong,et al.  A Variational Formula for Stochastic Controls and Some Applications , 2007 .

[22]  Vera Zeidan,et al.  Optimal Control Problems with Set-Valued Control and State Constraints , 2003, SIAM J. Optim..

[23]  A. Bensoussan.  Lectures on stochastic control , 1982 .

[24]  Hongwei Lou,et al.  Second-Order Necessary/Sufficient Conditions for Optimal Control Problems in the Absence of Linear Structure , 2010, 1008.1020.

[25]  J. Warga,et al.  A second-order condition that strengthens Pontryagin's maximum principle , 1978 .

[26]  Zhang HaiSen,et al.  Some results on pointwise second-order necessary conditions for stochastic optimal controls , 2016 .

[27]  H. Kushner.  Necessary conditions for continuous parameter stochastic optimization problems , 1972 .

[28]  S. Peng.  A general stochastic maximum principle for optimal control problems , 1990 .

[29]  H. Knobloch,et al.  Higher Order Necessary Conditions in Optimal Control Theory , 1981 .