Maximum Principle for Optimal Control Problems of Forward-Backward Regime-Switching Systems Involving Impulse Controls

This paper is concerned with optimal control problems of forward-backward Markovian regime-switching systems involving impulse controls. Here the Markov chains are continuous-time and finite-state. We derive the stochastic maximum principle for this kind of systems. Besides the Markov chains, the most distinguishing features of our problem are that the control variables consist of regular and impulsive controls, and that the domain of regular control is not necessarily convex. We obtain the necessary and sufficient conditions for optimal controls. Thereafter, we apply the theoretical results to a financial problem and get the optimal consumption strategies.

[1]  Larry G. Epstein,et al.  Stochastic differential utility , 1992 .

[2]  Zhen Wu,et al.  A general maximum principle for optimal control of forward-backward stochastic systems , 2013, Autom..

[3]  Zhen Wu,et al.  BSDEs with regime switching: Weak convergence and applications , 2013 .

[4]  Zhiyong Yu,et al.  A Pontryagin's Maximum Principle for Non-Zero Sum Differential Games of BSDEs with Applications , 2010, IEEE Transactions on Automatic Control.

[5]  Zhen Wu,et al.  Maximum Principle for Stochastic Recursive Optimal Control Problems Involving Impulse Controls , 2012 .

[6]  St'ephane Cr'epey,et al.  Reflected and doubly reflected BSDEs with jumps: A priori estimates and comparison , 2008, 0811.2276.

[7]  Bernt Øksendal,et al.  Optimal Consumption and Portfolio with Both Fixed and Proportional Transaction Costs , 2001, SIAM J. Control. Optim..

[8]  Fernando Zapatero,et al.  Classical and Impulse Stochastic Control of the Exchange Rate Using Interest Rates and Reserves , 2000 .

[9]  M. Jeanblanc-Picqué,et al.  Impulse Control Method and Exchange Rate , 1993 .

[10]  Zhen Wu,et al.  The Maximum Principles for Stochastic Recursive Optimal Control Problems Under Partial Information , 2009, IEEE Transactions on Automatic Control.

[11]  Catherine Donnelly.  Sufficient Stochastic Maximum Principle in a Regime-Switching Diffusion Model , 2011 .

[12]  S. Peng,et al.  Fully Coupled Forward-Backward Stochastic Differential Equations and Applications to Optimal Control , 1999 .

[13]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[14]  S. Peng.  A general stochastic maximum principle for optimal control problems , 1990 .

[15]  Jiongmin Yong,et al.  Optimality Variational Principle for Controlled Forward-Backward Stochastic Differential Equations with Mixed Initial-Terminal Conditions , 2010, SIAM J. Control. Optim..

[16]  Ralf Korn,et al.  Some applications of impulse control in mathematical finance , 1999, Math. Methods Oper. Res..

[17]  S. Peng,et al.  Backward Stochastic Differential Equations in Finance , 1997 .

[18]  Wensheng Xu,et al.  Stochastic maximum principle for optimal control problem of forward and backward system , 1995, The Journal of the Australian Mathematical Society. Series B. Applied Mathematics.

[19]  S. Crépey.  About the Pricing Equations in Finance , 2011 .

[20]  Zhen Wu,et al.  Stochastic Maximum Principle for Optimal Control Problems of Forward-Backward Systems Involving Impulse Controls , 2011, IEEE Transactions on Automatic Control.

[21]  J. Bismut.  An Introductory Approach to Duality in Optimal Stochastic Control , 1978 .

[22]  Zhen Wu,et al.  Maximum principle for optimal control problems of forward-backward regime-switching system and applications , 2012, Syst. Control. Lett..

[23]  A. R. Norman,et al.  Portfolio Selection with Transaction Costs , 1990, Math. Oper. Res..