Optimal switching under a hybrid diffusion model and applications to stock trading

Abstract This paper is concerned with the optimal switching problem under a hybrid diffusion (or, regime switching) model in an infinite horizon. The state of the system consists of a number of diffusions coupled by a finite-state continuous-time Markov chain. Based on the dynamic programming principle, the value function of our optimal switching problem is proved to be the unique viscosity solution to the associated system of variational inequalities. The optimal switching strategy, indicating when and where it is optimal to switch, is given in terms of the switching and continuation regions. In many applications, the underlying Markov chain has a large state space and exhibits two-time-scale structure. In this case, a singular perturbation approach is employed to reduce the computational complexity involved. It is shown that as the time-scale parameter e goes to zero, the value function of the original problem converges to that of a limit problem. The limit problem is much easier to solve, and its optimal switching solution leads to an approximate solution to the original problem. Finally, as an application of our theoretical results, an example concerning the stock trading problem in a regime switching market is provided. It is emphasized that, this paper is the first time to introduce the optimal switching as a general framework to study the stock trading problem, in view of their inherent connection. Both optimal trading rule and convergence result are numerically demonstrated in this example.

[1]  Qing Zhang,et al.  Continuous-Time Markov Chains and Applications , 1998 .

[2]  J. Yong,et al.  Finite horizon stochastic optimal switching and impulse controls with a viscosity solution approach , 1993 .

[3]  Mihail Zervos,et al.  BUY‐LOW AND SELL‐HIGH INVESTMENT STRATEGIES , 2013 .

[4]  Q. Zhang,et al.  Trend Following Trading under a Regime Switching Model , 2010, SIAM J. Financial Math..

[5]  G. Yin,et al.  Optimal stopping of two-time scale Markovian systems: Analysis, numerical methods, and applications☆ , 2017 .

[6]  Ran Tao,et al.  Optimal Switching under a Regime-Switching Model with Two-Time-Scale Markov Chains , 2015, Multiscale Model. Simul..

[7]  Zhen Wu,et al.  INFINITE HORIZON REFLECTED BACKWARD STOCHASTIC DIFFERENTIAL EQUATIONS AND APPLICATIONS IN MIXED CONTROL AND GAME PROBLEMS , 2008 .

[8]  Huyên Pham,et al.  Optimal Switching over Multiple Regimes , 2009, SIAM J. Control. Optim..

[9]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[10]  Mihail Zervos,et al.  The explicit solution to a sequential switching problem with non-smooth data , 2010 .

[11]  Qing Zhang,et al.  Continuous-Time Markov Chains and Applications: A Two-Time-Scale Approach , 2012 .

[12]  R. Carmona,et al.  Pricing Asset Scheduling Flexibility using Optimal Switching , 2008 .

[13]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[14]  Gang George Yin,et al.  A trend-following strategy: Conditions for optimality , 2011, Autom..

[15]  B. Øksendal,et al.  Optimal Switching in an Economic Activity Under Uncertainty , 1994 .

[16]  M. Zervos,et al.  A model for investment decisions with switching costs , 2001 .

[17]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[18]  Monique Jeanblanc,et al.  On the Starting and Stopping Problem: Application in Reversible Investments , 2007, Math. Oper. Res..

[19]  Boualem Djehiche,et al.  A Finite Horizon Optimal Multiple Switching Problem , 2007, SIAM J. Control. Optim..

[20]  Shi-Jie Deng,et al.  A Real Options Approach for Pricing Electricity Tolling Agreements , 2006, Int. J. Inf. Technol. Decis. Mak..

[21]  Q. Zhang,et al.  Stock Trading: An Optimal Selling Rule , 2001, SIAM J. Control. Optim..

[22]  Qing Zhang,et al.  Trading a mean-reverting asset: Buy low and sell high , 2008, Autom..

[23]  Ying Hu,et al.  Multi-dimensional BSDE with oblique reflection and optimal switching , 2007, 0706.4365.

[24]  H. Pham On the Smooth-Fit Property for One-Dimensional Optimal Switching Problem , 2004, math/0410285.

[25]  S. Hamadène,et al.  The Finite Horizon Optimal Multi-Modes Switching Problem: The Viscosity Solution Approach , 2008, 0805.1306.