Nonzero-Sum Stochastic Games and Mean-Field Games with Impulse Controls

We consider a general class of nonzero-sum N-player stochastic games with impulse controls, where players control the underlying dynamics with discrete interventions. We adopt a verification approach and provide sufficient conditions for the Nash equilibria (NEs) of the game. We then consider the limiting situation when N goes to infinity, that is, a suitable mean-field game (MFG) with impulse controls. We show that under appropriate technical conditions, there exists a unique NE solution to the MFG, which is an ϵ-NE approximation to the N-player game, with [Formula: see text]. As an example, we analyze in detail a class of two-player stochastic games which extends the classical cash management problem to the game setting. In particular, we present numerical analysis for the cases of the single player, the two-player game, and the MFG, showing the impact of competition on the player’s optimal strategy, with sensitivity analysis of the model parameters.

[1]  Tomasz R. Bielecki,et al.  Risk sensitive asset management with transaction costs , 2000, Finance Stochastics.

[2]  Jerome F. Eastham,et al.  Optimal Impulse Control of Portfolios , 1988, Math. Oper. Res..

[3]  Giorgio Ferrari,et al.  On a strategic model of pollution control , 2017, Ann. Oper. Res..

[4]  A. Shiryaev,et al.  Optimization of the flow of dividends , 1995 .

[5]  S. Shreve,et al.  Stochastic differential equations , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[6]  Luciano Campi,et al.  Nonzero-Sum Stochastic Differential Games with Impulse Controls: A Verification Theorem with Applications , 2016, Math. Oper. Res..

[7]  Bernt Øksendal,et al.  Optimal stochastic intervention control with application to the exchange rate , 1998 .

[8]  Alain Bensoussan,et al.  Impulse Control and Quasi-Variational Inequalities , 1984 .

[9]  Agnès Sulem,et al.  A Solvable One-Dimensional Model of a Diffusion Inventory System , 1986, Math. Oper. Res..

[10]  Renyuan Xu,et al.  Stochastic Games for Fuel Followers Problem: N vs MFG , 2018, 1803.02925.

[11]  S. Pliska,et al.  OPTIMAL PORTFOLIO MANAGEMENT WITH FIXED TRANSACTION COSTS , 1995 .

[12]  Luciano Campi,et al.  Nonzero-Sum Stochastic Differential Games Between an Impulse Controller and a Stopper , 2019, Journal of Optimization Theory and Applications.

[13]  Fernando Zapatero,et al.  Classical and Impulse Stochastic Control of the Exchange Rate Using Interest Rates and Reserves , 2000 .

[14]  Ralf Korn,et al.  Some applications of impulse control in mathematical finance , 1999, Math. Methods Oper. Res..

[15]  Xin Guo,et al.  Stochastic Games and Mean field game with Singular Controls , 2017 .

[16]  J. Michael Harrison,et al.  Instantaneous Control of Brownian Motion , 1983, Math. Oper. Res..

[17]  Alain Bensoussan,et al.  Sequential Capacity Expansion Options , 2019, Oper. Res..

[18]  P. Lions,et al.  Mean field games , 2007 .

[19]  Alain Bensoussan,et al.  Linear-Quadratic Mean Field Games , 2014, Journal of Optimization Theory and Applications.

[20]  W. Runggaldier,et al.  On Classical and Restricted Impulse Stochastic Control for the Exchange Rate , 2016 .

[21]  J. Michael Harrison,et al.  Impulse Control of Brownian Motion , 1983, Math. Oper. Res..

[22]  Ralf Korn,et al.  Portfolio optimisation with strictly positive transaction costs and impulse control , 1998, Finance Stochastics.

[23]  Bernt Øksendal,et al.  Optimal Consumption and Portfolio with Both Fixed and Proportional Transaction Costs , 2001, SIAM J. Control. Optim..

[24]  R. Carmona,et al.  Mean Field Games and Systemic Risk , 2013, 1308.2172.

[25]  Kumar Muthuraman,et al.  Impulse Control of Interest Rates , 2013, Oper. Res..

[26]  B. Øksendal,et al.  Applied Stochastic Control of Jump Diffusions , 2004, Universitext.

[27]  Xin Guo,et al.  Smooth Fit Principle for Impulse Control of Multidimensional Diffusion Processes , 2009, SIAM J. Control. Optim..

[28]  Matteo Basei Optimal price management in retail energy markets: an impulse control problem with asymptotic estimates , 2019, Math. Methods Oper. Res..

[29]  George M. Constantinides,et al.  Existence of Optimal Simple Policies for Discounted-Cost Inventory and Cash Management in Continuous Time , 1978, Oper. Res..

[30]  David C. Mauer,et al.  Interactions of Corporate Financing and Investment Decisions: A Dynamic Framework , 1994 .

[31]  Thaleia Zariphopoulou,et al.  Mean field and n‐agent games for optimal investment under relative performance criteria , 2017, Mathematical Finance.

[32]  Huyên Pham,et al.  A model of optimal portfolio selection under liquidity risk and price impact , 2006, Finance Stochastics.

[33]  Michael Pinedo,et al.  Optimal Control of a Mean-Reverting Inventory , 2010, Oper. Res..

[34]  Andrea Cosso,et al.  Stochastic Differential Games Involving Impulse Controls and Double-Obstacle Quasi-variational Inequalities , 2012, SIAM J. Control. Optim..

[35]  Alexander J. Triantis,et al.  Valuing Flexibility as a Complex Option , 1990 .

[36]  Parsiad Azimzadeh The value of a zero-sum stochastic differential game involving impulse control , 2016 .

[37]  Lei Zhang,et al.  CLASSICAL AND IMPULSE STOCHASTIC CONTROL FOR THE OPTIMIZATION OF THE DIVIDEND AND RISK POLICIES OF AN INSURANCE FIRM , 2006 .

[38]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..