A Symbolic Closed-Form Solution to Sequential Market Making with Inventory

Market-makers serve an important role as providers of liquidity and order in financial markets, particularly during periods of high volatility. Optimal market-makers solve a sequential decision making problem, where they face an exploration versus exploitation dilemma at each time step. A belief state MDP based solution was presented by Das and Magdon-Ismail [2008]. This solution however, was closely tied to the choice of a Gaussian belief state prior and did not take asset inventory into consideration when calculating an optimal policy. In this work we introduce a novel continuous state POMDP framework which is the first to solve, exactly and in closed-form, the optimal market-making problem with inventory, fixed asset value, arbitrary belief state priors, trader models and reward functions via symbolic dynamic programming. We use this novel model and solution to show that sequentially optimal policies are heavily inventory-dependent and calculate policies that operate with bounded loss guarantees under a variety of market models and conditions.

[1]  D. Sornette Why Stock Markets Crash: Critical Events in Complex Financial Systems , 2017 .

[2]  B. Swart,et al.  Quantitative Finance , 2006, Metals and Energy Finance.

[3]  David M. Pennock,et al.  Algorithmic Game Theory: Computational Aspects of Prediction Markets , 2007 .

[4]  E. J. Sondik,et al.  The Optimal Control of Partially Observable Markov Decision Processes. , 1971 .

[5]  George E. Monahan,et al.  A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms , 2007 .

[6]  R. Hanson LOGARITHMIC MARKETS CORING RULES FOR MODULAR COMBINATORIAL INFORMATION AGGREGATION , 2012 .

[7]  S. Sanner,et al.  Symbolic Dynamic Programming for Continuous State and Action MDPs , 2012, AAAI.

[8]  S. Joe Qin,et al.  A survey of industrial model predictive control technology , 2003 .

[9]  A. G. Kyurkchan,et al.  Theoretical and Mathematical Physics , 2004 .

[10]  Joelle Pineau,et al.  Point-based value iteration: An anytime algorithm for POMDPs , 2003, IJCAI.

[11]  Robin Hanson,et al.  Combinatorial Information Market Design , 2003, Inf. Syst. Frontiers.

[12]  Sanmay Das,et al.  A bayesian market maker , 2012, EC '12.

[13]  Joel Veness,et al.  Monte-Carlo Planning in Large POMDPs , 2010, NIPS.

[14]  Y. Amihud,et al.  Dealership market: Market-making with inventory , 1980 .

[15]  R. Gorvett Why Stock Markets Crash: Critical Events in Complex Financial Systems , 2005 .

[16]  Sanmay Das,et al.  The effects of market-making on price dynamics , 2008, AAMAS.

[17]  Tuomas Sandholm,et al.  Rational market making with probabilistic knowledge , 2012, AAMAS.

[18]  Paul R. Milgrom,et al.  Bid, ask and transaction prices in a specialist market with heterogeneously informed traders , 1985 .

[19]  Sanmay Das A learning market-maker in the Glosten–Milgrom model , 2005 .

[20]  S. Prabakaran,et al.  THE STATISTICAL MECHANICS OF FINANCIAL MARKETS , 2007 .

[21]  Pascal Poupart,et al.  Point-Based Value Iteration for Continuous POMDPs , 2006, J. Mach. Learn. Res..

[22]  Jesse Hoey,et al.  An analytic solution to discrete Bayesian reinforcement learning , 2006, ICML.

[23]  David M. Pennock,et al.  A practical liquidity-sensitive automated market maker , 2010, EC '10.

[24]  Zahra Zamani,et al.  Symbolic Dynamic Programming for Continuous State and Observation POMDPs , 2012, NIPS.

[25]  Maureen O'Hara,et al.  PRICE, TRADE SIZE, AND INFORMATION IN SECURITIES MARKETS* , 1987 .

[26]  Craig Boutilier,et al.  Symbolic Dynamic Programming for First-Order MDPs , 2001, IJCAI.

[27]  David M. Pennock,et al.  A Utility Framework for Bounded-Loss Market Makers , 2007, UAI.

[28]  L. Gillemot,et al.  Statistical theory of the continuous double auction , 2002, cond-mat/0210475.

[29]  Sanmay Das,et al.  Adapting to a Market Shock: Optimal Sequential Market-Making , 2008, NIPS.

[30]  Karl Johan Åström,et al.  Optimal control of Markov processes with incomplete state information , 1965 .

[31]  B. Mandlebrot The Variation of Certain Speculative Prices , 1963 .

[32]  R. Lourie,et al.  The Statistical Mechanics of Financial Markets , 2002 .

[33]  B. Mandelbrot The Variation of Certain Speculative Prices , 1963 .

[34]  Tanmoy Chakraborty,et al.  Market making and mean reversion , 2011, EC '11.

[35]  H. Raghav Rao,et al.  Information systems frontiers , 2000, CACM.

[36]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[37]  Scott Sanner,et al.  Symbolic Dynamic Programming for Discrete and Continuous State MDPs , 2011, UAI.