Machine Learning for Continuous-Time Economics

This paper proposes a global algorithm to solve a large class of nonlinear continuous-time models in finance and economics. Using tools from machine learning, I recast problem of solving the corresponding nonlinear partial differential equations as a sequence of supervised learning problems. To illustrate the scope of the method, I solve nontrivial benchmark models and compare the numerical solution with the analytical ones. Furthermore, I propose a setting to test and evaluate solution methods. In the context of a neoclassical growth model, given any value function, the productivity function is reverse engineered so that the Hamilton-Jacobi-Bellman equation corresponding to the optimization problem is identically zero. This provides a testing ground for solution methods and an objective way of comparing them. Results indicate that the method is accurate and can handle nonlinear models with as many as 10 dimensions. Finally, I provide an open source library that implements the proposed algorithm.

[1]  R. C. Merton,et al.  Lifetime Portfolio Selection under Uncertainty: The Continuous-Time Case , 1969 .

[2]  S. Ross Options and Efficiency , 1976 .

[3]  R. Lucas ASSET PRICES IN AN EXCHANGE ECONOMY , 1978 .

[4]  Fumio Hayashi,et al.  TOBIN'S MARGINAL q AND AVERAGE q: A NEOCLASSICAL INTERPRETATION , 1982 .

[5]  S. Ross,et al.  AN INTERTEMPORAL GENERAL EQUILIBRIUM MODEL OF ASSET PRICES , 1985 .

[6]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .

[7]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[8]  Larry G. Epstein,et al.  Substitution, Risk Aversion, and the Temporal Behavior of Consumption and Asset Returns: A Theoretical Framework , 1989 .

[9]  Lawrence J. Christiano Linear-Quadratic Approximation and Value-Function Iteration: A Comparison , 1990 .

[10]  R. Radner Intertemporal General Equilibrium , 1991 .

[11]  Larry G. Epstein,et al.  Stochastic differential utility , 1992 .

[12]  Kenneth L. Judd,et al.  Projection methods for solving aggregate growth models , 1992 .

[13]  D. Duffie Dynamic Asset Pricing Theory , 1992 .

[14]  John Rust Using Randomization to Break the Curse of Dimensionality , 1997 .

[15]  Harald Uhlig,et al.  A Toolkit for Analysing Nonlinear Dynamic Stochastic Models Easily , 1995 .

[16]  Sy-Ming Guu,et al.  Asymptotic methods for aggregate growth models , 1997 .

[17]  K. Judd Numerical methods in economics , 1998 .

[18]  J. Campbell,et al.  By Force of Habit: A Consumption‐Based Explanation of Aggregate Stock Market Behavior , 1995, Journal of Political Economy.

[19]  Ravi Bansal,et al.  Risks for the Long Run: A Potential Resolution of Asset Pricing Puzzles , 2000 .

[20]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[21]  J. Cochrane Two trees , 1924, Bulletin of popular information - Arnold Arboretum, Harvard University..

[22]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[23]  Viktor Winschel,et al.  Solving, Estimating, and Selecting Nonlinear Dynamic Models Without the Curse of Dimensionality , 2010 .

[24]  Ian W. R. Martin,et al.  The Lucas Orchard , 2011 .

[25]  Lilia Maliar,et al.  Smolyak Method for Solving Dynamic Economic Models: Lagrange Interpolation, Anisotropic Grid and Adaptive Domain , 2013 .

[26]  D. Costarelli,et al.  Constructive Approximation by Superposition of Sigmoidal Functions , 2013 .

[27]  Lilia Maliar,et al.  Numerical Methods for Large-Scale Dynamic Economic Models , 2014 .

[28]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[29]  Frank Schorfheide,et al.  Solution and Estimation Methods for DSGE Models , 2015 .

[30]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[31]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[32]  Wolfgang Ziegler,et al.  Recursive Methods In Economic Dynamics , 2016 .

[33]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[34]  A Model of Monetary Policy and Risk Premia , 2018 .

[35]  Simon Scheidegger,et al.  Machine Learning for High-Dimensional Dynamic Stochastic Economies , 2017, J. Comput. Sci..