A Certainty Equivalent Merton Problem

The Merton problem is the well-known stochastic control problem of choosing consumption over time, as well as an investment mix, to maximize expected constant relative risk aversion (CRRA) utility of consumption. Merton formulated the problem and provided an analytical solution in 1970; since then a number of extensions of the original formulation have been solved. In this note we identify a certainty equivalent problem, i.e., a deterministic optimal control problem with the same optimal value function and optimal policy, for the base Merton problem, as well as a number of extensions. When time is discretized, the certainty equivalent problem becomes a second-order cone program (SOCP), readily formulated and solved using domain specific languages for convex optimization. This makes it a good starting point for model predictive control, a policy that can handle extensions that are either too cumbersome or impossible to handle exactly using standard dynamic programming methods.

[1]  Stephen P. Boyd,et al.  ECOS: An SOCP solver for embedded systems , 2013, 2013 European Control Conference (ECC).

[2]  Stephen P. Boyd,et al.  CVXGEN: a code generator for embedded convex optimization , 2011, Optimization and Engineering.

[3]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[4]  R. C. Merton,et al.  Optimum consumption and portfolio rules in a continuous - time model Journal of Economic Theory 3 , 1971 .

[5]  Suleyman Basak,et al.  Dynamic Mean-Variance Asset Allocation , 2009 .

[6]  Huibert Kwakernaak,et al.  Linear Optimal Control Systems , 1972 .

[7]  Stephen P. Boyd,et al.  Stochastic Control With Affine Dynamics and Extended Quadratic Costs , 2018, IEEE Transactions on Automatic Control.

[8]  Lisa Turner,et al.  Applications of Second Order Cone Programming , 2012 .

[9]  Stephen P. Boyd,et al.  Plenary talk: Performance bounds and suboptimal policies for multi-period investment , 2013, 22nd Mediterranean Conference on Control and Automation.

[10]  Stephen P. Boyd,et al.  Fast Model Predictive Control Using Online Optimization , 2010, IEEE Transactions on Control Systems Technology.

[11]  W. Kwon,et al.  Receding Horizon Control: Model Predictive Control for State Models , 2005 .

[12]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[13]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[14]  Least-squares approach to risk parity in portfolio selection , 2016 .

[15]  R. C. Merton,et al.  Optimum Consumption and Portfolio Rules in a Continuous-Time Model* , 1975 .

[16]  Stephen P. Boyd,et al.  A perspective-based convex relaxation for switched-affine optimal control , 2015, Syst. Control. Lett..

[17]  Stephen P. Boyd,et al.  Multi-Period Trading via Convex Optimization , 2017, Found. Trends Optim..

[18]  Stephen P. Boyd,et al.  Applications of second-order cone programming , 1998 .

[19]  Larry G. Epstein,et al.  Stochastic differential utility , 1992 .

[20]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[21]  Stephen P. Boyd,et al.  CVXPY: A Python-Embedded Modeling Language for Convex Optimization , 2016, J. Mach. Learn. Res..

[22]  Donald Goldfarb,et al.  Second-order cone programming , 2003, Math. Program..

[23]  Alberto Bemporad,et al.  Predictive Control for Linear and Hybrid Systems , 2017 .

[24]  Scott F. Richard,et al.  Optimal consumption, portfolio and life insurance rules for an uncertain lived individual in a continuous time model , 1975 .

[25]  P. Whittle Risk-Sensitive Optimal Control , 1990 .