Learning About Learning in Dynamic Economic Models

This chapter of the Handbook of Computational Economics is mostly about research on active learning and is confined to discussion of learning in dynamic models in which the systems equations are linear, the criterion function is quadratic and the additive noise terms are Gaussian. Though there is much work on learning in more general systems, it is useful here to focus on models with these specifications since more general systems can be approximated in this way and since much of the early work on learning has been done with these quadraticlinear-gaussian systems. We begin with what has been learned about learning in dynamic economic models in the last few decades. Then we progress to a discussion of what we hope to learn in the future from a new project that is just getting underway. However before doing either of these it is useful to provide a short description of the mathematical framework that will be used in the chapter.

[1]  Gregory S. Crawford,et al.  Uncertainty and Learning in Pharmaceutical Demand , 2005 .

[2]  Marco P. Tucci The Nonconvexities Problem in Adaptive Control Models: A Simple Computational Solution , 1998 .

[3]  R. Lucas Econometric policy evaluation: A critique , 1976 .

[4]  Hans M. Amman,et al.  Should Macroeconomic Policy Makers Consider Parameter Covariances? , 1999 .

[5]  D. Kendrick Control theory with applications to economics , 2000 .

[6]  Leonard J. Mirman,et al.  A Bayesian Approach to the Production of Information and Learning by Doing , 1977 .

[7]  V. Wieland Monetary Policy, Parameter Uncertainty and Optimal Learning , 2000 .

[8]  Marco P. Tucci,et al.  A note on global optimization in adaptive control, econometrics and macroeconomics , 2002 .

[9]  R. Sundaram,et al.  Bayesian Economist... Bayesian Agents I: An Alternative Approach to Optimal Learning , 1993 .

[10]  M. Spagat,et al.  Growth under uncertainty with experimentation , 1998 .

[11]  Daniel Trefler The Ignorant Monopolist: Optimal Learning with Endogenous Information , 1993 .

[12]  B. Jullien,et al.  OPTIMAL LEARNING BY EXPERIMENTATION , 1991 .

[13]  Marco P. Tucci Adaptive Control in the Presence of Time-Varying Parameters , 1989 .

[14]  Hans M. Amman,et al.  Solving the Beck and Wieland model with optimal experimentation in DualPC , 2008, Autom..

[15]  Yaakov Bar-Shalom,et al.  An actively adaptive control for linear systems with random parameters via the dual control approach , 1972, CDC 1972.

[16]  Martin Ellison The Learning Cost of Interest Rate Reversals , 2003 .

[17]  Thomas F. Coleman,et al.  Handbook for matrix computations , 1988 .

[18]  A. H. Hallett,et al.  Efficient solution techniques for dynamic non-linear rational expectations models , 1986 .

[19]  G. Chow A Solution to Optimal Control of Linear Systems with Unknown Parameters , 1975 .

[20]  N. Kiefer,et al.  Controlling a Stochastic Process with Unknown Parameters , 1988 .

[21]  E. Tse Further comments on "Adaptive stochastic control for a class of linear systems" , 1973 .

[22]  Marco P. Tucci The Rational Expectation Hypothesis, Time-Varying Parameters and Adaptive Control: A Promising Combination? , 2004 .

[23]  Lars E. O. Svensson,et al.  Bayesian and Adaptive Optimal Policy Under Model Uncertainty , 2007 .

[24]  G. Violante,et al.  Quantifying the Effects of the Demographic Transition in Developing Economies , 2006 .

[26]  V. Wieland Monetary Policy and Uncertainty about the Natural Unemployment Rate: Brainard-Style Conservatism versus Experimental Activism , 2006 .

[27]  D. Kendrick,et al.  LINEAR-QUADRATIC OPTIMIZATION FOR MODELS WITH RATIONAL EXPECTATIONS , 1999, Macroeconomic Dynamics.

[28]  David A. Kendrick,et al.  Non-convexities from probing in adaptive control problems☆ , 1978 .

[29]  Sergei Morozov,et al.  Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control , 2011, Computational Economics.

[30]  David A. Kendrick,et al.  Stochastic control for economic models: past, present and the paths ahead , 2005 .

[31]  John B. Taylor Asymptotic Properties of Multiperiod Control Rules in the Linear Regression Model , 1974 .

[32]  David A. Kendrick,et al.  Applications of Control Theory to Macroeconomics , 1976 .

[33]  Marco P. Tucci Time-Varying Parameters in Adaptive Control , 1989 .

[34]  Hans M. Amman,et al.  Expected Optimal Feedback with Time-Varying Parameters , 2013 .

[35]  R. Fair,et al.  Solution and Maximum Likelihood Estimation of Dynamic Nonlinear Rationalexpectations Models , 1980 .

[36]  Volker Wieland,et al.  Learning by doing and the value of optimal experimentation , 2000 .

[37]  Gary S. Anderson,et al.  A linear algebraic procedure for solving linear perfect foresight models , 1985 .

[38]  Hans M. Amman,et al.  Mitigation Of The Lucas Critique With Stochastic Control Methods , 2003 .

[39]  R. Pindyck,et al.  Optimal Planning for Economic Stabilization , 1975 .

[40]  Optimal Policies for Economic Stabilization , 1973 .

[41]  G. Stewart,et al.  An Algorithm for Generalized Matrix Eigenvalue Problems. , 1973 .

[42]  Matrix methods for solving nonlinear dynamic optimization models , 2000 .

[43]  Hans M. Amman,et al.  Nonconvexities in Stochastic Control Models. , 1995 .

[44]  E. C. Macrae An Adaptive Learning Rule for Multiperiod Decision Problems , 1975 .

[45]  Bruce Mizrach,et al.  Nonconvexities in a stochastic control problem with learning , 1991 .

[46]  Hans M. Amman,et al.  Active learning: A correction , 1997 .

[47]  Gunter W. Beck,et al.  Learning and control in a changing economic environment , 2002 .

[48]  T. Cosimano Optimal Experimentation and the Perturbation Method , 2003 .

[49]  Nicholas M. Kiefer A value function arising in the economics of information , 1989 .

[50]  Hans M. Amman,et al.  Nonconvexities in Stochastic Control Models: An Analysis , 1994 .

[51]  E. Tse,et al.  Further comments on "Adaptive stochastic control for a class of linear systems" , 1972 .

[52]  Paul Glasserman,et al.  Monte Carlo Methods in Financial Engineering , 2003 .

[53]  E. Prescott THE MULTI-PERIOD CONTROL PROBLEM UNDER UNCERTAINTY , 1972 .

[54]  Elizabeth Chase MacRae,et al.  Linear Decision with Experimentation , 1972 .

[55]  Y. Bar-Shalom,et al.  Wide-sense adaptive dual control for nonlinear stochastic systems , 1973 .

[56]  G. Chow Analysis and control of dynamic economic systems , 1975 .

[57]  Hans M. Amman,et al.  A Classification System for Economic Stochastic Control Models , 2006 .

[58]  Hans M. Amman,et al.  Active learning Monte Carlo results , 1994 .

[59]  Reinhard Neck,et al.  Opticon: An algorithm for the optimal control of nonlinear stochastic models , 1992, Ann. Oper. Res..

[60]  Hans M. Amman,et al.  Numerical methods for linear-quadratic models , 1996 .

[61]  Alfred L. Norman,et al.  FIRST ORDER DUAL CONTROL , 1976 .

[62]  Hans M. Amman,et al.  The parameter set in an adaptive control Monte Carlo experiment: Some considerations , 2007 .

[63]  Henri Theil Optimal decision rules for government and industry , 1965 .

[64]  Reinhard Neck,et al.  Stochastic control theory and operational research , 1984 .

[65]  David A. Kendrick,et al.  Stochastic control for economic models , 1981 .

[66]  Hans M. Amman,et al.  The Duali/Dualpc Software for Optimal Control Models: User's Guide , 1999 .

[67]  Hans M. Amman,et al.  The DUALI/DUALPC Software for Optimal Control Models: Introduction , 1996 .

[68]  T. Cosimano Optimal experimentation and the perturbation method in the neighborhood of the augmented linear regulator problem , 2008 .

[69]  Volker Wieland,et al.  Data Uncertainty and the Role of Money as an Information Variable for Monetary Policy , 2003, SSRN Electronic Journal.

[70]  N. Kiefer,et al.  Optimal Control of an Unknown Linear Process with Learning , 1989 .

[71]  C. Sims Solving Linear Rational Expectations Models , 2002 .

[72]  Alfred L. Norman,et al.  Multiple relative maxima in optimal macroeconomic policy: an illustration , 1979 .

[73]  Charles M. Kahn,et al.  THE SOLUTION OF LINEAR DIFFERENCE MODELS UNDER RATIONAL EXPECTATIONS , 1980 .