Rules of Thumb versus Dynamic Programming

This paper studies decisionmaking with rules of thumb in the context of dynamic decision problems and compares it to dynamic programming. A rule is a fixed mapping from a subset of states into actions. Rules are compared by averaging over past experiences. This can lead to favoring rules which are only applicable in good states. Correcting this good state bias requires solving the dynamic program. The authors provide a general framework and characterize the asymptotic properties. They apply it to provide a candidate explanation for the sensitivity of consumption to transitory income.

[1]  E. Thorndike.  “Animal Intelligence” , 1898, Nature.

[2]  J. M. Blackburn.  The acquisition of skill : an analysis of learning curves , 1936 .

[3]  Income and consumption , 1939 .

[4]  Richard H. Day,et al.  Myopic Optimizing and Rules of Thumb in a Micro-Model of Industrial Growth , 1974 .

[5]  Elizabeth C. Hirschman,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[6]  R. Hall.  Stochastic Implications of the Life Cycle-Permanent Income Hypothesis: Theory and Evidence , 1978, Journal of Political Economy.

[7]  John R. Anderson.  Cognitive Psychology and Its Implications , 1980 .

[8]  Frederic S. Mishkin,et al.  The Sensitivity of Consumption to Transitory Income: Estimates from Panel Data on Households , 1980 .

[9]  Marjorie Flavin,et al.  The Adjustment of Consumption to Changing Expectations About Future Income , 1981, Journal of Political Economy.

[10]  Student,et al.  PSYCHOLOGY OF PREFERENCES , 1982, Pediatrics.

[11]  The Sensitivity of Consumption to Transitory Income: Estimates from Panel Data on Households , 1982 .

[12]  L. Summers,et al.  The Changing Cyclical Variability of Economic Activity in the United States , 1984 .

[13]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[14]  M. Metivier,et al.  Applications of a Kushner and Clark lemma to general classes of stochastic algorithms , 1984, IEEE Trans. Inf. Theory.

[15]  R. Gordon.  The American business cycle : continuity and change , 1987 .

[16]  N. Mankiw,et al.  Permanent Income, Current Income, and Consumption , 1987 .

[17]  Stephen M. Johnson,et al.  Can People Compute? an Experimental Test of the Life Cycle Consumption Model , 1987 .

[18]  J. Hey,et al.  Optimal Consumption under Uncertainty: An Experimental Investigation , 1988 .

[19]  N. Kiyotaki,et al.  Production and consumption , 2013 .

[20]  T. Sargent,et al.  Convergence of Least Squares Learning Mechanisms in Self- Referential Linear Stochastic Models* , 1989 .

[21]  S. Zeldes.  Consumption and Liquidity Constraints: An Empirical Investigation , 1989, Journal of Political Economy.

[22]  B. Ingram.  Equilibrium Modeling of Asset Prices: Rationality versus Rules of Thumb , 1990 .

[23]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[24]  Ellen R. McGrattan,et al.  Money as a medium of exchange in an economy with artificially intelligent agents , 1990 .

[25]  Anthony A. Smith.  Solving Stochastic Dynamic Programming Problems Using Rules Of Thumb , 1991 .

[26]  G. Pflug,et al.  Stochastic approximation and optimization of random systems , 1992 .

[27]  L. Samuelson,et al.  Evolutionary stability in repeated games played by finite automata , 1992 .

[28]  G. F. Tremblay,et al.  Bright Air, Brilliant Fire: On the Matter of the Mind, Gerald M. Edelman. 1992. Basic Books, New York, NY. 280 pages. ISBN: 0-465-05245-2. $25.00 , 1992 .

[29]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[30]  R. Rosenthal.  Rules of thumb in games , 1993 .

[31]  Glenn Ellison,et al.  Rules of Thumb for Social Learning , 1993, Journal of Political Economy.

[32]  Thomas J. Sargent,et al.  Bounded Rationality in Macroeconomics: The Arne Ryde Memorial Lectures , 1993 .

[33]  S. Zeldes,et al.  The Importance of Precautionary Motives in Explaining Individual and Aggregate Saving , 1993 .

[34]  Pamela Ramser,et al.  Quasi-rational Economics , 1993 .

[35]  W. Brian Arthur,et al.  On designing economic agents that behave like human agents , 1993 .

[36]  T. Sargent.  Bounded rationality in macroeconomics , 1993 .

[37]  Joseph G. Eisenhauer.  SAVING AND SOCIAL INSURANCE , 1994 .

[38]  K. Vandezande,et al.  The Price Is Right, But Are The Bids? An Empirical Investigation of Rational Decision Making , 1994 .

[39]  S. Wren‐Lewis,et al.  Are Wages Forward Looking , 1994 .

[40]  S. Pinker.  The Language Instinct , 1994 .

[41]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[42]  Ben J. A. Kröse,et al.  Learning from delayed rewards , 1995, Robotics Auton. Syst..

[43]  J. Skinner,et al.  Precautionary Saving and Social Insurance , 1994, Journal of Political Economy.

[44]  Shlomo Zilberstein,et al.  Models of Bounded Rationality , 1995 .

[45]  Andrew G. Barto,et al.  Learning to Act Using Real-Time Dynamic Programming , 1995, Artif. Intell..

[46]  Jonathan B. Berk,et al.  The Price Is Right, but Are the Bids? An Investigation of Rational Decision Theory , 1996 .

[47]  Tilman Börgers.  ON THE RELEVANCE OF LEARNING AND EVOLUTION TO ECONOMIC THEORY , 1996 .

[48]  Martin Browning,et al.  Household Saving: Micro Theories and Micro Facts , 1996 .

[49]  Anthony A. Smith,et al.  Rules of thumb in macroeconomic equilibrium A quantitative analysis , 1996 .

[50]  Annamaria Lusardi,et al.  Permanent Income, Current Income, and Consumption: Evidence From Two Panel Data Sets , 1996 .

[51]  Tilman Börgers,et al.  Learning Through Reinforcement and Replicator Dynamics , 1997 .

[52]  D. Kahneman,et al.  Back to Bentham? Explorations of experience utility , 1997 .

[53]  David Easley,et al.  Choice without beliefs , 1999 .

[54]  S. Pinker.  How the Mind Works , 1999, Philosophy after Darwin.

[55]  S. Ludvigson,et al.  Can Buffer Stock Saving Explain the Smoothness and Excess Sensitivity of Consumption? , 2000 .

[56]  Igor Durdanovic,et al.  Evolution of Cooperative Problem Solving in an Artificial Economy , 2000, Neural Computation.

[57]  Ariel Pakes,et al.  A Framework for Applied Dynamic Analysis in I.O , 2000 .

[58]  Blake LeBaron,et al.  Empirical regularities from interacting long- and short-memory investors in an agent-based stock market , 2001, IEEE Trans. Evol. Comput..