Policy Evaluation in Uncertain Economic Environments

This paper develops a decision-theoretic approach to policy analysis. We argue that policy evaluation should be conducted on the basis of two factors: the policymaker's preferences, and the conditional distribution of the outcomes of interest given a policy and available information. From this perspective, the common practice of conditioning on a particular model is often inappropriate, since model uncertainty is an important element of policy evaluation. We advocate the use of model averaging to account for model uncertainty and show how it may be applied to policy evaluation exercises. We illustrate our approach with applications to monetary policy and to growth policy.

[1]  Christopher A. Sims,et al.  The Role of Models and Probabilities in the Monetary Policy Process , 2002 .

[2]  Alain Desdoigts Patterns of Economic Development and the Formation of Clubs , 1999 .

[3]  E. Sterken,et al.  Monetary Policy Rules From , 2004 .

[4]  G. C. Tiao,et al.  Bayesian inference in statistical analysis , 1973 .

[5]  R. Marimon Learning from learning in economics , 1996 .

[6]  Christopher A. Sims,et al.  Pitfalls of a Minimax Approach to Model Uncertainty , 2001 .

[7]  Marcus Miller,et al.  ル-ルを変更して--サッチャ-政権の経済的帰結(Brookings Papers on Economic Activity) , 1984 .

[8]  Edward I. George,et al.  The Practical Implementation of Bayesian Model Selection , 2001 .

[9]  Lars Peter Hansen,et al.  Certainty equivalence and model uncertainty , 2005 .

[10]  Wasserman,et al.  Bayesian Model Selection and Model Averaging. , 2000, Journal of mathematical psychology.

[11]  David L. Dollar Outward-Oriented Developing Economies Really Do Grow More Rapidly: Evidence from 95 LDCs, 1976-1985 , 1992, Economic Development and Cultural Change.

[12]  R. Levine,et al.  A Sensitivity Analysis of Cross-Country Growth Regressions , 1991 .

[13]  J. Temple Growth Regressions and What the Textbooks Don't Tell You , 1999 .

[14]  Christopher Otrok,et al.  On Measuring the Welfare Cost of Business Cycles , 2001 .

[15]  Rajeev Dehejia,et al.  Program Evaluation as a Decision Problem , 1999 .

[16]  C. Sims Bayesian skepticism on unit root econometrics , 1988 .

[17]  Glenn D. Rudebusch,et al.  Policy Rules for Inflation Targeting , 1998 .

[18]  L. Tierney,et al.  Accurate Approximations for Posterior Moments and Marginal Densities , 1986 .

[19]  Thomas A. Knox,et al.  Learning How to Invest when Returns are Uncertain , 2002 .

[20]  Edward E. Leamer,et al.  Let's Take the Con Out of Econometrics , 1983 .

[21]  T. Sargent,et al.  Robust Control and Model Uncertainty , 2001 .

[22]  A. Tversky,et al.  Who accepts Savage's axiom? , 1974 .

[23]  A. Raftery Bayesian Model Selection in Social Research , 1995 .

[24]  Pierre Bernhard,et al.  SURVEY OF LINEAR QUADRATIC ROBUST CONTROL , 2002, Macroeconomic Dynamics.

[25]  D. Ellsberg Decision, probability, and utility: Risk, ambiguity, and the Savage axioms , 1961 .

[26]  Allan Drazen,et al.  Threshold Externalities in Economic Development , 1990 .

[27]  Bennett T. McCallum,et al.  Robustness properties of a rule for monetary policy , 1988 .

[28]  Andrew T. Levin,et al.  Robust Monetary Policy with Competing Reference Models , 2003 .

[29]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[30]  Donald B. Rubin,et al.  Using Empirical Bayes Techniques in the Law School Validity Studies , 1980 .

[31]  Marc P. Giannoni,et al.  DOES MODEL UNCERTAINTY JUSTIFY CAUTION? ROBUST OPTIMAL MONETARY POLICY IN A FORWARD-LOOKING MODEL , 2002, Macroeconomic Dynamics.

[32]  Larry G. Epstein,et al.  Learning Under Ambiguity , 2002 .

[33]  X. Sala-i-Martin,et al.  Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (Bace) Approach , 2000 .

[34]  Peter C. B. Phillips,et al.  To Criticize the Critics: An Objective Bayesian Analysis of Stochastic Trends , 1991 .

[35]  T. Sargent,et al.  Robust Permanent Income and Pricing , 1999 .

[36]  T. Sargent,et al.  Acknowledging Misspecification in Macroeconomic Theory , 2001 .

[37]  Gary Chamberlain,et al.  Econometrics and decision theory , 2000 .

[38]  D. Weil,et al.  A Contribution to the Empirics of Economic Growth Author ( s ) : , 2008 .

[39]  Danny Quah,et al.  The New Empirics of Economic Growth , 1998 .

[40]  Alexei Onatski,et al.  ROBUST MONETARY POLICY UNDER MODEL UNCERTAINTY IN A SMALL MODEL OF THE U.S. ECONOMY , 1998, Macroeconomic Dynamics.

[41]  T. Sargent The Conquest of American Inflation , 1999 .

[42]  M. Steel,et al.  Benchmark Priors for Bayesian Model Averaging , 2001 .

[43]  I. Gilboa,et al.  Maxmin Expected Utility with Non-Unique Prior , 1989 .

[44]  T. C. Edens,et al.  Economic Growth , 1957, The Journal of Economic History.

[45]  D. Madigan,et al.  Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window , 1994 .

[46]  James J. Heckman,et al.  Micro Data, Heterogeneity and the Evaluation of Public Policy Part 1 , 2001 .

[47]  Charles F. Manski,et al.  Identification problems and decisions under ambiguity: Empirical analysis of treatment response and normative analysis of treatment choice , 2000 .

[48]  M. Woodford Inflation Stabilization and Welfare , 2001 .

[49]  John B. Taylor The Robustness and Efficiency of Monetary Policy Rules as Guidelines for Interest Rate Setting by the European Central Bank , 1999 .

[50]  S. Durlauf,et al.  Interpreting Tests of the Convergence Hypothesis , 1994 .

[51]  Alexei Onatski,et al.  Modeling Model Uncertainty , 2002 .

[52]  John Maynard Keynes,et al.  On a Method of Statistical Business-Cycle Research. A Comment , 1940 .

[53]  Howard Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[54]  Steven N. Durlauf,et al.  The local Solow growth model , 2001 .

[55]  Stephanie Schmitt-Grohé,et al.  Optimal Fiscal and Monetary Policy Under Sticky Prices , 2001, J. Econ. Theory.

[56]  Margaret Mary McConnell,et al.  Output Fluctuations in the United States: What Has Changed Since the Early 1980s? , 1998 .

[57]  William C. Brainard Uncertainty and the effectiveness of policy , 1967 .

[58]  Optimal fiscal and monetary policy under imperfect competition , 2004 .

[59]  G. Harcourt Keynes, John Maynard , 2001 .

[60]  M. Steel,et al.  Model uncertainty in cross-country growth regressions , 2001 .

[61]  John B. Taylor Monetary Policy Rules , 1999 .

[62]  Steven N. Durlauf,et al.  Econometric analysis and the study of economic growth : a skeptical perspective , 2000 .

[63]  H. Jeffreys A Treatise on Probability , 1922, Nature.

[64]  T. Fearn,et al.  Bayes model averaging with selection of regressors , 2002 .

[65]  C. Sims,et al.  What Does Monetary Policy Do , 1996 .

[66]  S. Becker,et al.  What Price Ambiguity? or the Role of Ambiguity in Decision-Making , 1964, Journal of Political Economy.

[67]  Charles F. Manski,et al.  Social Learning from Private Experiences: The Dynamics of the Selection Problem , 2004 .

[68]  F. Knight The economic nature of the firm: From Risk, Uncertainty, and Profit , 2009 .

[69]  Abraham Wald,et al.  Statistical Decision Functions , 1951 .

[70]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[71]  R. Abrams,et al.  Psychological sources of ambiguity avoidance , 1986 .

[72]  James D. Hamilton A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle , 1989 .

[73]  Joseph B. Kadane,et al.  Priors for unit root models , 1996 .

[74]  Stephen F. Knack,et al.  INSTITUTIONS AND ECONOMIC PERFORMANCE: CROSS‐COUNTRY TESTS USING ALTERNATIVE INSTITUTIONAL MEASURES , 1995 .

[75]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[76]  H. Broadman,et al.  Finance and Growth: Schumpeter Might Be Right , 1993 .

[77]  Michael McAleer,et al.  What Will Take the Con out of Econometrics , 1985 .

[78]  Lars Peter Hansen,et al.  Robust control and filtering of forward-looking models , 2000 .

[79]  X. Sala-i-Martin,et al.  I Just Ran Two Million Regressions , 1997 .

[80]  Adrian E. Raftery,et al.  Bayesian model averaging: a tutorial (with comments by M. Clyde, David Draper and E. I. George, and a rejoinder by the authors , 1999 .

[81]  John B. Taylor How Should Monetary Policy Respond to Shocks While Maintaining Long-Run Price Stability , 1996 .

[82]  X. Sala-i-Martin,et al.  DETERMINANTS OF LONG-TERM GROWTH: A BAYESIAN AVERAGING OF CLASSICAL ESTIMATES (BACE) APPROACH ECONOMICS DEPARTMENT WORKING PAPERS NO. 266 , 2000 .

[83]  M. Kendall Theoretical Statistics , 1956, Nature.

[84]  Friedrich A. von Hayek,et al.  Scientism and the Study of Society , 1942 .

[85]  T. Fearn,et al.  Multivariate Bayesian variable selection and prediction , 1998 .

[86]  Edward E. Leamer,et al.  Reporting the Fragility of Regression Estimates , 1983 .

[87]  D. Lindley The 1988 Wald Memorial Lectures: The Present Position in Bayesian Statistics , 1990 .

[88]  David Draper,et al.  Assessment and Propagation of Model Uncertainty , 2011 .

[89]  Steven N. Durlauf,et al.  Multiple regimes and cross‐country growth behaviour , 1995 .

[90]  J. Heckman Micro Data, Heterogeneity, and the Evaluation of Public Policy: Nobel Lecture , 2001, Journal of Political Economy.

[91]  Evan W. Anderson The dynamics of risk-sensitive allocations , 2005, J. Econ. Theory.

[92]  D. Madigan,et al.  Bayesian Model Averaging for Linear Regression Models , 1997 .

[93]  Alan S. Blinder,et al.  Distinguished Lecture on Economics in Government: What Central Bankers Could Learn from Academics--and Vice Versa , 1997 .

[94]  W. Easterly,et al.  Africa's Growth Tragedy: Policies and Ethnic Divisions , 1997 .