Exploration of the Parameter Space in Macroeconomic Agent-Based Models

Agent-Based Models (ABM) are computational scenario-generators, which can be used to predict the possible future outcomes of the complex system they represent. To better understand the robustness of these predictions, it is necessary to understand the full scope of the possible phenomena the model can generate. Most often, due to high-dimensional parameter spaces, this is a computationally expensive task. Inspired by ideas coming from systems biology, we show that for multiple macroeconomic models, including an agent-based model and several Dynamic Stochastic General Equilibrium (DSGE) models, there are only a few stiff parameter combinations that have strong effects, while the other sloppy directions are irrelevant. This suggest an algorithm that efficiently explores the space of parameters by primarily moving along the stiff directions. We apply our algorithm to a medium-sized agent-based model, and show that it recovers all possible dynamics of the unemployment rate. The application of this method to Agent-based Models may lead to a more thorough and robust understanding of their features, and provide enhanced parameter sensitivity analyses. Several promising paths for future research are discussed. 1 ar X iv :2 11 1. 08 65 4v 1 [ ec on .G N ] 1 6 N ov 2 02 1

[1]  Christopher R. Myers,et al.  Universally Sloppy Parameter Sensitivities in Systems Biology Models , 2007, PLoS Comput. Biol..

[2]  M. Gallegati,et al.  Network calibration and metamodeling of a financial accelerator agent based model , 2018, Journal of Economic Interaction and Coordination.

[3]  Sander van der Hoog,et al.  Surrogate Modelling in (and of) Agent-Based Models: A Prospectus , 2018, Computational Economics.

[4]  Zhe Li,et al.  Validation and Calibration of an Agent-Based Model: A Surrogate Approach , 2020 .

[5]  Blake LeBaron,et al.  Modeling Macroeconomies As Open-Ended Dynamic Systems of Interacting Agents , 2008 .

[6]  Giovanni Dosi,et al.  Micro and macro policies in the Keynes+Schumpeter evolutionary models , 2014, Journal of Evolutionary Economics.

[7]  Marco Del Negro,et al.  Inflation in the Great Recession and New Keynesian Models , 2013 .

[8]  Olivier J. Blanchard,et al.  On the future of macroeconomic models , 2018 .

[9]  Information geometry for multiparameter models: New perspectives on the origin of simplicity , 2021, 2111.07176.

[10]  Mardi Dungey,et al.  Monetary Policy, Inflation, and the Business Cycle: An Introduction to the New Keynesian Framework , 2009 .

[11]  J. Bouchaud,et al.  Tipping Points in Macroeconomic Agent-Based Models , 2013, 1307.5319.

[12]  Bryan C. Daniels,et al.  Perspective: Sloppiness and emergent theories in physics, biology, and beyond. , 2015, The Journal of chemical physics.

[13]  Bruce Tidor,et al.  Sloppy models, parameter uncertainty, and the role of experimental design. , 2010, Molecular bioSystems.

[14]  J. Bouchaud,et al.  Monetary policy and dark corners in a stylized agent-based model , 2015, 1501.00434.

[15]  Leigh Tesfatsion,et al.  Agent-Based Computational Economics: Growing Economies From the Bottom Up , 2002, Artificial Life.

[16]  J. Sethna,et al.  Parameter Space Compression Underlies Emergent Theories and Predictive Models , 2013, Science.

[17]  Ryan N. Gutenkunst,et al.  Sloppiness and the Geometry of Parameter Space , 2016 .

[18]  Martin Eichenbaum,et al.  On DSGE Models , 2018, Journal of Economic Perspectives.

[19]  Thomas W. Lucas,et al.  Efficient Nearly Orthogonal and Space-Filling Latin Hypercubes , 2007, Technometrics.

[20]  A. Turrell,et al.  Drawing on different disciplines: macroeconomic agent-based models , 2019 .

[21]  Joshua M. Epstein,et al.  Agent-based computational models and generative social science , 1999, Complex..

[22]  Arend Ligtenberg,et al.  The Use of Surrogate Models to Analyse Agent-Based Models , 2021, J. Artif. Soc. Soc. Simul..

[23]  Saul Desiderio,et al.  A Regression-Based Calibration Method for Agent-Based Models , 2021, Computational Economics.

[24]  Giorgio Fagiolo,et al.  Macroeconomic Policy in DSGE and Agent-Based Models Redux: New Developments and Challenges Ahead , 2016 .

[25]  Amir Sani,et al.  Agent-Based Model Calibration Using Machine Learning Surrogates , 2017, 1703.10639.

[26]  J. Stiglitz Where Modern Macroeconomics Went Wrong , 2017 .

[27]  P. François,et al.  Numerical Parameter Space Compression and Its Application to Biophysical Models. , 2020, Biophysical journal.

[28]  Frank Smets,et al.  Shocks and Frictions in Us Business Cycles: A Bayesian DSGE Approach , 2007, SSRN Electronic Journal.

[29]  Mark K Transtrum,et al.  Geometry of nonlinear least squares with applications to sloppy models and optimization. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[31]  Mark K Transtrum,et al.  Why are nonlinear fits to data so challenging? , 2009, Physical review letters.

[32]  Peer-Olaf Siebers,et al.  'One Size Does Not Fit All': A Roadmap of Purpose-Driven Mixed-Method Pathways for Sensitivity Analysis of Agent-Based Models , 2020, J. Artif. Soc. Soc. Simul..

[33]  G. Dosi,et al.  More is different ... and complex! the case for agent-based macroeconomics , 2019, Journal of Evolutionary Economics.

[34]  Greg Kaplan,et al.  Microeconomic Heterogeneity and Macroeconomic Shocks , 2018, Journal of Economic Perspectives.

[35]  Optimal Inflation Target: Insights from an Agent-Based Model , 2017 .

[36]  Charles T. Carlstrom,et al.  Replication data for: Targeting Long Rates in a Model with Segmented Markets , 2019 .