A Critical Guide to Empirical Validation of Agent-Based Economics Models : Methodologies , Procedures , and Open Problems

This paper addresses the methodological problems of empirical validation in agentbased (AB) economics models and how these are currently being tackled. We first identify a set of issues that are common to all modellers engaged in empirical validation. We then propose a novel taxonomy, which captures the relevant dimensions along which AB economics models differ. We argue that these dimensions affect the way in which empirical validation is carried out by AB modelllers and we critically discuss the main alternative approaches to empirical validation being developed in AB economics. We conclude focusing on a set of (as yet) unresolved issues for empirical validation that require future research.

[1]  Sport Neuropsychology,et al.  The Handbook , 2007, Journal of the International Neuropsychological Society.

[2]  Roberto Leombruni,et al.  A Common Protocol for Agent-Based Social Simulation , 2006, J. Artif. Soc. Soc. Simul..

[3]  Giorgio Fagiolo,et al.  An Evolutionary Model of Endogenous Business Cycles , 2006 .

[4]  R. Nelson.  Recent Evolutionary Theorizing about Economic Change , 2005, Technology, Institutions, and Economic Growth.

[5]  P. Windrum.  Heterogeneous preferences and new innovation cycles in mature industries: the amateur camera industry 1955-1974 , 2005 .

[6]  Deddy P. Koesrindartoto,et al.  An agent-based computational laboratory for testing the economic reliability of wholesale power market designs , 2005, IEEE Power Engineering Society General Meeting, 2005.

[7]  Andreas Pyka,et al.  Agent-Based Modelling: A Methodology for Neo-Schumpeterian Economics , 2005 .

[8]  P. Saviotti,et al.  Economic development, qualitative change and employment creation , 2004 .

[9]  Bruce Edmonds,et al.  From KISS to KIDS - An 'Anti-simplistic' Modelling Approach , 2004, MABS.

[10]  G. Nigel Gilbert,et al.  Open Problems in Using Agent-Based Models in Industrial and Labor Dynamics , 2004, Adv. Complex Syst..

[11]  Giorgio Fagiolo,et al.  Matching, Bargaining, and Wage Setting in an Evolutionary Model of Labor Market and Output Dynamics , 2004, Adv. Complex Syst..

[12]  D. Gatti,et al.  A new approach to business fluctuations: heterogeneous interacting agents, scaling laws and financial fragility , 2003, cond-mat/0312096.

[13]  G. Dosi,et al.  Exploitation, exploration and innovation in a model of endogenous growth with locally interacting agents , 2003 .

[14]  Thomas Brenner,et al.  The Use of Simulations in Developing Robust Knowledge about Causal Processes: Methodological Considerations and an Application to Industrial Evolution , 2003 .

[15]  Giorgio Fagiolo,et al.  ENDOGENOUS NETWORKS IN RANDOM POPULATION GAMES , 2003 .

[16]  Franco Malerba,et al.  Innovation and market structure in the dynamics of the pharmaceutical industry and biotechnology: towards a history‐friendly model , 2002 .

[17]  Paul Downward,et al.  Critical realism, empirical methods and inference: a critical discussion , 2002 .

[18]  有賀 裕二,et al.  「進化経済学会・有賀裕二編」, 『Evolutionary Controversies in Economics : A New Transdisciplinary Approach』, 出版社Springer,Tokyo, 発行日2001年7月, 24cm×16cm版, xv+252頁, ISBN4-431-70303-9 , 2002 .

[19]  Leigh Tesfatsion,et al.  Agent-Based Computational Economics: Growing Economies From the Bottom Up , 2002, Artificial Life.

[20]  Frank Schorfheide,et al.  Loss function‐based evaluation of DSGE models , 2000 .

[21]  J. Kleijnen,et al.  Validation of models: statistical techniques and data availability , 1999, WSC'99. 1999 Winter Simulation Conference Proceedings. 'Simulation - A Bridge to the Future' (Cat. No.99CH37038).

[22]  William A. Brock,et al.  Scaling in Economics: A Reader's Guide , 1999 .

[23]  F. Malerba.  'History-friendly' Models of Industry Evolution: The Computer Industry , 1999 .

[24]  Marco Lippi,et al.  Aggregation and the Microfoundations of Dynamic Macroeconomics , 1998 .

[25]  Alan Kirman,et al.  The economy as an evolving network , 1997 .

[26]  Marc Willinger,et al.  Alternative methodologies for modelling evolutionary dynamics: Introduction , 1997 .

[27]  Jim Doran,et al.  From computer simulation to artificial societies , 1997 .

[28]  Kim R. Sawyer,et al.  Underdetermination in Economics. The Duhem-Quine Thesis , 1997, Economics and Philosophy.

[29]  Fernando Vega-Redondo,et al.  Evolution, Games, and Economic Behaviour , 1996 .

[30]  L. Tesfatsion.  HOW ECONOMISTS CAN GET ALIFE , 1995 .

[31]  Bart Verspagen,et al.  Evolutionary Theorizing on Economic Growth , 1995 .

[32]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[33]  J. Kleijnen.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[34]  G. Dosi,et al.  An introduction to evolutionary theories in economics , 1994 .

[35]  Uskali M√§ki,et al.  Reorienting the Assumptions Issue , 1994 .

[36]  David A. Lane,et al.  Artificial worlds and economics, part I , 1993 .

[37]  Stan J. Liebowitz,et al.  The Fable of the Keys , 1990, The Journal of Law and Economics.

[38]  Alan Kirman,et al.  The Intrinsic Limits of Modern Economic-Theory - the Emperor Has No Clothes , 1989 .

[39]  Luigi Orsenigo,et al.  Innovation, Diversity and Diffusion: A Self-organisation Model , 1988 .

[40]  Edward E. Leamer,et al.  Specification Searches: Ad Hoc Inference with Nonexperimental Data , 1980 .

[41]  T. Sargent,et al.  After Keynesian macroeconomics , 1979 .

[42]  W. Bean.  What is History , 1964 .

[43]  T. Kuhn,et al.  The Structure of Scientific Revolutions , 1963 .

[44]  T. Haavelmo,et al.  The probability approach in econometrics , 1944 .

[45]  B. Verspagen,et al.  Elgar companion to neo-schumpeterian economics , 2007 .

[46]  R. Marks.  Market Design Using Agent-Based Models , 2006 .

[47]  Herbert Dawid,et al.  Agent-based Models of Innovation and Technological Change , 2006 .

[48]  Paul Windrum,et al.  Structural change in the presence of network externalities: a co-evolutionary model of technological successions , 2004 .

[49]  Koen Frenken,et al.  History, state and prospects of evolutionary models of technical change : a review with special emphasis on complexity theory , 2004 .

[50]  Thomas Brenner,et al.  Agent Learning Representation - Advice in Modelling Economic Learning , 2004 .

[51]  Roberto Leombruni,et al.  The Methodological Status of Agent-Based Simulations , 2002 .

[52]  Robin Cowan,et al.  Evolutionary economics and the counterfactual threat: on the nature and role of counterfactual history as an empirical tool in economics , 2002 .

[53]  Edmund Chattoe,et al.  Building Empirically Plausible Multi-Agent Systems: A Case Study of Innovation Diffusion , 2002 .

[54]  Gianfranco Giulioni,et al.  Financial Fragility, Patterns of Firms' Entry and Exit and Aggregate Dynamics , 2000 .

[55]  Paul Windrum,et al.  Simulation models of technological innovation: a review , 1999 .

[56]  G. Nigel Gilbert,et al.  Simulation for the social scientist , 1999 .

[57]  Giorgio Fagiolo,et al.  Spatial Interactions in Dynamic Decentralised Economies: a Review , 1998 .

[58]  John B. Davis,et al.  The Handbook of Economic Methodology , 1998 .

[59]  A. Kirman.  The economy as an interactive system , 1997 .

[60]  J. Bransen.  The Philosophy of Social Science. An Introduction , 1996 .

[61]  G. Dosi,et al.  The Process of Economic Development: Introducing Some Stylized Facts and Theories on Technologies, Firms and Institutions , 1994 .

[62]  David A. Lane.  Artificial worlds and economics, part II , 1993 .

[63]  M. Blaug.  The methodology of economics: Frontmatter , 1992 .

[64]  Uskali Mäki,et al.  On the method of isolation in economics, Idealization IV: Intelligibility in Science, edited by Craig Dilworth , 1992 .

[65]  G. Dosi.  Sources, Procedures, and Microeconomic Effects of Innovation , 1988 .

[66]  W. Arthur,et al.  The Economy as an Evolving Complex System II , 1988 .

[67]  Gavin J. Wright.  An evolutionary theory of economic change , 1982 .

[68]  Fourth Edition,et al.  Simulation Modeling and Analysis , 1982 .

[69]  I. Lakatos.  Falsification and the Methodology of Scientific Research Programmes , 1976 .

[70]  N. Kaldor.  Capital Accumulation and Economic Growth , 1961 .

[71]  Arthur F. Burns,et al.  Methodology of Positive Economics" In Essays In Positive Economics , 2022 .