Validation in agent-based models: an investigation on the CATS model

Abstract In this paper we deal with some validation experiments on the complex adaptive trivial system (CATS) model proposed in Gallegati et al. [Gallegati, M., Giulioni, G., Palestrini, A., Delli Gatti, D., 2003a. Financial fragility, patterns of firms’ entry and exit and aggregate dynamics. Journal of Economic Behavior and Organization 51, 79–97; Gallegati, M., Delli Gatti, D., Di Guilmi, C., Gaffeo, E., Giulioni, G., Palestrini, A., 2005. A new approach to business fluctuations: heterogeneous interacting agents, scaling laws and financial fragility. Journal of Economic Behavior and Organization 56, 489–512]. In particular starting from a sample of Italian firms included in the AIDA database, we perform several ex post validation experiments over the simulation period 1996–2001. In the experiments, the model parameters have been estimated using actual data and the initial set up consists of a sample of agents in 1996. The CATS model is then simulated over the period 1996–2001. Using alternative validation techniques, the simulations’ results are ex post validated respect to the actual data.

[1]  Y. Fujiwara.  Zipf Law in Firms Bankruptcy , 2003, cond-mat/0310062.

[2]  Jeremy J. Ramsden,et al.  Company size distribution in different countries , 2000 .

[3]  D. C. Hague,et al.  The theory of capital : proceedings of a conference held by the International Economic Association , 1961 .

[4]  Frank Hahn.  Money and inflation , 1982 .

[5]  H. Simon,et al.  ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS , 1955 .

[6]  W. Beaver.  Financial Ratios As Predictors Of Failure , 1966 .

[7]  Mauro Gallegati,et al.  Complex dynamics and empirical evidence , 2007, Inf. Sci..

[8]  H. Takayasu,et al.  Zipf's law in income distribution of companies , 1999 .

[9]  B. Greenwald,et al.  Financial Market Imperfections and Business Cycles , 1993 .

[10]  Mauro Gallegati,et al.  Business Cycle Fluctuations and Firms' Size Distribution Dynamics , 2004, Adv. Complex Syst..

[11]  Joshua M. Epstein.  Agent-based computational models and generative social science , 1999 .

[12]  Gianfranco Giulioni,et al.  Financial Fragility, Patterns of Firms' Entry and Exit and Aggregate Dynamics , 2000 .

[13]  D. Gatti,et al.  A new approach to business fluctuations: heterogeneous interacting agents, scaling laws and financial fragility , 2003, cond-mat/0312096.

[14]  L. Amaral,et al.  Scaling behaviour in the growth of companies , 1996, Nature.

[15]  R. Clower,et al.  The Theory of Capital , 1961 .

[16]  K. G. Troitzsch.  VALIDATING SIMULATION MODELS , 2004 .

[17]  C. Klüppelberg,et al.  Modelling Extremal Events , 1997 .

[18]  Robert L. Axtell,et al.  Aligning simulation models: A case study and results , 1996, Comput. Math. Organ. Theory.

[19]  V. Plerou,et al.  A theory of power-law distributions in financial market fluctuations , 2003, Nature.

[20]  Mauro Gallegati,et al.  Financial fragility, patterns of firms’ entry and exit and aggregate dynamics , 2003 .

[21]  Peter Winker,et al.  A global optimization heuristic for estimating agent based models , 2003, Comput. Stat. Data Anal..

[22]  K. Judd.  Computationally Intensive Analyses in Economics , 2006 .

[23]  H. A. Simon,et al.  Skew Distributions and the Size of Business Firms , 1977 .

[24]  Paul Windrum,et al.  Empirical Validation of Agent-Based Models: Alternatives and Prospects , 2007, J. Artif. Soc. Soc. Simul..

[25]  B. Mandelbrot.  THE PARETO-LEVY LAW AND THE DISTRIBUTION OF INCOME* , 1960 .

[26]  Mauro Gallegati,et al.  Complex Dynamics and Financial Fragility in an Agent-Based Model , 2003, Adv. Complex Syst..

[27]  Bronwyn H Hall,et al.  The Relationship between Firm Size and Firm Growth in the U.S. Manufacturing Sector , 1986 .

[28]  R. Axtell.  Zipf Distribution of U.S. Firm Sizes , 2001, Science.

[29]  R. Hegselmann,et al.  Simulating Social Phenomena , 1997 .

[30]  N. Kaldor.  Capital Accumulation and Economic Growth , 1961 .

[31]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[32]  A. Secchi,et al.  Explaining the distribution of firm growth rates , 2006 .

[33]  Christian Gourieroux,et al.  Simulation-based econometric methods , 1996 .

[34]  Mauro Gallegati,et al.  On the size distribution of firms: additional evidence from the G7 countries , 2003 .

[35]  Mauro Gallegati,et al.  Power Law Scaling in the World Income Distribution , 2003 .

[36]  Jack P. C. Kleijnen,et al.  Experimental Design for Sensitivity Analysis, Optimization and Validation of Simulation Models , 1997 .

[37]  R. Quandt,et al.  Old and new methods of estimation and the pareto distribution , 1966 .

[38]  N. Anders Klevmarken,et al.  Statistical inference in micro-simulation models: incorporating external information , 2002, Math. Comput. Simul..

[39]  Christian M. Reidys,et al.  Reduction of Discrete Dynamical Systems over Graphs , 2004, Adv. Complex Syst..

[40]  Robert Axelrod,et al.  Advancing the art of simulation in the social sciences , 1997, Complex..

[41]  Robert G. Sargent,et al.  Validating simulation models , 1983, WSC '83.

[42]  Francis Galton F.R.S..  IV. Statistics by intercomparison, with remarks on the law of frequency of error , 1875 .

[43]  Mauro Gallegati,et al.  Validating and Calibrating Agent-Based Models: A Case Study , 2007 .

[44]  Eric R. Ziegel,et al.  Statistical Size Distributions in Economics and Actuarial Sciences , 2004, Technometrics.

[45]  Robert L. Axtell,et al.  WHY AGENTS? ON THE VARIED MOTIVATIONS FOR AGENT COMPUTING IN THE SOCIAL SCIENCES , 2000 .

[46]  J. Banks,et al.  Handbook of Simulation , 1998 .