Building and assurance of agent-based models: An example and challenge to the field

Abstract The assurance, that is, the verification and validation, of agent-based models is difficult, because of the heterogeneity of agents, and the possibility of the emergence of new patterns of macro behavior as a result of the interactions of these agents at the micro-level. This paper uses an agent-based model of the complex interactions among consumers, retailers, and manufacturers to explore issues of model assurance. These explorations involve two challenges for the agent-based model's field. The first challenge is to address the critical issue of software verification. The second challenge is to overcome the many methodological obstacles that exist in empirically validating these models. This paper will outline some of them. The authors propose a method based on the Genetic Algorithm to address both these challenges, but the experiments required, and a lack of good data on many kinds of agents, generally call for a minimalist approach to building and assuring agent-based models.

[1]  R. Leombruni,et al.  Why are economists sceptical about agent-based simulations? , 2005 .

[2]  Robert L. Glass,et al.  Sorting out software complexity , 2002, CACM.

[3]  Herbert A. Simon,et al.  Cognitive modeling in perspective , 1999, Kognitionswissenschaft.

[4]  Marco Laumanns,et al.  PISA: A Platform and Programming Language Independent Interface for Search Algorithms , 2003, EMO.

[5]  Robert L. Glass,et al.  Inspections - Some Surprising Findings. , 1999 .

[6]  Ganesh Iyer,et al.  Coordinating Channels Under Price and Nonprice Competition , 1998 .

[7]  Robert F. Lusch,et al.  A preliminary test of Hunt's General Theory of Competition: using artificial adaptive agents to study complex and ill-defined environments , 2005 .

[8]  J. Richard Harrison,et al.  Simulation in the Social Sciences , 2008, Simul. Model. Pract. Theory.

[9]  Dorien J. DeTombe,et al.  VALIDATION OF SIMULATION MODELS , 1999 .

[10]  Dominique M. Hanssens,et al.  Market Response Models: Econometric and Time Series Analysis , 1989 .

[11]  Randall P. Sadowski,et al.  Simulation with Arena , 1998 .

[12]  Yaneer Bar-Yam,et al.  Unifying Principles in Complex Systems , 2002 .

[13]  Avelino J. Gonzalez,et al.  Validation and verification of intelligent systems - what are they and how are they different? , 2000, J. Exp. Theor. Artif. Intell..

[14]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[15]  Robert L. Glass,et al.  The proof of correctness wars , 2002, CACM.

[16]  Osman Balci,et al.  Validating Expert System Performance , 1987, IEEE Expert.

[17]  Brent Hailpern,et al.  Software debugging, testing, and verification , 2002, IBM Syst. J..

[18]  Mihail C. Roco,et al.  Converging Technologies for Improving Human Performance: Nanotechnology, Biotechnology, Information Technology and Cognitive Science , 2003 .

[19]  Gerard J. Holzmann,et al.  Software verification at Bell Labs: One line of development , 2000, Bell Labs Technical Journal.

[20]  B. Edmonds,et al.  Sociology and Simulation: Statistical and Qualitative Cross‐Validation1 , 2005, American Journal of Sociology.

[21]  B. LeBaron Agent-based Computational Finance , 2006 .

[22]  Wayne W. Wakeland,et al.  Heuristic optimization as a V&V tool for software process simulation models , 2005, Softw. Process. Improv. Pract..

[23]  Robert L. Glass Practical programmer: inspections—some surprising findings , 1999, CACM.

[24]  Lori A. Clarke,et al.  FLAVERS: A finite state verification technique for software systems , 2002, IBM Syst. J..

[25]  Dominique M. Hanssens,et al.  Modeling Asymmetric Competition , 1988 .

[26]  Michael E. Fagan Design and Code Inspections to Reduce Errors in Program Development (Reprint) , 2002, Software Pioneers.

[27]  Peter J. Fleming,et al.  Evolution of mathematical models of chaotic systems based on multiobjective genetic programming , 2005, Knowledge and Information Systems.

[28]  Robert L. Glass,et al.  Evolving a new theory of project success , 1999, Commun. ACM.

[29]  Lee G. Cooper,et al.  Market-Share Analysis , 1988 .

[30]  D. Meadows Dynamics of Growth in a Finite World , 1974 .

[31]  R. Goldberg Turning Points in Software Development , 1999, IBM Syst. J..

[32]  Barry W. Boehm,et al.  Software Engineering Economics , 1993, IEEE Transactions on Software Engineering.

[33]  John H. Miller,et al.  Active Nonlinear Tests (Ants) of Complex Simulation Models , 1998 .

[34]  B. McKelvey,et al.  Why Gaussian statistics are mostly wrong for strategic organization , 2005 .

[35]  Robert Axelrod Advancing the art of simulation in the social sciences , 1997 .