A Framework for the Calibration of Social Simulation Models

Simulation with agent-based models is increasingly used in the study of complex socio-technical systems and in social simulation in general. This paradigm offers a number of attractive features, namely the possibility of modeling emergent phenomena within large populations. As a consequence, often the quantity in need of calibration may be a distribution over the population whose relation with the parameters of the model is analytically intractable. Nevertheless, we can simulate. In this paper we present a simulation-based framework for the calibration of agent-based models with distributional output based on indirect inference. We illustrate our method step by step on a model of norm emergence in an online community of peer production, using data from three large Wikipedia communities. Model fit and diagnostics are discussed.

[1]  Peter Winker,et al.  A global optimization heuristic for estimating agent based models , 2003, Comput. Stat. Data Anal..

[2]  Coye Cheshire,et al.  The Social Psychological Effects of Feedback on the Production of Internet Information Pools , 2008, J. Comput. Mediat. Commun..

[3]  Aaron Halfaker,et al.  Don't bite the newbies: how reverts affect the quantity and quality of Wikipedia work , 2011, Int. Sym. Wikis.

[4]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[5]  Eric Bonabeau,et al.  Agent-based modeling: Methods and techniques for simulating human systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[6]  K. Arrow,et al.  The New Palgrave Dictionary of Economics , 2020 .

[7]  Songqing Chen,et al.  Analyzing patterns of user content generation in online social networks , 2009, KDD.

[8]  Thomas C. Schelling,et al.  Dynamic models of segregation , 1971 .

[9]  Francesca Musiani.  Dominique Cardon, La démocratie internet. Promesses et limites | Joseph M. Reagle, Good Faith Collaboration. The Culture of Wikipedia , 2011 .

[10]  Raúl Toral,et al.  Global Culture: A Noise Induced Transition in Finite Systems , 2003 .

[11]  S. Ellner,et al.  Dynamic Models in Biology , 2006 .

[12]  Dennis M. Wilkinson,et al.  Strong regularities in online peer production , 2008, EC '08.

[13]  Domenico Parisi,et al.  Cultural Change in Spatial Environments , 2003 .

[14]  B. Weitz.  Hosted By , 2003 .

[15]  M. Macy,et al.  Local Convergence and Global Diversity , 2008, 0808.2710.

[16]  E. Ostrom.  Collective action and the evolution of social norms , 2000, Journal of Economic Perspectives.

[17]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[18]  Mauro Gallegati,et al.  Validating and Calibrating Agent-Based Models: A Case Study , 2007 .

[19]  P. Resnick,et al.  Encouraging Commitment in Online Communities , 2011 .

[20]  Douglas E. Jones,et al.  Parameter estimation and sensitivity analysis in an agent-based model of Leishmania major infection. , 2010, Journal of theoretical biology.

[21]  William A. V. Clark,et al.  Understanding the social context of the Schelling segregation model , 2008, Proceedings of the National Academy of Sciences.

[22]  Anthony A. Smith,et al.  Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions , 1993 .

[23]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[24]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[25]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[26]  Andrea Ciffolilli,et al.  Phantom authority, self-selective recruitment and retention of members in virtual communities: The case of Wikipedia , 2003, First Monday.

[27]  Dirk Helbing,et al.  Individualization as Driving Force of Clustering Phenomena in Humans , 2010, PLoS Comput. Biol..

[28]  D. McFadden.  A Method of Simulated Moments for Estimation of Discrete Response Models Without Numerical Integration , 1989 .

[29]  A. Hirschman,et al.  Exit, Voice, and Loyalty: Responses to Decline in Firms, Organizations, and States , 1971 .

[30]  Pawel Sobkowicz,et al.  Modelling Opinion Formation with Physics Tools: Call for Closer Link with Reality , 2009, J. Artif. Soc. Soc. Simul..

[31]  D. C. Feldman,et al.  The Development and Enforcement of Group Norms , 1984 .

[32]  Lada A. Adamic,et al.  Computational Social Science , 2009, Science.

[33]  C. Bicchieri.  The grammar of society: the nature and dynamics of social norms , 2005 .

[34]  Joshua M. Epstein,et al.  Growing Artificial Societies: Social Science from the Bottom Up , 1996 .

[35]  Alberto Vancheri,et al.  Empirical Analysis of User Participation in Online Communities: the Case of Wikipedia , 2010, ICWSM.

[36]  David Higdon,et al.  Cosmic Calibration , 2006 .

[37]  Giovanni Luca Ciampaglia.  A Bounded Confidence Approach to Understanding User Participation in Peer Production Systems , 2011, SocInfo.

[38]  M. F. Morell.  Good Faith Collaboration: The Culture of Wikipedia , 2013 .

[39]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[40]  H. Tajfel.  Social Psychology of Intergroup Relations , 1982 .

[41]  Guillaume Deffuant,et al.  How can extremism prevail? A study based on the relative agreement interaction model , 2002, J. Artif. Soc. Soc. Simul..

[42]  Josh Lerner,et al.  The Simple Economics of Open Source , 2000 .

[43]  Filippo Radicchi.  Human Activity in the Web , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  T. J. Mitchell,et al.  Exploratory designs for computational experiments , 1995 .

[45]  W. Hamilton.  The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[46]  Rainer Hegselmann,et al.  Opinion dynamics and bounded confidence: models, analysis and simulation , 2002, J. Artif. Soc. Soc. Simul..

[47]  Albert-László Barabási,et al.  The origin of bursts and heavy tails in human dynamics , 2005, Nature.

[48]  S. Fortunato,et al.  Scaling and universality in proportional elections. , 2006, Physical review letters.

[49]  S. Fortunato.  UNIVERSALITY OF THE THRESHOLD FOR COMPLETE CONSENSUS FOR THE OPINION DYNAMICS OF DEFFUANT et al , 2004, cond-mat/0406054.

[50]  S. Rafaeli,et al.  Psychological Aspects of Cyberspace: Online Motivational Factors: Incentives for Participation and Contribution in Wikipedia , 2008 .

[51]  Raúl Toral,et al.  Global culture: a noise-induced transition in finite systems. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[52]  James O. Berger,et al.  A Framework for Validation of Computer Models , 2007, Technometrics.

[53]  Stefano Tarantola,et al.  Winding Stairs: A sampling tool to compute sensitivity indices , 2000, Stat. Comput..

[54]  J. McKenzie Alexander,et al.  The Structural Evolution of Morality , 2008 .

[55]  Stephen P. Ellner,et al.  POPULATION CYCLES IN THE PINE LOOPER MOTH: DYNAMICAL TESTS OF MECHANISTIC HYPOTHESES , 2005 .

[56]  Guillaume Deffuant,et al.  Mixing beliefs among interacting agents , 2000, Adv. Complex Syst..

[57]  R. Axelrod.  An Evolutionary Approach to Norms , 1986, American Political Science Review.

[58]  Yochai Benkler,et al.  The wealth of networks: how social production transforms markets and freedom , 2006 .

[59]  J. McKenzie Alexander,et al.  The Structural Evolution of Morality: Index , 2008 .

[60]  Adilson E. Motter,et al.  A Poissonian explanation for heavy tails in e-mail communication , 2008, Proceedings of the National Academy of Sciences.

[61]  Colin Camerer,et al.  Measuring Social Norms and Preferences Using Experimental Games: A Guide for Social Scientists , 2002 .

[62]  Dave Higdon,et al.  Combining Field Data and Computer Simulations for Calibration and Prediction , 2005, SIAM J. Sci. Comput..

[63]  S. Wood.  Statistical inference for noisy nonlinear ecological dynamic systems , 2010, Nature.

[64]  Karolin Kappler,et al.  Jointly They Edit: Examining the Impact of Community Identification on Political Interaction in Wikipedia , 2012, PloS one.

[65]  Paul Windrum,et al.  Empirical Validation of Agent-Based Models: Alternatives and Prospects , 2007, J. Artif. Soc. Soc. Simul..

[66]  S. Moscovici,et al.  Influence of a consistent minority on the responses of a majority in a color perception task. , 1969, Sociometry.

[67]  S. Fortunato,et al.  Statistical physics of social dynamics , 2007, 0710.3256.

[68]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[69]  Mark Levene,et al.  How long do Wikipedia editors keep active? , 2012, WikiSym '12.

[70]  Karl-Dieter Opp,et al.  How do norms emerge? An outline of a theory , 2001 .

[71]  F. Reid.  Rediscovering the Social Group: A Self-Categorization Theory , 1987 .

[72]  Charles R. Graham.  A Model of Norm Development for Computer-Mediated Teamwork , 2003 .

[73]  Jürgen Kurths,et al.  Evidence for a bimodal distribution in human communication , 2010, Proceedings of the National Academy of Sciences.