Norm creation, spreading and emergence: A survey of simulation models of norms in multi-agent systems

Norms in human societies are expectations of behaviours of the individuals. In human societies, there are several types of norms such as moral norms, social norms and legal norms (laws). In multi-agent systems, software agents are modelled as possessing characteristics and behaviour borrowed from human societies. In order to design and develop robust artificial agent societies, it is important to understand different approaches proposed by researchers by which norms can spread and emerge within agent societies. This paper makes three contributions to the study of norms. Firstly, based on the simulation research on norms, we propose a life-cycle model for norms. Secondly, we discuss different mechanisms used by researchers to study norm creation, identification, spreading, enforcement and emergence. We also discuss the strengths and weaknesses of each of these mechanisms. Thirdly, in the context of identifying the desired characteristics of the simulation models of norms we discuss the research issues that need to be addressed.

[1]  J. Habermas,et al.  The Theory of Communicative Action, Vol. 1, Reason and the Rationalization of Society , 1986 .

[2]  Pablo Noriega,et al.  Environment Engineering for Multiagent Systems , 2004 .

[3]  Joshua M. Epstein,et al.  Learning to Be Thoughtless: Social Norms and Individual Computation , 2001 .

[4]  Munindar P. Singh,et al.  Searching social networks , 2003, AAMAS '03.

[5]  Daniel Moldt,et al.  My agents love to conform: Norms and emotion in the micro-macro link , 2006, Comput. Math. Organ. Theory.

[6]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[7]  J. Elster,et al.  The Cement Of Society , 1989 .

[8]  Maryam Purvis,et al.  Norm Identification in Multi-agent Societies , 2010 .

[9]  Magnus Boman,et al.  Norms in artificial decision making , 1999, Artificial Intelligence and Law.

[10]  Sandip Sen,et al.  Topology and Memory Effect on Convention Emergence , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[11]  David Hales,et al.  Group Reputation Supports Beneficent Norms , 2002, J. Artif. Soc. Soc. Simul..

[12]  Herbert Gintis,et al.  The hitchhiker's guide to altruism: gene-culture coevolution, and the internalization of norms. , 2003, Journal of theoretical biology.

[13]  R. Tuomela.  The Importance of Us: A Philosophical Study of Basic Social Notions , 1995 .

[14]  Roel Wieringa,et al.  Deontic logic in computer science: normative system specification , 1994 .

[15]  Bastin Tony Roy Savarimuthu,et al.  Role Model Based Mechanism for Norm Emergence in Artificial Agent Societies , 2007, COIN.

[16]  Mariusz Zytniewski,et al.  Normative Multi-Agent Enriched Data Mining to Support E-Citizens , 2009, Data Mining and Multi-agent Integration.

[17]  Mark Wallace,et al.  Second Life: The Official Guide , 2006 .

[18]  Michael Luck,et al.  Norm Emergence in Tag-Based Cooperation , 2010 .

[19]  Moshe Tennenholtz,et al.  On the Emergence of Social Conventions: Modeling, Analysis, and Simulations , 1997, Artif. Intell..

[20]  M. Finnemore,et al.  International Norm Dynamics and Political Change , 1998, International Organization.

[21]  Reuven Cohen,et al.  Efficient immunization strategies for computer networks and populations. , 2002, Physical review letters.

[22]  Michael Wooldridge,et al.  Intelligent agents: theory and practice The Knowledge Engineering Review , 1995 .

[23]  Wolfgang Reisig,et al.  Application and Theory of Petri Nets , 1982, Informatik-Fachberichte.

[24]  Marek J. Sergot,et al.  A Formal Characterisation of Institutionalised Power , 1996, Log. J. IGPL.

[25]  Juan A. Rodríguez-Aguilar,et al.  Infection-Based Norm Emergence in Multi-Agent Complex Networks , 2008, ECAI.

[26]  Francesca Toni,et al.  Normative KGP agents , 2006, Comput. Math. Organ. Theory.

[27]  Mario Paolucci,et al.  Normative reputation and the costs of compliance , 1998, J. Artif. Soc. Soc. Simul..

[28]  R. Axelrod.  An Evolutionary Approach to Norms , 1986, American Political Science Review.

[29]  Frank Dignum,et al.  Deliberative Normative Agents: Principles and Architecture , 1999, ATAL.

[30]  Martin A. Nowak,et al.  Indirect reciprocity provides a narrow margin of efficiency for costly punishment , 2008, Nature.

[31]  Emile Durkheim,et al.  Émile Durkheim on the division of labor in society : being a translation of his De la division du travail social, with an estimate of his work , 1934 .

[32]  Nano Trias,et al.  Fill the gap , 2010 .

[33]  Carles Sierra,et al.  Distributed Norm Enforcement: Ostracism in Open Multi-Agent Systems , 2008, Computable Models of the Law, Languages, Dialogues, Games, Ontologies.

[34]  Fabiola López y López,et al.  Social power and norms : impact on agent behaviour , 2003 .

[35]  Mary A. Burke,et al.  The emergence of local norms in networks , 2006, Complex..

[36]  Michael Wooldridge,et al.  Understanding the Emergence of Conventions in Multi-Agent Systems , 1995, ICMAS.

[37]  Moshe Tennenholtz,et al.  Emergent Conventions in Multi-Agent Systems: Initial Experimental Results and Observations (Preliminary Report) , 1992, KR.

[38]  Daniel Moldt,et al.  Emotion-based norm enforcement and maintenance in multi-agent systems: foundations and petri net modeling , 2006, AAMAS '06.

[39]  Wamberto Weber Vasconcelos,et al.  Managing Conflict Resolution in Norm-Regulated Environments , 2008, ESAW.

[40]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[41]  Bastin Tony Roy Savarimuthu,et al.  Internal Agent Architecture for Norm Identification , 2009, COIN@AAMAS&IJCAI&MALLOW.

[42]  C. Castelfranchi.  The Micro-Macro Constitution of Power , 2003 .

[43]  Giulia Andrighetto,et al.  How Agents Find out Norms: A Simulation Based Model of Norm Innovation , 2008, NORMAS.

[44]  Josep M. Pujol,et al.  Structure in artificial societies , 2006 .

[45]  F. C. Santos,et al.  The evolution of norms. , 2006, Journal of theoretical biology.

[46]  Bastin Tony Roy Savarimuthu,et al.  Norm emergence in agent societies formed by dynamically changing networks , 2009, Web Intell. Agent Syst..

[47]  Wei Li,et al.  Institutions, Institutional Change, and Economic Performance , 2009, SSRN Electronic Journal.

[48]  Bastin Tony Roy Savarimuthu,et al.  Obligation Norm Identification in Agent Societies , 2010, J. Artif. Soc. Soc. Simul..

[49]  Giovanni Sartor,et al.  Why agents comply with norms, and why they should* , 2001 .

[50]  C. Bicchieri.  The grammar of society: the nature and dynamics of social norms , 2005 .

[51]  Daniel Polani,et al.  Modelling the Emergence of Possession Norms using Memes , 2001, J. Artif. Soc. Soc. Simul..

[52]  James E. Kittock.  Emergent Conventions and the Structure of Multi--Agent Systems , 1995 .

[53]  J. Elster.  Social Norms and Economic Theory , 1989, Handbook of Monetary Policy.

[54]  Harko Verhagen,et al.  Simulation of the Learning of Norms , 2001 .

[55]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[56]  George A. Akerlof.  An economic theorist's book of tales: The economics of caste and of the rat race and other woeful tales , 1976 .

[57]  R. Conte,et al.  Cognitive and social action , 1995 .

[58]  Frank Dignum,et al.  Autonomous agents with norms , 1999, Artificial Intelligence and Law.

[59]  Jordi Sabater-Mir,et al.  Categorizing Social Norms in a Simulated Resource Gathering Society , 2009, COIN@AAMAS&AAAI.

[60]  Amedeo Cesta,et al.  Dependence relations among autonomous agents (abstract) , 1992, SIGO.

[61]  J. Coleman.  Foundations of Social Theory , 1990 .

[62]  V. Latora,et al.  VECTOR OPINION DYNAMICS IN A BOUNDED CONFIDENCE CONSENSUS MODEL , 2005, physics/0504017.

[63]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[64]  Henricus Verhagen,et al.  Norm autonomous agents , 2000 .

[65]  Kislaya Prasad,et al.  The emergence of local norms in networks: Research Articles , 2006 .

[66]  Robert Boyd,et al.  Group beneficial norms can spread rapidly in a structured population. , 2002, Journal of theoretical biology.

[67]  Michael Luck,et al.  Constraining autonomy through norms , 2002, AAMAS '02.

[68]  Karl-Dieter Opp,et al.  How do norms emerge? An outline of a theory , 2001 .

[69]  Yicheng Zhang,et al.  On the minority game: Analytical and numerical studies , 1998, cond-mat/9805084.

[70]  R. M. Hare,et al.  Norm and Action: A Logical Enquiry. , 1965 .

[71]  Martin Neumann,et al.  Homo Socionicus: a Case Study of Simulation Models of Norms , 2008, J. Artif. Soc. Soc. Simul..

[72]  J. Gibbs.  Norms: The Problem of Definition and Classification , 1965, American Journal of Sociology.

[73]  Tilman Slembeck.  Reputations and Fairness in Bargaining - Experimental Evidence from a Repeated Ultimatum Game With Fixed Opponents , 1999 .

[74]  Kenichi Aoki,et al.  Cultural coevolution of norm adoption and enforcement when punishers are rewarded or non-punishers are punished. , 2006, Theoretical population biology.

[75]  Guido Boella,et al.  Introduction to the special issue on normative multiagent systems , 2008, Autonomous Agents and Multi-Agent Systems.

[76]  Wamberto Weber Vasconcelos,et al.  Normative conflict resolution in multi-agent systems , 2009, Autonomous Agents and Multi-Agent Systems.

[77]  N. Gilbert,et al.  Artificial Societies: The Computer Simulation of Social Life , 1995 .

[78]  J. Sadock.  Speech acts , 2007 .

[79]  Hyacinth S. Nwana,et al.  Software agents: an overview , 1996, The Knowledge Engineering Review.

[80]  Ernst Fehr,et al.  Third Party Punishment and Social Norms , 2004 .

[81]  P. Richerson,et al.  Culture and the Evolutionary Process , 1988 .

[82]  Mario Paolucci,et al.  Emergence In the Loop: Simulating the two way dynamics of norm innovation , 2007, Normative Multi-agent Systems.

[83]  Giulia Andrighetto,et al.  The Complex Loop of Norm Emergence: A Simulation Model , 2008, WCSS.

[84]  G. Becker,et al.  The Economic Approach to Human Behavior , 1978 .

[85]  David Hales,et al.  Cooperation without Memory or Space: Tags, Groups and the Prisoner's Dilemma , 2000, MABS.

[86]  Wamberto Weber Vasconcelos,et al.  Norm-oriented programming of electronic institutions , 2006, AAMAS '06.

[87]  Giulia Andrighetto,et al.  Normal = Normative? The role of intelligent agents in norm innovation , 2009, Normative Multi-Agent Systems.

[88]  Paolo Petta,et al.  Introducing Emotions into the Computational Study of Social Norms: A First Evaluation , 2001, J. Artif. Soc. Soc. Simul..

[89]  Mehdi Dastani,et al.  The BOID architecture: conflicts between beliefs, obligations, intentions and desires , 2001, AGENTS '01.

[90]  Magnus Boman.  Norms as Constraints on Real-Time Autonomous Agent Action , 1997, MAAMAW.

[91]  Edna Ullmann-Margalit,et al.  The Emergence Of Norms , 1977 .

[92]  Pablo Noriega,et al.  Operationalisation of norms for usage in electronic institutions , 2006, AAMAS '06.

[93]  Chrysanthos Dellarocas,et al.  Social Order in Multiagent Systems , 2001, Multiagent Systems, Artificial Societies, and Simulated Organizations.

[94]  Michael Luck,et al.  Norm-based behaviour modification in BDI agents , 2009, AAMAS.

[95]  S. Rosenschein,et al.  On social laws for artificial agent societies: off-line design , 1996 .

[96]  Robert C. Ellickson.  Law and Economics Discovers Social Norms , 1998, The Journal of Legal Studies.

[97]  Juan A. Rodríguez-Aguilar,et al.  Handling Uncertainty in the Emergence of Social Conventions , 2009, 2009 Third IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[98]  Fabiola López y López,et al.  An architecture for autonomous normative agents , 2004, Proceedings of the Fifth Mexican International Conference in Computer Science, 2004. ENC 2004..

[99]  Melanie Mitchell,et al.  Complex systems: Network thinking , 2006, Artif. Intell..

[100]  Pedro G. Lind,et al.  Networks based on collisions among mobile agents , 2006 .

[101]  Martin Neumann,et al.  A Classification of Normative Architectures , 2008, WCSS.

[102]  Robert C. Ellickson,et al.  Order Without Law: How Neighbors Settle Disputes , 1991 .

[103]  Andrew M. Colman,et al.  The complexity of cooperation: Agent-based models of competition and collaboration , 1998, Complex..

[104]  Roel Wieringa,et al.  Applications of deontic logic in computer science: a concise overview , 1994 .

[105]  Anand S. Rao,et al.  Modeling Rational Agents within a BDI-Architecture , 1997, KR.

[106]  Sandip Sen,et al.  Effects of Social Network Topology and Options on Norm Emergence , 2009, COIN@AAMAS&IJCAI&MALLOW.

[107]  Guido Boella,et al.  Normative Systems in Computer Science - Ten Guidelines for Normative Multiagent Systems , 2009, Normative Multi-Agent Systems.

[108]  George A. Akerlof.  A theory of social custom, of which unemployment may be one consequence , 1980 .

[109]  TennenholtzMoshe,et al.  On the emergence of social conventions , 1997 .

[110]  Ramon Sangüesa,et al.  Extracting reputation in multi agent systems by means of social network topology , 2002, AAMAS '02.

[111]  Sandip Sen,et al.  Emergence of Norms through Social Learning , 2007, IJCAI.

[112]  Frank I. Michelman,et al.  Between Facts and Norms , 1992 .

[113]  Mayuko Nakamaru,et al.  Spread of two linked social norms on complex interaction networks. , 2004, Journal of theoretical biology.

[114]  Guido Boella,et al.  An architecture of a normative system: counts-as conditionals, obligations and permissions , 2006, AAMAS '06.

[115]  Rino Falcone,et al.  Introduction: Agents and Norms: How to fill the gap? , 1999, Artificial Intelligence and Law.

[116]  Zoltán Toroczkai,et al.  Competition-driven network dynamics: emergence of a scale-free leadership structure and collective efficiency. , 2004, Physical review letters.

[117]  Cristiano Castelfranchi,et al.  From conventions to prescriptions. Towards an integrated view of norms , 1999, Artificial Intelligence and Law.

[118]  Marek Sergot,et al.  On the characterization of law and computer systems: the normative systems perspective , 1994 .