Mechanisms for norm emergence and norm identification in multi-agent societies

Norms are standards of behaviour expected of the members of a society. Norms in human societies help in sustaining social order and facilitating cooperation and coordination among agents. Researchers in multi-agent systems investigate how the concept of norms can serve a similar purpose in artificial societies with autonomous agents. This thesis contributes to two aspects of the study of norms in multi-agent systems through the investigation of mechanisms for norm emergence and norm identification. With the advent of digital societies such as Second Life, software agents that reside in these societies are expected to abide by the norms of those societies. Most works on norms in multi-agent systems assume that agents know the norms a priori. Though this is important, norms that are not explicitly specified by the designers of the society may emerge in open agent societies. Thus there is a need for the study of mechanisms for artificial agent societies which can facilitate norm emergence based on interactions between agents. To that end the first part of this thesis describes a role model mechanism for norm emergence. The thesis also describes how norms can emerge in connection with different types of network topologies. A particle-collision model for constructing dynamic network topologies has been applied to model how two societies can be brought together. Using such a model, norm emergence on dynamic network topologies have been studied. With the uptake of virtual environments which are open and dynamic, agents residing in these societies should be endowed with mechanisms that facilitate norm identification. To that end, the second part of the thesis investigates how a software agent comes to know the norms of the society that it is a part of. To achieve

[1]  Hiroaki Kitano,et al.  RoboCup Rescue: search and rescue in large-scale disasters as a domain for autonomous agents research , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[2]  Henricus Verhagen,et al.  Norm autonomous agents , 2000 .

[3]  J. Burgoon,et al.  Interactivity in human–computer interaction: a study of credibility, understanding, and influence , 2000 .

[4]  Zoltán Toroczkai,et al.  Competition-driven network dynamics: emergence of a scale-free leadership structure and collective efficiency. , 2004, Physical review letters.

[5]  Hans J Herrmann,et al.  Spreading gossip in social networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Daniel Moldt,et al.  My agents love to conform: Norms and emotion in the micro-macro link , 2006, Comput. Math. Organ. Theory.

[7]  Robert Boyd,et al.  Group beneficial norms can spread rapidly in a structured population. , 2002, Journal of theoretical biology.

[8]  Roel Wieringa,et al.  Applications of deontic logic in computer science: a concise overview , 1994 .

[9]  Mario Paolucci,et al.  What Is the Use of Gossip? A Sensitivity Analysis of the Spreading of Respectful Reputation , 1997, Tools and Techniques for Social Science Simulation.

[10]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[11]  Jie Wu,et al.  Small Worlds: The Dynamics of Networks between Order and Randomness , 2003 .

[12]  S. N. Dorogovtsev,et al.  Evolution of networks , 2001, cond-mat/0106144.

[13]  R. Tuomela The Importance of Us: A Philosophical Study of Basic Social Notions , 1995 .

[14]  Robert C. Ellickson Order without law : how neighbors settle disputes , 2009 .

[15]  Béla Bollobás,et al.  The Diameter of a Scale-Free Random Graph , 2004, Comb..

[16]  Guido Boella,et al.  The ontological properties of social roles in multi-agent systems: definitional dependence, powers and roles playing roles , 2007, Artificial Intelligence and Law.

[17]  Santo Fortunato Damage spreading and opinion dynamics on scale-free networks , 2005 .

[18]  Mario Paolucci,et al.  Normative reputation and the costs of compliance , 1998, J. Artif. Soc. Soc. Simul..

[19]  Moshe Tennenholtz,et al.  On Social Laws for Artificial Agent Societies: Off-Line Design , 1995, Artif. Intell..

[20]  Munindar P. Singh,et al.  Emergence of agent-based referral networks , 2002, AAMAS '02.

[21]  Martin J. Kollingbaum,et al.  NoA - A Normative Agent Architecture , 2003, IJCAI.

[22]  Robert C. Ellickson Law and Economics Discovers Social Norms , 1998, The Journal of Legal Studies.

[23]  J. Coleman Foundations of Social Theory , 1990 .

[24]  Wamberto Weber Vasconcelos,et al.  Managing Conflict Resolution in Norm-Regulated Environments , 2008, ESAW.

[25]  Padhraic Smyth,et al.  Analysis and Visualization of Network Data using JUNG , 2005 .

[26]  Michael Wooldridge,et al.  Introduction to multiagent systems , 2001 .

[27]  S. Rosenschein,et al.  On social laws for artificial agent societies: off-line design , 1996 .

[28]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[29]  Fausto Giunchiglia,et al.  Tropos: An Agent-Oriented Software Development Methodology , 2004, Autonomous Agents and Multi-Agent Systems.

[30]  Michael Luck,et al.  Norm Emergence in Tag-Based Cooperation , 2010 .

[31]  Magnus Boman Norms as Constraints on Real-Time Autonomous Agent Action , 1997, MAAMAW.

[32]  Michael Winikoff,et al.  Assurance of Agent Systems: What Role should Formal Verification play? , 2010 .

[33]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[34]  Tilman Börgers,et al.  Rational Ritual: Culture, Coordination, and Common Knowledge , 2004 .

[35]  Nicholas R. Jennings,et al.  Commitments and conventions: The foundation of coordination in multi-agent systems , 1993, The Knowledge Engineering Review.

[36]  Eric Bonabeau,et al.  Agent-based modeling: Methods and techniques for simulating human systems , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Amedeo Cesta,et al.  Dependence relations among autonomous agents (abstract) , 1992, SIGO.

[38]  R. McAfee,et al.  Auctions and Bidding , 1986 .

[39]  Marek J. Sergot,et al.  A Formal Characterisation of Institutionalised Power , 1996, Log. J. IGPL.

[40]  Daniel Polani,et al.  Modelling the Emergence of Possession Norms using Memes , 2001, J. Artif. Soc. Soc. Simul..

[41]  Daniel Moldt,et al.  Emotion-based norm enforcement and maintenance in multi-agent systems: foundations and petri net modeling , 2006, AAMAS '06.

[42]  D. North Institutions, Institutional Change and Economic Performance: Economic performance , 1990 .

[43]  Leon van der Torre,et al.  Contextual Deontic Logic: Normative Agents, Violations and Independence , 2004, Annals of Mathematics and Artificial Intelligence.

[44]  Nicholas R. Jennings,et al.  On cooperation in multi-agent systems , 1997, The Knowledge Engineering Review.

[45]  R. Axelrod An Evolutionary Approach to Norms , 1986, American Political Science Review.

[46]  Roel Wieringa,et al.  Deontic logic in computer science: normative system specification , 1994 .

[47]  M. Nowak,et al.  Fairness versus reason in the ultimatum game. , 2000, Science.

[48]  Michael Winikoff,et al.  Verifying social expectations by model checking truncated paths , 2011, J. Log. Comput..

[49]  Kenichi Aoki,et al.  Cultural coevolution of norm adoption and enforcement when punishers are rewarded or non-punishers are punished. , 2006, Theoretical population biology.

[50]  Marc Esteva,et al.  AMELI: an agent-based middleware for electronic institutions , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[51]  Peter F. Patel-Schneider,et al.  The DARPA Knowledge Sharing Effort: A Progress Report , 1997, KR.

[52]  Javier Vázquez-Salceda,et al.  The Role of Norms and Electronic Institutions in Multi-Agent Systems , 2003, Whitestein Series in Software Agent Technologies.

[53]  Yu Zhang,et al.  Emergence of Social Norms in Complex Networks , 2009, 2009 International Conference on Computational Science and Engineering.

[54]  Moshe Tennenholtz,et al.  On the Emergence of Social Conventions: Modeling, Analysis, and Simulations , 1997, Artif. Intell..

[55]  Lik Mui,et al.  Notions of reputation in multi-agents systems: a review , 2002, AAMAS '02.

[56]  Ulrich Endriss,et al.  Temporal logics for normative agent communication protocols , 2005, AAMAS '05.

[57]  C. Bicchieri The grammar of society: the nature and dynamics of social norms , 2005 .

[58]  Rino Falcone,et al.  Introduction: Agents and Norms: How to fill the gap? , 1999, Artificial Intelligence and Law.

[59]  Carlos E. Alchourrón,et al.  Conflicts of norms and the revision of normative systems , 1991 .

[60]  Guido Boella,et al.  Normative Systems in Computer Science - Ten Guidelines for Normative Multiagent Systems , 2009, Normative Multi-Agent Systems.

[61]  Frank I. Michelman,et al.  Between Facts and Norms , 1992 .

[62]  Chengqi Zhang,et al.  Agent-Mining Interaction: An Emerging Area , 2007, AIS-ADM.

[63]  Pablo Cayetano Noriega Blanco-Vigil Agent mediated auctions: the fishmarket metaphor , 1998 .

[64]  A. Bandura Social learning theory , 1977 .

[65]  Sandip Sen,et al.  Effects of Social Network Topology and Options on Norm Emergence , 2009, COIN@AAMAS&IJCAI&MALLOW.

[66]  V. Latora,et al.  VECTOR OPINION DYNAMICS IN A BOUNDED CONFIDENCE CONSENSUS MODEL , 2005, physics/0504017.

[67]  Huaiqing Wang,et al.  Intelligent Agent Supported Flexible Workflow Monitoring System , 2002, CAiSE.

[68]  Albert-László Barabási,et al.  Error and attack tolerance of complex networks , 2000, Nature.

[69]  International Foundation for Autonomous Agents and MultiAgent Systems ( IFAAMAS ) , 2007 .

[70]  Jeffrey S. Rosenschein,et al.  Deals Among Rational Agents , 1985, IJCAI.

[71]  Mayuko Nakamaru,et al.  Spread of two linked social norms on complex interaction networks. , 2004, Journal of theoretical biology.

[72]  Sandip Sen,et al.  Effect of referrals on convergence to satisficing distributions , 2005, AAMAS '05.

[73]  C. Castelfranchi The Micro-Macro Constitution of Power , 2003 .

[74]  Rainer Hegselmann,et al.  Opinion dynamics and bounded confidence: models, analysis and simulation , 2002, J. Artif. Soc. Soc. Simul..

[75]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[76]  Guido Boella,et al.  Norm governed multiagent systems: the delegation of control to autonomous agents , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[77]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[78]  Nicholas R. Jennings,et al.  Rights and commitment in multi-agent agreements , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[79]  Nicholas R. Jennings,et al.  Negotiation decision functions for autonomous agents , 1998, Robotics Auton. Syst..

[80]  Carlos José Pereira de Lucena,et al.  JAT: A Test Automation Framework for Multi-Agent Systems , 2007, 2007 IEEE International Conference on Software Maintenance.

[81]  Michael Wooldridge,et al.  Understanding the Emergence of Conventions in Multi-Agent Systems , 1995, ICMAS.

[82]  Peter Ludlow,et al.  The Second Life Herald: The Virtual Tabloid that Witnessed the Dawn of the Metaverse , 2007 .

[83]  Francesca Toni,et al.  Normative KGP agents , 2006, Comput. Math. Organ. Theory.

[84]  Magnus Johansson,et al.  Massively multiple online role playing games as normative multiagent systems , 2009, Normative Multi-Agent Systems.

[85]  Pattie Maes,et al.  Kasbah: An Agent Marketplace for Buying and Selling Goods , 1996, PAAM.

[86]  Stacy Marsella,et al.  EMA: A process model of appraisal dynamics , 2009, Cognitive Systems Research.

[87]  David Lewis Convention: A Philosophical Study , 1986 .

[88]  James F. Allen Natural language processing , 1979 .

[89]  C. Zastrow The Practice of Social Work: A Comprehensive Worktext , 2009 .

[90]  Munindar P. Singh,et al.  Workflow Agents , 1998, IEEE Internet Comput..

[91]  Onn Shehory,et al.  A Comparative Evaluation of Agent-Oriented Methodologies , 2004 .

[92]  Chrysanthos Dellarocas,et al.  Social Order in Multiagent Systems , 2001, Multiagent Systems, Artificial Societies, and Simulated Organizations.

[93]  J. Elster,et al.  The Cement Of Society , 1989 .

[94]  Giulia Andrighetto,et al.  The Complex Loop of Norm Emergence: A Simulation Model , 2008, WCSS.

[95]  Heikki Mannila,et al.  Discovery of Frequent Episodes in Event Sequences , 1997, Data Mining and Knowledge Discovery.

[96]  Sandip Sen,et al.  Emergence of Norms through Social Learning , 2007, IJCAI.

[97]  Tomoko Koda,et al.  Cultural Differences in Using Facial Parts as Cues to Recognize Emotions in Avatars , 2009, IVA.

[98]  R. M. Hare,et al.  Norm and Action: A Logical Enquiry. , 1965 .

[99]  Mariusz Zytniewski,et al.  Normative Multi-Agent Enriched Data Mining to Support E-Citizens , 2009, Data Mining and Multi-agent Integration.

[100]  Albert,et al.  Topology of evolving networks: local events and universality , 2000, Physical review letters.

[101]  Michael Winikoff,et al.  Comparing Agent-Oriented Methodologies , 2003, AOIS.

[102]  Munindar P. Singh,et al.  Readings in agents , 1997 .

[103]  Frank Dignum,et al.  Autonomous agents with norms , 1999, Artificial Intelligence and Law.

[104]  Moshe Tennenholtz,et al.  Artificial Social Systems , 1992, Lecture Notes in Computer Science.

[105]  Wamberto Weber Vasconcelos,et al.  Norm-oriented programming of electronic institutions , 2006, AAMAS '06.

[106]  R. Lazarus Emotion and Adaptation , 1991 .

[107]  Pablo Noriega,et al.  Environment Engineering for Multiagent Systems , 2004 .

[108]  Joshua M. Epstein,et al.  Learning to Be Thoughtless: Social Norms and Individual Computation , 2001 .

[109]  Jordi Sabater-Mir,et al.  Categorizing Social Norms in a Simulated Resource Gathering Society , 2009, COIN@AAMAS&AAAI.

[110]  Nigel Gilbert,et al.  Computer simulation for social theory , 1995 .

[111]  H. J. Herrmann,et al.  Model of mobile agents for sexual interactions networks , 2006 .

[112]  George A. Akerlof A theory of social custom, of which unemployment may be one consequence , 1980 .

[113]  Reuven Cohen,et al.  Efficient immunization strategies for computer networks and populations. , 2002, Physical review letters.

[114]  Mark Wallace,et al.  Second Life: The Official Guide , 2006 .

[115]  Mario Paolucci,et al.  Emergence In the Loop: Simulating the two way dynamics of norm innovation , 2007, Normative Multi-agent Systems.

[116]  Giovanni Sartor,et al.  Why agents comply with norms, and why they should* , 2001 .

[117]  Pedro G. Lind,et al.  Networks based on collisions among mobile agents , 2006 .

[118]  Wamberto Weber Vasconcelos,et al.  Normative conflict resolution in multi-agent systems , 2009, Autonomous Agents and Multi-Agent Systems.

[119]  Stephen Cranefield,et al.  Modelling and Monitoring Social Expectations in Multi-agent Systems , 2006, COIN@AAMAS/ECAI.

[120]  Michael Winikoff,et al.  Prometheus: a methodology for developing intelligent agents , 2002, AAMAS '02.

[121]  G. Becker,et al.  The Economic Approach to Human Behavior , 1978 .

[122]  Guido Boella,et al.  Introduction to the special issue on normative multiagent systems , 2008, Autonomous Agents and Multi-Agent Systems.

[123]  Oren Etzioni,et al.  A scalable comparison-shopping agent for the World-Wide Web , 1997, AGENTS '97.

[124]  Andres Ferrate Google Wave: Up and Running , 2010 .

[125]  Johan Gustav Bellika,et al.  Using user models in software agents: the Virtual Secretary , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[126]  Sandip Sen,et al.  Topology and Memory Effect on Convention Emergence , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[127]  Magnus Boman,et al.  Norms in artificial decision making , 1999, Artificial Intelligence and Law.

[128]  Ramon Sangüesa,et al.  Extracting reputation in multi agent systems by means of social network topology , 2002, AAMAS '02.

[129]  Pablo Noriega,et al.  An Integrated Development Environment for Electronic Institutions , 2005 .

[130]  Michael Luck,et al.  Constraining autonomy through norms , 2002, AAMAS '02.

[131]  John F. Roddick,et al.  Association mining , 2006, CSUR.

[132]  Anand S. Rao,et al.  Decision Procedures for Propositional Linear-Time Belief-Desire-Intention Logics , 1995, ATAL.

[133]  Magnus Boman,et al.  Adjustable Autonomy, Norms and Pronouncers † , 1999 .

[134]  Juliette Rouchier,et al.  Rational Ritual: Culture, Co-ordination and Common Knowledge by Michael Suk-Young Chwe , 2002, J. Artif. Soc. Soc. Simul..

[135]  Martin J. Kollingbaum,et al.  Norm adoption in the NoA agent architecture , 2003, AAMAS '03.

[136]  John-Jules Ch. Meyer,et al.  Verifying Norm Compliancy of Protocols , 2005, AAMAS Workshops.

[137]  Guido Boella,et al.  Introduction to normative multiagent systems , 2006, Comput. Math. Organ. Theory.

[138]  F. C. Santos,et al.  The evolution of norms. , 2006, Journal of theoretical biology.

[139]  Giulia Andrighetto,et al.  Internalizing Norms: A Cognitive Model of (Social) Norms' Internalization , 2010, Int. J. Agent Technol. Syst..

[140]  Justin Manuel Aronfreed,et al.  Conduct and Conscience: The Socialization of Internalized Control Over Behavior , 1968 .

[141]  Nicholas R. Jennings Agent-Oriented Software Engineering , 1999, MAAMAW.

[142]  Pablo Lambert de Diesbach,et al.  Embodied Virtual Agents: An Affective and Attitudinal Approach of the Effects on Man-Machine Stickiness in a Product/Service Discovery , 2007, HCI.

[143]  R. Conte,et al.  Cognitive and social action , 1995 .

[144]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[145]  Mario Paolucci,et al.  Intelligent Social Learning , 2001, J. Artif. Soc. Soc. Simul..

[146]  Mehdi Dastani,et al.  The BOID architecture: conflicts between beliefs, obligations, intentions and desires , 2001, AGENTS '01.

[147]  Fabiola López y López,et al.  An architecture for autonomous normative agents , 2004, Proceedings of the Fifth Mexican International Conference in Computer Science, 2004. ENC 2004..

[148]  Lee Sproull,et al.  Using a human face in an interface , 1994, CHI '94.

[149]  George A. Akerlof An economic theorist's book of tales: The economics of caste and of the rat race and other woeful tales , 1976 .

[150]  Tilman Slembeck Reputations and Fairness in Bargaining - Experimental Evidence from a Repeated Ultimatum Game With Fixed Opponents , 1999 .

[151]  Alexander Artikis,et al.  Interaction patterns and observable commitments in a multi-agent trading scenario , 2001, AGENTS '01.

[152]  Hyacinth S. Nwana,et al.  Software agents: an overview , 1996, The Knowledge Engineering Review.

[153]  Pablo Noriega,et al.  Distributed norm management in regulated multiagent systems , 2007, AAMAS '07.

[154]  Eduardo Alonso,et al.  Rights for Multi-agent Systems , 2002, Foundations and Applications of Multi-Agent Systems.

[155]  Giulia Andrighetto,et al.  Normal = Normative? The role of intelligent agents in norm innovation , 2009, Normative Multi-Agent Systems.

[156]  Michael Luck,et al.  Norm-based behaviour modification in BDI agents , 2009, AAMAS.

[157]  E. Campbell,et al.  The Internalization of Moral Norms , 1964 .

[158]  Marco Colombetti,et al.  An operational approach to norms in artificial institutions , 2005, AAMAS '05.

[159]  Sarit Kraus,et al.  Negotiation and Cooperation in Multi-Agent Environments , 1997, Artif. Intell..

[160]  L. Tesfatsion Agent-based computational economics : A constructive approach to economic theory , 2006 .

[161]  Moshe Tennenholtz,et al.  Emergent Conventions in Multi-Agent Systems: Initial Experimental Results and Observations (Preliminary Report) , 1992, KR.

[162]  Susanne van Mulken,et al.  The impact of animated interface agents: a review of empirical research , 2000, Int. J. Hum. Comput. Stud..

[163]  Michael N. Huhns,et al.  Agents as Web Services , 2002, IEEE Internet Comput..

[164]  Juan A. Rodríguez-Aguilar,et al.  Handling Uncertainty in the Emergence of Social Conventions , 2009, 2009 Third IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[165]  Akikazu Takeuchi,et al.  Situated facial displays: towards social interaction , 1995, CHI '95.

[166]  D. Dennett The Intentional Stance. , 1987 .

[167]  Nicholas R. Jennings,et al.  The Gaia Methodology for Agent-Oriented Analysis and Design , 2000, Autonomous Agents and Multi-Agent Systems.

[168]  Ernst Fehr,et al.  Third Party Punishment and Social Norms , 2004 .

[169]  Herbert Gintis,et al.  The hitchhiker's guide to altruism: gene-culture coevolution, and the internalization of norms. , 2003, Journal of theoretical biology.

[170]  Viviane Torres da Silva,et al.  Modeling and Validating Norms , 2009, Normative Multi-Agent Systems.

[171]  Carles Sierra,et al.  Distributed Norm Enforcement: Ostracism in Open Multi-Agent Systems , 2008, Computable Models of the Law, Languages, Dialogues, Games, Ontologies.

[172]  Javier Vázquez-Salceda,et al.  Norms in multiagent systems: from theory to practice , 2005, Comput. Syst. Sci. Eng..

[173]  J. M. Smith,et al.  The Logic of Animal Conflict , 1973, Nature.

[174]  Yicheng Zhang,et al.  On the minority game: Analytical and numerical studies , 1998, cond-mat/9805084.

[175]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[176]  Michael Möhring,et al.  Simulating norm formation: an operational approach , 2009, AAMAS.

[177]  Javier Vázquez-Salceda,et al.  Making norms concrete , 2010, AAMAS.

[178]  Guido Boella,et al.  An architecture of a normative system: counts-as conditionals, obligations and permissions , 2006, AAMAS '06.

[179]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[180]  Eugénio C. Oliveira,et al.  Directed Deadline Obligations in Agent-Based Business Contracts , 2009, COIN@AAMAS&IJCAI&MALLOW.

[181]  David Wong,et al.  Concordia: An Infrastructure for Collaborating Mobile Agents , 1997, Mobile Agents.

[182]  Paolo Petta,et al.  Introducing Emotions into the Computational Study of Social Norms: A First Evaluation , 2001, J. Artif. Soc. Soc. Simul..

[183]  James E. Kittock The Impact of Locality and Authority on Emergent Conventions: Initial Observations , 1994, AAAI.

[184]  Carl Hewitt,et al.  Offices are open systems , 1986, TOIS.

[185]  J. Elster Social Norms and Economic Theory , 1989, Handbook of Monetary Policy.

[186]  Giulia Andrighetto,et al.  How Agents Find out Norms: A Simulation Based Model of Norm Innovation , 2008, NORMAS.

[187]  Mitsuru Ishizuka,et al.  Emerging system for affectively charged interpersonal communication , 2009, 2009 ICCAS-SICE.

[188]  Andrew M. Colman,et al.  The complexity of cooperation: Agent-based models of competition and collaboration , 1998, Complex..

[189]  Sean Luke,et al.  Cooperative Multi-Agent Learning: The State of the Art , 2005, Autonomous Agents and Multi-Agent Systems.

[190]  Pablo Noriega,et al.  Implementing norms in electronic institutions , 2005, AAMAS '05.

[191]  Catholijn M. Jonker,et al.  Modelling an Agent's Mind and Matter , 1997, MAAMAW.

[192]  Sarvapali D. Ramchurn,et al.  Trust in multi-agent systems , 2004, The Knowledge Engineering Review.

[193]  Guillaume Deffuant,et al.  Simulating Interacting Agents and Social Phenomena, The Second World Congress [Post-Conference Proceedings of the World Congress on Social Simulation, WCSS 2008, George Mason University, Fairfax, VA, USA, 14-17 July 2008] , 2010, WCSS.

[194]  Herbert Gintis,et al.  Solving the Puzzle of Prosociality , 2003 .

[195]  Karl-Dieter Opp,et al.  How do norms emerge? An outline of a theory , 2001 .

[196]  M. Wellman,et al.  Automated Markets and Trading Agents , 2007 .

[197]  Martin Neumann,et al.  A Classification of Normative Architectures , 2008, WCSS.

[198]  Jeffrey M. Bradshaw,et al.  Software agents , 1997 .

[199]  Frank Dignum,et al.  From Social Monitoring to Normative Influence , 2001, J. Artif. Soc. Soc. Simul..

[200]  Wamberto Weber Vasconcelos,et al.  A Distributed Architecture for Norm-Aware Agent Societies , 2005, DALT.

[201]  Martin A. Nowak,et al.  Indirect reciprocity provides a narrow margin of efficiency for costly punishment , 2008, Nature.

[202]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[203]  Harko Verhagen,et al.  Simulation of the Learning of Norms , 2001 .

[204]  Viviane Torres da Silva,et al.  From the specification to the implementation of norms: an automatic approach to generate rules from norms to govern the behavior of agents , 2008, Autonomous Agents and Multi-Agent Systems.

[205]  Michael Luck,et al.  A model of normative power , 2010, AAMAS.

[206]  Diane J. Cook,et al.  Flexible Social Laws , 1995, IJCAI.

[207]  Marek Sergot,et al.  On the characterization of law and computer systems: the normative systems perspective , 1994 .

[208]  Giulia Andrighetto,et al.  Norm internalization in artificial societies , 2010, AI Commun..

[209]  Edna Ullmann-Margalit,et al.  The Emergence Of Norms , 1977 .

[210]  Randall Davis,et al.  Report on the Workshop on Distributed AI , 1980 .

[211]  Thies Wittig,et al.  ARCHON: an architecture for multi-agent systems , 1992 .

[212]  M. Feldman,et al.  Cultural transmission and evolution: a quantitative approach. , 1981, Monographs in population biology.

[213]  Gerhard Weiss,et al.  Multiagent Systems , 1999 .

[214]  Pablo Noriega,et al.  Operationalisation of norms for usage in electronic institutions , 2006, AAMAS '06.

[215]  Yoav Shoham,et al.  An overview of agent-oriented programming , 1997 .

[216]  Yukinori Kakazu,et al.  The structural phase transition among fixed cardinal networks , 2004 .

[217]  M. Spence Job Market Signaling , 1973 .

[218]  Melanie Mitchell,et al.  Complex systems: Network thinking , 2006, Artif. Intell..

[219]  Munindar P. Singh,et al.  Emergent properties of referral systems , 2003, AAMAS '03.

[220]  Julian Padget,et al.  Formalizing a Language for Institutions and Norms , 2001, ATAL.

[221]  Paul Davidsson,et al.  Agent Based Social Simulation: A Computer Science View , 2002, J. Artif. Soc. Soc. Simul..

[222]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[223]  J. Gibbs Norms: The Problem of Definition and Classification , 1965, American Journal of Sociology.

[224]  Joong Hyuk Chang,et al.  Mining weighted sequential patterns in a sequence database with a time-interval weight , 2011, Knowl. Based Syst..

[225]  Edmund H. Durfee,et al.  Coordination of distributed problem solvers , 1988 .

[226]  Munindar P. Singh,et al.  Searching social networks , 2003, AAMAS '03.

[227]  David Hales,et al.  Group Reputation Supports Beneficent Norms , 2002, J. Artif. Soc. Soc. Simul..

[228]  Eduardo Alonso,et al.  Rights and Argumentation in Open Multi-Agent Systems , 2004, Artificial Intelligence Review.

[229]  G. Boella,et al.  Deliberate Normative Agents , 2001 .

[230]  Josep M. Pujol,et al.  Structure in artificial societies , 2006 .

[231]  Agostino Poggi,et al.  Jade - a fipa-compliant agent framework , 1999 .

[232]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[233]  Cristiano Castelfranchi,et al.  From conventions to prescriptions. Towards an integrated view of norms , 1999, Artificial Intelligence and Law.

[234]  Michael Luck,et al.  Agent technology, Computing as Interaction: A Roadmap for Agent Based Computing , 2005 .

[235]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[236]  Juan A. Rodríguez-Aguilar,et al.  Infection-Based Norm Emergence in Multi-Agent Complex Networks , 2008, ECAI.

[237]  P. Richerson,et al.  Culture and the Evolutionary Process , 1988 .

[238]  Jeff White Readings in agents , 1998 .

[239]  David Hales,et al.  Cooperation without Memory or Space: Tags, Groups and the Prisoner's Dilemma , 2000, MABS.

[240]  F. Dignum,et al.  From Desires, Obligations and Norms to Goals , 2002 .

[241]  Frank Dignum,et al.  Deliberative Normative Agents: Principles and Architecture , 1999, ATAL.