Fairness in multi-agent systems

Multi-agent systems are complex systems in which multiple autonomous entities, called agents, cooperate in order to achieve a common or personal goal. These entities may be computer software, robots, and also humans. In fact, many multi-agent systems are intended to operate in cooperation with or as a service for humans. Typically, multi-agent systems are designed assuming perfectly rational, self-interested agents, according to the principles of classical game theory. Recently, such strong assumptions have been relaxed in various ways. One such way is explicitly including principles derived from human behavior. For instance, research in the field of behavioral economics shows that humans are not purely self-interested. In addition, they strongly care about fairness. Therefore, multi-agent systems that fail to take fairness into account, may not be sufficiently aligned with human expectations and may not reach intended goals. In this paper, we present an overview of work in the area of fairness in multi-agent systems. More precisely, we first look at the classical agent model, that is, rational decision making. We then provide an outline of descriptive models of fairness, that is, models that explain how and why humans reach fair decisions. Then, we look at prescriptive, computational models for achieving fairness in adaptive multi-agent systems. We show that results obtained by these models are compatible with experimental and analytical results obtained in the field of behavioral economics.

[1]  D. Parkes,et al.  Auctions, Bidding and Exchange Design , 2004 .

[2]  M. A. L. Thathachar,et al.  Networks of Learning Automata , 2004 .

[3]  Nico Roos,et al.  Using Neuro-Evolution in Aircraft Deicing Scheduling , 2007 .

[4]  Danny Weyns,et al.  Gradient field-based task assignment in an AGV transportation system , 2006, AAMAS '06.

[5]  F. C. Santos,et al.  Scale-free networks provide a unifying framework for the emergence of cooperation. , 2005, Physical review letters.

[6]  C. Hauert,et al.  Reward and punishment , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Dorothy E. Denning,et al.  Cryptography and Data Security , 1982 .

[8]  Thomas Riechmann,et al.  Inequity Aversion and Individual Behavior in Public Good Games: An Experimental Investigation , 2007 .

[9]  Nicholas R. Jennings,et al.  A Roadmap of Agent Research and Development , 2004, Autonomous Agents and Multi-Agent Systems.

[10]  W. Güth,et al.  An experimental analysis of ultimatum bargaining , 1982 .

[11]  Ann Nowé,et al.  Exploring selfish reinforcement learning in repeated games with stochastic rewards , 2007, Autonomous Agents and Multi-Agent Systems.

[12]  O. Leimar,et al.  Evolution of cooperation through indirect reciprocity , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[13]  M. Milinski,et al.  Reputation helps solve the ‘tragedy of the commons’ , 2002, Nature.

[14]  G. Owen,et al.  Two-person bargaining: An experimental test of the Nash axioms , 1974 .

[15]  J. Henrich.  Cultural group selection, coevolutionary processes and large-scale cooperation , 2004 .

[16]  R Boyd,et al.  Why people punish defectors. Weak conformist transmission can stabilize costly enforcement of norms in cooperative dilemmas. , 2001, Journal of theoretical biology.

[17]  R. Boyd,et al.  The evolution of altruistic punishment , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[18]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[19]  M. Nowak,et al.  Evolution of indirect reciprocity , 2005, Nature.

[20]  Kaushik Basu,et al.  The traveler's dilemma: Paradoxes of rationality in game theory , 1994 .

[21]  Javier Vázquez-Salceda,et al.  Norms in multiagent systems: from theory to practice , 2005, Comput. Syst. Sci. Eng..

[22]  C. Hauert,et al.  Volunteering as Red Queen Mechanism for Cooperation in Public Goods Games , 2002, Science.

[23]  H. Simon,et al.  Models of Man. , 1957 .

[24]  F. C. Santos,et al.  Evolutionary dynamics of social dilemmas in structured heterogeneous populations. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[26]  Sarah Mathew,et al.  A Narrow Road to Cooperation , 2007, Science.

[27]  Klaus M. Schmidt,et al.  A Theory of Fairness, Competition, and Cooperation , 1999 .

[28]  Juan Antonio Rodríguez-Aguilar,et al.  On the design and construction of agent-mediated institutions , 2001 .

[29]  A. Ortmann,et al.  On the origin of convention: Evidence from symmetric bargaining games , 1995 .

[30]  E. Fehr,et al.  Fairness and Retaliation: The Economics of Reciprocity , 2000, SSRN Electronic Journal.

[31]  M. Thathachar,et al.  Networks of Learning Automata: Techniques for Online Stochastic Optimization , 2003 .

[32]  Armin Falk,et al.  A Theory of Reciprocity , 2001, Games Econ. Behav..

[33]  J. Nash.  THE BARGAINING PROBLEM , 1950, Classics in Game Theory.

[34]  John F. Nash,et al.  Some Experimental n-Person Games , 1952 .

[35]  Huib Aldewereld,et al.  Autonomy vs. Conformity: An Institutional Perspective on Norms and Protocols , 2007, The Knowledge Engineering Review.

[36]  Sandip Sen,et al.  Emergence of Norms through Social Learning , 2007, IJCAI.

[37]  Steven de Jong,et al.  Fairness in multi-agent systems , 2008, The Knowledge Engineering Review.

[38]  John J Flynn,et al.  South America's missing mammals. , 2007, Scientific American.

[39]  L. Keller,et al.  Selfish genes: a green beard in the red fire ant , 1998, Nature.

[40]  J. Henrich,et al.  Costly Punishment Across Human Societies , 2006, Science.

[41]  M. Rabin,et al.  Understanding Social Preference with Simple Tests , 2001 .

[42]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[43]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[44]  Colin Camerer,et al.  Foundations of Human Sociality - Economic Experiments and Ethnographic: Evidence From Fifteen Small-Scale Societies , 2004 .

[45]  W. Hamilton.  The genetical evolution of social behaviour. I. , 1964, Journal of theoretical biology.

[46]  Nico Roos,et al.  Priority Awareness: Towards a Computational Model of Human Fairness for Multi-agent Systems , 2007, Adaptive Agents and Multi-Agents Systems.

[47]  H. Oosterbeek,et al.  Cultural Differences in Ultimatum Game Experiments: Evidence from a Meta-Analysis , 2001 .

[48]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[49]  David C. Parkes,et al.  Computational Mechanism Design , 2007 .

[50]  Arnon Lotem,et al.  Evolution of cooperation between individuals , 1999, Nature.

[51]  Nico Roos,et al.  Agent-based scheduling for aircraft deicing , 2006 .

[52]  M. Rabin.  Published by: American , 2022 .

[53]  E. Fehr.  Human behaviour: Don't lose your reputation , 2004, Nature.

[54]  R. Boyd,et al.  Indirect reciprocity can stabilize cooperation without the second-order free rider problem , 2004, Nature.

[55]  Francisco C. Santos,et al.  Emergence of Cooperation in Heterogeneous structured populations , 2006 .

[56]  Jonathan D. Cohen,et al.  The Neural Basis of Economic Decision-Making in the Ultimatum Game , 2003, Science.

[57]  R. Sugden.  The Economics of Rights, Co-Operation, and Welfare , 1986 .

[58]  Manuela M. Veloso,et al.  Multiagent learning using a variable learning rate , 2002, Artif. Intell..

[59]  A. Roth,et al.  Game-Theoretic Models and the Role of Information in Bargaining , 1979 .

[60]  Yann Chevaleyre,et al.  Issues in Multiagent Resource Allocation , 2006, Informatica.

[61]  T. Yamagishi.  The provision of a sanctioning system as a public good , 1986 .

[62]  M. Nowak,et al.  Evolution of indirect reciprocity by image scoring , 1998, Nature.

[63]  Karl Tuyls,et al.  Artificial agents learning human fairness , 2008, AAMAS.

[64]  Gerhard Weiss,et al.  Multiagent systems: a modern approach to distributed artificial intelligence , 1999 .

[65]  M. Yaari,et al.  On dividing justly , 1984 .

[66]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[67]  Kumpati S. Narendra,et al.  Learning automata - an introduction , 1989 .

[68]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[69]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[70]  M. Milinski,et al.  Cooperation through image scoring in humans. , 2000, Science.

[71]  Francisco C. Santos,et al.  Cooperation Prevails When Individuals Adjust Their Social Ties , 2006, PLoS Comput. Biol..

[72]  E. Fehr,et al.  Altruistic punishment in humans , 2002, Nature.

[73]  Á. Pascual-Leone,et al.  Diminishing Reciprocal Fairness by Disrupting the Right Prefrontal Cortex , 2006, Science.

[74]  Nicholas R. Jennings,et al.  Socially Rational Agents , 1997 .

[75]  C. Hauert,et al.  Via Freedom to Coercion: The Emergence of Costly Punishment , 2007, Science.

[76]  J. Nash.  Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[77]  Kaushik Basu,et al.  The traveler's dilemma. , 2007, Scientific American.

[78]  Ida G. Sprinkhuizen-Kuyper,et al.  Robust and Scalable Coordination of Potential-Field Driven Agents , 2006, 2006 International Conference on Computational Inteligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA'06).

[79]  M. Nowak,et al.  Fairness versus reason in the ultimatum game. , 2000, Science.

[80]  Ernst Fehr,et al.  Homo reciprocans: A Research Initiative on the Origins, Dimensions, and Policy Implications of Recip , 1997 .

[81]  Kevin J. S. Zollman.  Explaining fairness in complex environments , 2008 .

[82]  Ann Nowé,et al.  Evolutionary game theory and multi-agent reinforcement learning , 2005, The Knowledge Engineering Review.

[83]  C. Preist,et al.  Adaptive agents in a persistent shout double auction , 1998, ICE '98.

[84]  Yoav Shoham,et al.  If multi-agent learning is the answer, what is the question? , 2007, Artif. Intell..

[85]  Yann Chevaleyre,et al.  A Short Introduction to Computational Social Choice , 2007, SOFSEM.

[86]  Jacques Ferber,et al.  Multi-agent systems - an introduction to distributed artificial intelligence , 1999 .

[87]  Herbert Gintis,et al.  Game Theory Evolving: A Problem-Centered Introduction to Modeling Strategic Interaction - Second Edition , 2009 .