Directional learning and the provisioning of public goods

We consider an environment where players are involved in a public goods game and must decide repeatedly whether to make an individual contribution or not. However, players lack strategically relevant information about the game and about the other players in the population. The resulting behavior of players is completely uncoupled from such information, and the individual strategy adjustment dynamics are driven only by reinforcement feedbacks from each player's own past. We show that the resulting “directional learning” is sufficient to explain cooperative deviations away from the Nash equilibrium. We introduce the concept of k–strong equilibria, which nest both the Nash equilibrium and the Aumann-strong equilibrium as two special cases, and we show that, together with the parameters of the learning model, the maximal k–strength of equilibrium determines the stationary distribution. The provisioning of public goods can be secured even under adverse conditions, as long as players are sufficiently responsive to the changes in their own payoffs and adjust their actions accordingly. Substantial levels of public cooperation can thus be explained without arguments involving selflessness or social preferences, solely on the basis of uncoordinated directional (mis)learning.

[1]  R. Aumann Correlated Equilibrium as an Expression of Bayesian Rationality Author ( s ) , 1987 .

[2]  D. E. Matthews Evolution and the Theory of Games , 1977 .

[3]  Charles R. Plott,et al.  Public goods provision in an experimental environment , 1985 .

[4]  D. M. V. Hesteren Evolutionary Game Theory , 2017 .

[5]  H. Peyton Young,et al.  Learning in a Black Box , 2013 .

[6]  C. Cannings,et al.  Evolutionary Game Theory , 2010 .

[7]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[8]  H. Peyton Young,et al.  Decentralized dynamics to optimal and stable states in the assignment game , 2013, 52nd IEEE Conference on Decision and Control.

[9]  David G. Rand,et al.  Static network structure can stabilize human cooperation , 2014, Proceedings of the National Academy of Sciences.

[10]  F. C. Santos,et al.  Social diversity promotes the emergence of cooperation in public goods games , 2008, Nature.

[11]  J. Wooders,et al.  Coalition-Proof Equilibrium , 1996 .

[12]  M. Whinston,et al.  Coalition-Proof Nash Equilibria I. Concepts , 1987 .

[13]  Jean-François Laslier,et al.  Stubborn learning , 2014, Theory and Decision.

[14]  J. Ledyard Public Goods: A Survey of Experimental Research , 1994 .

[15]  Michael Mesterton-Gibbons,et al.  An introduction to game-theoretic modelling , 2019 .

[16]  Jörgen W. Weibull,et al.  Evolutionary Game Theory , 1996 .

[17]  B. Rivlin,et al.  A Selective Survey of the Literature in the Social Sciences and Related Fields on Modern North Africa , 1954, American Political Science Review.

[18]  E. Fehr,et al.  Cooperation and Punishment in Public Goods Experiments , 1999, SSRN Electronic Journal.

[19]  Attila Szolnoki,et al.  Coevolutionary Games - A Mini Review , 2009, Biosyst..

[20]  F. C. Santos,et al.  Risk of collective failure provides an escape from the tragedy of the commons , 2011, Proceedings of the National Academy of Sciences.

[21]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[22]  David P. Myatt,et al.  When Does One Bad Apple Spoil the Barrel? An Evolutionary Analysis of Collective Action , 2008 .

[23]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[24]  R. Selten,et al.  End behavior in sequences of finite prisoner's dilemma supergames , 1986 .

[25]  David G. Rand,et al.  Human cooperation , 2013, Trends in Cognitive Sciences.

[26]  Rupert Sausgruber,et al.  Confusion and learning in the voluntary contributions game , 2013, Experimental Economics.

[27]  A. Roth,et al.  Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria , 1998 .

[28]  Till Grüne-Yanoff A cooperative species: human reciprocity and its evolution , 2015 .

[29]  Ananish Chaudhuri Sustaining cooperation in laboratory public goods experiments: a selective survey of the literature , 2011 .

[30]  Mike Mesterton-Gibbons,et al.  Cooperation Among Unrelated Individuals: Evolutionary Factors , 1992, The Quarterly Review of Biology.

[31]  Dean Phillips Foster,et al.  Regret Testing: Learning to Play Nash Equilibrium Without Knowing You Have an Opponent , 2006 .

[32]  S. Hrdy Mothers and Others: The Evolutionary Origins of Mutual Understanding , 2009 .

[33]  H. Peyton Young,et al.  Learning by trial and error , 2009, Games Econ. Behav..

[34]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[35]  U. Fischbacher,et al.  Are People Conditionally Cooperative? Evidence from a Public Goods Experiment , 2001 .

[36]  A. Roth,et al.  Learning in Extensive-Form Games: Experimental Data and Simple Dynamic Models in the Intermediate Term* , 1995 .

[37]  R. Axelrod,et al.  Evolutionary Dynamics , 2004 .

[38]  H. Gintis,et al.  A Cooperative Species: Human Reciprocity and Its Evolution , 2011 .

[39]  R. Aumann Subjectivity and Correlation in Randomized Strategies , 1974 .

[40]  T. Palfrey,et al.  Anomalous Behavior in Public Goods Experiments: How Much and Why? , 1997 .

[41]  J M Smith,et al.  Evolution and the theory of games , 1976 .

[42]  Jacob K. Goeree,et al.  An Explanation of Anomalous Behavior in Models of Political Participation , 2005, American Political Science Review.

[43]  R. Selten,et al.  Experimental Sealed Bid First Price Auctions with Directly Observed Bid Functions , 1994 .

[44]  Attila Szolnoki,et al.  Evolutionary dynamics of group interactions on structured populations: a review , 2013, Journal of The Royal Society Interface.

[45]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[46]  M. Nowak Five Rules for the Evolution of Cooperation , 2006, Science.

[47]  David G. Rand,et al.  Positive Interactions Promote Public Cooperation , 2009, Science.

[48]  Wolfgang J. Luhan,et al.  Cedex Discussion Paper Series , 2022 .

[49]  A. Hama Supercooperators: Altruism, Evolution, and Why We Need Each Other to Succeed , 2012 .