Coaction versus reciprocity in continuous-time models of cooperation.

Cooperating animals frequently show closely coordinated behaviours organized by a continuous flow of information between interacting partners. Such real-time coaction is not captured by the iterated prisoner's dilemma and other discrete-time reciprocal cooperation games, which inherently feature a delay in information exchange. Here, we study the evolution of cooperation when individuals can dynamically respond to each other's actions. We develop continuous-time analogues of iterated-game models and describe their dynamics in terms of two variables, the propensity of individuals to initiate cooperation (altruism) and their tendency to mirror their partner's actions (coordination). These components of cooperation stabilize at an evolutionary equilibrium or show oscillations, depending on the chosen payoff parameters. Unlike reciprocal altruism, cooperation by coaction does not require that those willing to initiate cooperation pay in advance for uncertain future benefits. Correspondingly, we show that introducing a delay to information transfer between players is equivalent to increasing the cost of cooperation. Cooperative coaction can therefore evolve much more easily than reciprocal cooperation. When delays entirely prevent coordination, we recover results from the discrete-time alternating prisoner's dilemma, indicating that coaction and reciprocity are connected by a continuum of opportunities for real-time information exchange.

[1]  F. Weissing,et al.  The evolution of social dominance I: Two-player models , 2003 .

[2]  R. Connor,et al.  Altruism among non-relatives: alternatives to the 'Prisoner's Dilemma'. , 1995, Trends in ecology & evolution.

[3]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[4]  M. Taborsky Cooperation built the Tower of Babel , 2007, Behavioural Processes.

[5]  L. Dugatkin Cooperation Among Animals: An Evolutionary Perspective , 1997 .

[6]  C. Pennartz,et al.  Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making , 2008, Progress in Neurobiology.

[7]  Alasdair I Houston,et al.  Incorporating rules for responding into evolutionary games , 1999, Nature.

[8]  D. Fudenberg,et al.  Evolutionary cycles of cooperation and defection. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[9]  M. Milinski,et al.  Do sticklebacks cooperate repeatedly in reciprocal pairs? , 1990, Behavioral Ecology and Sociobiology.

[10]  Mike Mesterton-Gibbons,et al.  Information, variance and cooperation: minimal models , 2011, Dyn. Games Appl..

[11]  M Nowak,et al.  Oscillations in the evolution of reciprocity. , 1989, Journal of theoretical biology.

[12]  R. Seyfarth,et al.  Contingent cooperation between wild female baboons , 2010, Proceedings of the National Academy of Sciences.

[13]  David G. Rand,et al.  Delayed and Inconsistent Information and the Evolution of Trust , 2012, Dyn. Games Appl..

[14]  R. Trivers The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[15]  M. Hauser,et al.  Give unto others: genetically unrelated cotton-top tamarin monkeys preferentially give food to those who altruistically give food back , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[16]  Sebastian Bonhoeffer,et al.  Evolution of cooperation by generalized reciprocity , 2005, Proceedings of the Royal Society B: Biological Sciences.

[17]  M. Milinski,et al.  Working memory constrains human cooperation in the Prisoner's Dilemma. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[18]  D. Stephens,et al.  Discounting and Reciprocity in an Iterated Prisoner's Dilemma , 2002, Science.

[19]  Peter Hammerstein,et al.  Why is reciprocity so rare in social animals? A protestant appeal. , 2003 .

[20]  T. Schelling,et al.  The Strategy of Conflict. , 1961 .

[21]  R. Bshary,et al.  The interplay of cognition and cooperation , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  D. Stephens,et al.  Testing models of non-kin cooperation: mutualism and the Prisoner’s Dilemma , 1995, Animal Behaviour.

[23]  M. Nowak,et al.  The Alternating Prisoner's Dilemma , 1994 .

[24]  L. Vesterlund,et al.  Giving Little by Little: Dynamic Voluntary Contribution Games , 2007 .

[25]  R. Boyd,et al.  Explaining altruistic behavior in humans , 2003 .

[26]  Ronald Noë Cooperation experiments: coordination through communication versus acting apart together , 2006, Animal Behaviour.

[27]  A. Kacelnik,et al.  Simultaneous and sequential choice as a function of reward delay and magnitude: normative, descriptive and process-based models tested in the European starling (Sturnus vulgaris). , 2008, Journal of experimental psychology. Animal behavior processes.

[28]  Attila Szolnoki,et al.  Information sharing promotes prosocial behaviour , 2013, ArXiv.

[29]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[30]  R. Schuster Cooperative coordination as a social behavior , 2002, Human Nature.

[31]  T. Pitcher,et al.  Who Dares, Wins: the Function and Evolution of Predator Inspection Behaviour in Shoaling Fish , 1991 .

[32]  Leslie M. Marx,et al.  Dynamic Voluntary Contribution to a Public Project , 2000 .

[33]  F. Waal,et al.  Capuchins do cooperate: the advantage of an intuitive task , 2000, Animal Behaviour.

[34]  Fiery Cushman,et al.  Evolving the Psychological Mechanisms for Cooperation , 2005 .

[35]  U. Dieckmann,et al.  The Dynamical Theory of Coevolution : A Derivation from Stochastic Ecological Processes , 1996 .

[36]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[37]  Marcus Frean The prisoner’s dilemma without synchrony , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[38]  E. Hill Journal of Theoretical Biology , 1961, Nature.

[39]  R. Herrnstein,et al.  Choice and delay of reinforcement. , 1967, Journal of the experimental analysis of behavior.

[40]  M. Taborsky,et al.  The influence of social experience on cooperative behaviour of rats (Rattus norvegicus): direct vs generalised reciprocity , 2008, Behavioral Ecology and Sociobiology.

[41]  Attila Szolnoki,et al.  Decelerated invasion and waning moon patterns in public goods games with delayed distribution , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  R. Selten Reexamination of the perfectness concept for equilibrium points in extensive games , 1975, Classics in Game Theory.

[43]  T. Krama,et al.  Experimental evidence of reciprocal altruism in the pied flycatcher , 2008, Behavioral Ecology and Sociobiology.

[44]  M. Nowak,et al.  Evolution of indirect reciprocity by image scoring , 1998, Nature.

[45]  C. Boesch,et al.  Hunting behavior of wild chimpanzees in the Taï National Park. , 1989, American journal of physical anthropology.

[46]  Scott S. Wiltermuth,et al.  Synchrony and Cooperation , 2009, Psychological science.

[47]  M. Macy,et al.  Learning dynamics in social dilemmas , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[48]  F. Weissing,et al.  Effects of Conformism on the Cultural Evolution of Social Behaviour , 2013, PloS one.

[49]  N. Raihani,et al.  Resolving the iterated prisoner’s dilemma: theory and reality , 2011, Journal of evolutionary biology.

[50]  Tim Clutton-Brock,et al.  Cooperation between non-kin in animal societies , 2009, Nature.

[51]  M. Milinski TIT FOR TAT in sticklebacks and the evolution of cooperation , 1987, Nature.