Alternating cooperation strategies in a Route Choice Game: Theory, experiments, and effects of a learning scenario

In this paper, we present experimental investigations on a day-to-day route choice scenario. Here, the equilibrium outcome is, according to real traffic observations, fair (equal for all users) but induces an inefficient usage of network capacity. Optimal usage would be characterized by some users winning and some losing in comparison to the equilibrium state. Coherent, alternating cooperation strategies can be a suitable solution, but they require innovation and group coordination in addition to cooperativeness. In these points, our work differs considerably from other contributions observing the emergence of cooperation in social dilemmas. By classifying the two-person variant of our experiments among the symmetrical 2x2 games we show the situation of the Route Choice Game not to be addressed by the literature so far. Although the equilibrium outcome in this setup is “strongly stable”, in our experiments we find eminent empirical evidence of alternating cooperation and, thereby, observed persistent utilization of the system optimum. The transition to this optimal configuration can be well described by quantitative considerations that are presented in the paper. Furthermore, the straight success of a learning scenario indicates that the collective innovation of alternating strategies may be the most critical challenge to the individuals instead of just learning to be cooperative. Presumably, this also holds for other social dilemma situations.

[1]  Ricardo Mansilla,et al.  Algorithmic Complexity in Minority Game , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[2]  Akira Namatame,et al.  The Complexity of Collective Decision , 2002 .

[3]  Challet,et al.  Relevance of memory in minority games , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[4]  M. Macy,et al.  Learning dynamics in social dilemmas , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[5]  R. Riolo,et al.  Evolution of cooperation without reciprocity , 2001, Nature.

[6]  Sebastian Kube,et al.  Experimental Investigation of Day-to-Day Route-Choice Behaviour and Network Simulations of Autobahn Traffic in North Rhine-Westphalia , 2004 .

[7]  Baosheng Yuan,et al.  Evolutionary dynamics and the phase structure of the minority game. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  M. Nowak,et al.  A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner's Dilemma game , 1993, Nature.

[9]  J. G. Wardrop,et al.  Some Theoretical Aspects of Road Traffic Research , 1952 .

[10]  Johnson,et al.  Theory of the evolutionary minority game , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[11]  Dirk Helbing,et al.  Experiments, Stochastic Description, Intermittency Control, and Traffic Optimization , 2002 .

[12]  Josef Hofbauer,et al.  The theory of evolution and dynamical systems , 1988 .

[13]  Giovanna Devetag,et al.  Coordination and Self-Organization in Minority Games: Experimental Evidence , 2002 .

[14]  B D Greenshields,et al.  A study of traffic capacity , 1935 .

[15]  Anatol Rapoport,et al.  A taxonomy of 2x2 games , 1966 .

[16]  D. Queller Social evolution: Kinship is relative , 2004, Nature.

[17]  L. Samuelson,et al.  Evolutionary stability in repeated games played by finite automata , 1992 .

[18]  Anatol Rapoport,et al.  Exploiter, leader, hero, and martyr: The four archetypes of the 2 × 2 game , 1967 .

[19]  M. Milinski,et al.  Volunteering leads to rock–paper–scissors dynamics in a public goods game , 2003, Nature.

[20]  R. Axelrod,et al.  The Further Evolution of Cooperation , 1988, Science.

[21]  M. Milinski,et al.  Reputation helps solve the ‘tragedy of the commons’ , 2002, Nature.

[22]  R Mulet,et al.  Learning to coordinate in a complex and nonstationary world. , 2001, Physical review letters.

[23]  A Rapoport Exploiter, leader, hero, and martyr: the four archetypes of the 2 times 2 game. , 1967, Behavioral science.

[24]  Tad Hogg,et al.  Controlling chaos in distributed systems , 1991, IEEE Trans. Syst. Man Cybern..

[25]  Larry Samuelson,et al.  Building rational cooperation , 2006, J. Econ. Theory.

[26]  Hogg,et al.  Dynamics of computational ecosystems. , 1989, Physical review. A, General physics.

[27]  W. Arthur Inductive Reasoning and Bounded Rationality , 1994 .

[28]  A. Colman,et al.  Evolution of coordinated alternating reciprocity in repeated dyadic games. , 2004, Journal of theoretical biology.

[29]  A. Colman Depth of strategic reasoning in games , 2003, Trends in Cognitive Sciences.

[30]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[31]  Daniel B. Neill Cooperation and coordination in the turn-taking dilemma , 2003, TARK '03.

[32]  M. Nowak,et al.  Evolution of indirect reciprocity by image scoring , 1998, Nature.

[33]  Martin A. Nowak,et al.  Evolution: The good, the bad and the lonely , 2002, Nature.

[34]  P M Hui,et al.  Theory of networked minority games based on strategy pattern dynamics. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Dirk Helbing,et al.  How Individuals Learn to Take Turns: Emergence of Alternating Cooperation in a Congestion Game and the Prisoner's Dilemma , 2005, Adv. Complex Syst..

[36]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.

[37]  Alasdair I. Houston,et al.  Variation in behaviour promotes cooperation in the Prisoner's Dilemma game , 2004, Nature.

[38]  Yi-Cheng Zhang,et al.  Emergence of cooperation and organization in an evolutionary game , 1997 .

[39]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[40]  György Szabó,et al.  Phase transitions and volunteering in spatial public goods games. , 2002, Physical review letters.

[41]  Heinz Mühlenbein,et al.  Evolution of Cooperation in a Spatial Prisoner's Dilemma , 2002, Adv. Complex Syst..

[42]  B. Huberman,et al.  The outbreak of cooperation , 1993 .

[43]  K. Lindgren,et al.  Cooperation in an unpredictable environment , 2002 .

[44]  A. C. Pigou Economics of welfare , 1920 .

[45]  Ken Binmore,et al.  Fun and games : a text on game theory , 1992 .

[46]  M. Nowak,et al.  The Alternating Prisoner's Dilemma , 1994 .