Adaptive agents on evolving networks

We propose a model of strategic network formation in repeated games where players adopt actions and connections simultaneously using a simple reinforcement learning scheme. We demonstrate that under certain plausible assumptions the dynamics of such systems can be described by so called replicator equations that characterize the co-evolution of agent strategies and network topology. Within this framework, the network structures emerging as a result of the game-dynamical interactions are described by the stable rest points of the replicator dynamics. In particular, we show using both simulations and analytical methods that for certain N-agent games the stable equilibria consist of star motifs as the main building blocks of the network.

[1]  Josef Hofbauer,et al.  Evolutionary Games and Population Dynamics , 1998 .

[2]  J. Crutchfield,et al.  Coupled replicator equations for the dynamics of learning in multiagent systems. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[4]  Thilo Gross,et al.  Adaptive coevolutionary networks: a review , 2007, Journal of The Royal Society Interface.

[5]  S. Fortunato,et al.  Statistical physics of social dynamics , 2007, 0710.3256.

[6]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[7]  Attila Szolnoki,et al.  Coevolutionary Games - A Mini Review , 2009, Biosyst..