Dynamics of Vertex-Reinforced Random Walks

We generalize a result from Volkov (2001,[23]) and prove that, on a large class of locally finite connected graphs of bounded degree (G, ∼) and symmetric reinforcement matrices a = (ai,j)i,j∈V (G), the vertex-reinforced random walk (VRRW) eventually localizes with positive probability on subsets which consist of a complete d-partite subgraph with possible loops plus its outer boundary. We first show that, in general, any stable equilibrium of a linear symmetric replicator dynamics with positive payoffs on a graph G satisfies the property that its support is a complete d-partite subgraph of G with possible loops, for some d > 1. This result is used here for the study of VRRWs, but also applies to other contexts such as evolutionary models in population genetics and game theory. Next we generalize the result of Pemantle (1992,[14]) and Bena¨om (1997,[2]) relating the asymptotic behaviour of the VRRW to replicator dynamics. This enables us to conclude that, given any neighbourhood of a strictly stable equilibrium with support S, the following event occurs with positive probability: the walk localizes on S ∪ ∂S (where ∂S is the outer boundary of S) and the density of occupation of the VRRW converges, with polynomial rate, to a strictly stable equilibrium in this neighbourhood.

[1]  Stanislav Volkov,et al.  Phase Transition in Vertex-Reinforced Random Walks on $${\mathbb{Z}}$$ with Non-linear Reinforcement , 2006 .

[2]  Stanislav Volkov,et al.  Vertex-reinforced random walk on Z has finite range , 1999 .

[3]  C Cannings,et al.  Patterns of ESS's. I. , 1988, Journal of theoretical biology.

[4]  C Cannings,et al.  Routes to polymorphism. , 1993, Journal of theoretical biology.

[5]  A survey of random processes with reinforcement , 2007, math/0610076.

[6]  An asymptotic result for Brownian polymers , 2008, 0804.1431.

[7]  Mark Broom,et al.  On the number of local maxima of a constrained quadratic form , 1993, Proceedings of the Royal Society of London. Series A: Mathematical and Physical Sciences.

[8]  V. Limic,et al.  VRRW on complete-like graphs: Almost sure behavior , 2009, 0904.4722.

[9]  L. Saloff-Coste,et al.  Lectures on finite Markov chains , 1997 .

[10]  Pierre Tarres Vertex-reinforced random walk on ℤ eventually gets stuck on five points , 2004 .

[11]  E. Akin,et al.  Dynamics of games and genes: Discrete versus continuous time , 1983 .

[12]  R. Pemantle Vertex-reinforced random walk , 1992, math/0404041.

[13]  N. Cohen,et al.  Preferential duplication graphs , 2010, Journal of Applied Probability.

[14]  Franz Merkl,et al.  Linearly edge-reinforced random walks , 2006, math/0608220.

[15]  Attracting edge and strongly edge reinforced walks , 2006, math/0604200.

[16]  M. Benaïm Vertex-reinforced random walks and a conjecture of Pemantle , 1997 .

[17]  Chris Cannings,et al.  On the number of stable equilibria in a one-locus, multi-allelic system , 1988 .