Consensus over martingale graph processes

In this paper, we consider a consensus seeking process based on repeated averaging in a randomly changing network. The underlying graph of such a network at each time is generated by a martingale random process. We prove that consensus is reached almost surely if and only if the expected graph of the network contains a directed spanning tree. We then provide an example of a consensus seeking process based on local averaging of opinions in a dynamic model of social network formation which is a martingale. At each time step, individual agents randomly choose some other agents to interact with according to some arbitrary probabilities. The interaction is one-sided and results in the agent averaging her opinion with those of her randomly chosen neighbors based on the weights she assigns to them. Once an agent chooses a neighbor, the weights are updated in such a way that the expected values of the weights are preserved. We show that agents reach consensus in this random dynamical network almost surely. Finally, we demonstrate that a Polya Urn process is a martingale process, and our prior results in [1] is a special case of the model proposed in this paper.

[1]  Mehran Mesbahi,et al.  Agreement over random networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[2]  L. Elsner,et al.  Convergence of infinite products of matrices and inner-outer iteration schemes , 1994 .

[3]  Sandro Zampieri,et al.  Randomized consensus algorithms over large scale networks , 2007 .

[4]  M. Degroot Reaching a Consensus , 1974 .

[5]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[6]  F. Bullo,et al.  Analysis and design tools for distributed motion coordination , 2005, Proceedings of the 2005, American Control Conference, 2005..

[7]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[8]  Chai Wah Wu,et al.  Synchronization and convergence of linear dynamics in random directed networks , 2006, IEEE Transactions on Automatic Control.

[9]  Ali Jadbabaie,et al.  On consensus in a correlated model of network formation based on a Polya urn process , 2011, IEEE Conference on Decision and Control and European Control Conference.

[10]  Ιωαννησ Τσιτσικλησ,et al.  PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION , 1984 .

[11]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[12]  R. Durrett Probability: Theory and Examples , 1993 .

[13]  John S. Baras,et al.  Convergence Results for the Linear Consensus Problem under Markovian Random Graphs , 2013, SIAM J. Control. Optim..

[14]  Alireza Tahbaz-Salehi,et al.  Consensus Over Ergodic Stationary Graph Processes , 2010, IEEE Transactions on Automatic Control.

[15]  Maurizio Porfiri,et al.  Consensus Seeking Over Random Weighted Directed Graphs , 2007, IEEE Transactions on Automatic Control.

[16]  Alireza Tahbaz-Salehi,et al.  A Necessary and Sufficient Condition for Consensus Over Random Networks , 2008, IEEE Transactions on Automatic Control.

[17]  Matthew O. Jackson,et al.  Naïve Learning in Social Networks and the Wisdom of Crowds , 2010 .

[18]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..