Convergence of rule-of-thumb learning rules in social networks

We study the problem of dynamic learning by a social network of agents. Each agent receives a signal about an underlying state and communicates with a subset of agents (his neighbors) in each period. The network is connected. In contrast to the majority of existing learning models, we focus on the case where the underlying state is time-varying. We consider the following class of rule of thumb learning rules: at each period, each agent constructs his posterior as a weighted average of his prior, his signal and the information he receives from neighbors. The weights given to signals can vary over time and the weights given to neighbors can vary across agents. We distinguish between two subclasses: (1) constant weight rules; (2) diminishing weight rules. The latter reduces weights given to signals asymptotically to 0. Our main results characterize the asymptotic behavior of beliefs. We show that the general class of rules leads to unbiased estimates of the underlying state. When the underlying state has innovations with variance tending to zero asymptotically, we show that the diminishing weight rules ensure convergence in the mean-square sense. In contrast, when the underlying state has persistent innovations, constant weight rules enable us to characterize explicit bounds on the mean square error between an agent¿s belief and the underlying state as a function of the type of learning rule and signal structure.

[1]  R. Olfati-Saber,et al.  Consensus Filters for Sensor Networks and Distributed Sensor Fusion , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[2]  A. Banerjee,et al.  A Simple Model of Herd Behavior , 1992 .

[3]  J.N. Tsitsiklis,et al.  Convergence in Multiagent Coordination, Consensus, and Flocking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[4]  S. Goyal,et al.  Conformism and diversity under social learning , 2001 .

[5]  Ruggero Carli,et al.  Distributed Kalman filtering based on consensus strategies , 2008, IEEE Journal on Selected Areas in Communications.

[6]  Yannis M. Ioannides,et al.  Job Information Networks, Neighborhood Effects, and Inequality , 2004 .

[7]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[8]  Kaivan Munshi Social learning in a heterogeneous population: technology diffusion in the Indian Green Revolution , 2004 .

[9]  Mark S. Granovetter The Strength of Weak Ties , 1973, American Journal of Sociology.

[10]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[11]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[12]  Daron Acemoglu,et al.  Bayesian Learning in Social Networks , 2008 .

[13]  P. DeMarzo,et al.  Persuasion Bias, Social Influence, and Uni-Dimensional Opinions , 2001 .

[14]  M. Anthony,et al.  Mathematics for Economics and Finance: Introduction to optimisation , 1996 .

[15]  P. DeMarzo,et al.  Persuasion Bias, Social Influence, and Uni-Dimensional Opinions , 2001 .

[16]  Glenn Ellison,et al.  Rules of Thumb for Social Learning , 1993, Journal of Political Economy.

[17]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[18]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[19]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[20]  Lones Smith,et al.  Pathological Outcomes of Observational Learning , 2000 .

[21]  M. Rosenzweig,et al.  Learning by Doing and Learning from Others: Human Capital and Technical Change in Agriculture , 1995, Journal of Political Economy.

[22]  B. Golub,et al.  Naive Learning in Social Networks: Convergence, Influence and Wisdom of Crowds , 2007 .

[23]  Glenn Ellison,et al.  Word-of-Mouth Communication and Social Learning , 1995 .

[24]  S. Bikhchandani,et al.  You have printed the following article : A Theory of Fads , Fashion , Custom , and Cultural Change as Informational Cascades , 2007 .