Whose Opinion to Follow in Multihypothesis Social Learning? A Large Deviations Perspective

We consider a multihypothesis social learning problem in which an agent has access to a set of private observations and chooses an opinion from a set of experts to incorporate into its final decision. To model individual biases, we allow the agent and experts to have general loss functions and possibly different decision spaces. We characterize the loss exponents of both the agent and experts, and provide an asymptotically optimal method for the agent to choose the best expert to follow. We show that up to asymptotic equivalence, the worst loss exponent for the agent is achieved when it adopts the 0-1 loss function, which assigns a loss of 0 if the true hypothesis is declared and a loss of 1 otherwise. We introduce the concept of hypothesis-loss neutrality, and show that if the agent adopts a particular policy that is hypothesis-loss neutral, then it ignores all experts whose decision spaces are smaller than its own. On the other hand, if experts have the same decision space as the agent, then choosing an expert with the same loss function as itself is not necessarily optimal for the agent, which is somewhat counter-intuitive. We derive sufficient conditions for when it is optimal for the agent with 0-1 loss function to choose an expert with the same loss function.

[1]  Moe Z. Win,et al.  On the Subexponential Decay of Detection Error Probabilities in Long Tandems , 2008, IEEE Trans. Inf. Theory.

[2]  David P. Myatt,et al.  Innovation Diffusion in Heterogeneous Populations: Contagion, Social Influence, and Social Learning , 2009 .

[3]  Wee-Peng Tay,et al.  The Value of Feedback in Decentralized Detection , 2011, IEEE Transactions on Information Theory.

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  H. Vincent Poor,et al.  Minimax robust decentralized detection , 1994, IEEE Trans. Inf. Theory.

[6]  Xavier Vives,et al.  Social learning and rational expectations , 1996 .

[7]  N. Sloane,et al.  Lower Bounds to Error Probability for Coding on Discrete Memoryless Channels. I , 1993 .

[8]  Wuqiong Luo,et al.  Identifying Infection Sources and Regions in Large Networks , 2012, IEEE Transactions on Signal Processing.

[9]  Yongsheng Ding,et al.  An Intelligent Self-Organization Scheme for the Internet of Things , 2013, IEEE Computational Intelligence Magazine.

[10]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[11]  Thomas M. Cover,et al.  Elements of Information Theory: Cover/Elements of Information Theory, Second Edition , 2005 .

[12]  Gerd Kortuem,et al.  Smart objects as building blocks for the Internet of things , 2010, IEEE Internet Computing.

[13]  Sinan Aral,et al.  Identifying Influential and Susceptible Members of Social Networks , 2012, Science.

[14]  Pramod K. Varshney,et al.  A New Framework for Distributed Detection With Conditionally Dependent Observations , 2012, IEEE Transactions on Signal Processing.

[15]  Tony Q. S. Quek,et al.  Robust detection and social learning in tandem networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Moe Z. Win,et al.  Data Fusion Trees for Detection: Does Architecture Matter? , 2008, IEEE Transactions on Information Theory.

[17]  N. Bingham Probability Theory: An Analytic View , 2002 .

[18]  M. Athans,et al.  Distributed detection by a large team of sensors in tandem , 1992 .

[19]  J. Tsitsiklis Decentralized Detection' , 1993 .

[20]  Pramod K. Varshney,et al.  A Bayesian sampling approach to decision fusion using hierarchical models , 2002, IEEE Trans. Signal Process..

[21]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[22]  Jure Leskovec,et al.  The dynamics of viral marketing , 2005, EC '06.

[23]  Edwin K. P. Chong,et al.  Error Probability Bounds for Balanced Binary Relay Trees , 2012, IEEE Transactions on Information Theory.

[24]  Venugopal V. Veeravalli,et al.  Decentralized detection in sensor networks , 2003, IEEE Trans. Signal Process..

[25]  Ertem Tuncel,et al.  On error exponents in hypothesis testing , 2005, IEEE Transactions on Information Theory.

[26]  K. Khalil On the Complexity of Decentralized Decision Making and Detection Problems , 2022 .

[27]  Ashot N. Harutyunyan,et al.  Error exponents in multiple hypothesis testing for arbitrarily varying sources , 2010, 2010 IEEE Information Theory Workshop.

[28]  D. Stroock,et al.  Probability Theory: An Analytic View , 1995, The Mathematical Gazette.

[29]  Moe Z. Win,et al.  Bayesian Detection in Bounded Height Tree Networks , 2007, IEEE Transactions on Signal Processing.

[30]  John N. Tsitsiklis,et al.  On Learning With Finite Memory , 2012, IEEE Transactions on Information Theory.

[31]  Elwyn R. Berlekamp,et al.  Lower Bounds to Error Probability for Coding on Discrete Memoryless Channels. II , 1967, Inf. Control..

[32]  Rick S. Blum,et al.  The good, bad and ugly: distributed detection of a known signal in dependent Gaussian noise , 2000, IEEE Trans. Signal Process..

[33]  Yashodhan Kanoria,et al.  Tractable Bayesian Social Learning on Trees , 2012, IEEE Journal on Selected Areas in Communications.

[34]  John N. Tsitsiklis,et al.  Extremal properties of likelihood-ratio quantizers , 1993, IEEE Trans. Commun..

[35]  John N. Tsitsiklis,et al.  Decentralized detection by a large number of sensors , 1988, Math. Control. Signals Syst..

[36]  George Atia,et al.  Controlled Sensing for Multihypothesis Testing , 2012, IEEE Transactions on Automatic Control.

[37]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[38]  Yu Zhang,et al.  Identifying Key Users for Targeted Marketing by Mining Online Social Network , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[39]  Douglas Gale,et al.  Bayesian learning in social networks , 2003, Games Econ. Behav..

[40]  Moe Z. Win,et al.  On the Impact of Node Failures and Unreliable Communications in Dense Sensor Networks , 2008, IEEE Transactions on Signal Processing.

[41]  P.K. Varshney,et al.  Decision fusion rules in multi-hop wireless sensor networks , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[42]  Duncan J. Watts,et al.  Everyone's an influencer: quantifying influence on twitter , 2011, WSDM '11.