Non-Bayesian Social Learning with Gaussian Uncertain Models

Non-Bayesian social learning theory provides a framework for distributed inference of a group of agents interacting over a social network by sequentially communicating and updating beliefs about the unknown state of the world through likelihood updates from their observations. Typically, likelihood models are assumed known precisely. However, in many situations the models are generated from sparse training data due to lack of data availability, high cost of collection/calibration, limits within the communications network, and/or the high dynamics of the operational environment. Recently, social learning theory was extended to handle those model uncertainties for categorical models. In this paper, we introduce the theory of Gaussian uncertain models and study the properties of the beliefs generated by the network of agents. We show that even with finite amounts of training data, non-Bayesian social learning can be achieved and all agents in the network will converge to a consensus belief that provably identifies the best estimate for the state of the world given the set of prior information.

[1]  L. M. M.-T. Theory of Probability , 1929, Nature.

[2]  M. Degroot Optimal Statistical Decisions , 1970 .

[3]  T. Javidi,et al.  Social learning and distributed hypothesis testing , 2014, 2014 IEEE International Symposium on Information Theory.

[4]  Ali H. Sayed,et al.  Belief Control Strategies for Interactions Over Weakly-Connected Graphs , 2018, IEEE Open Journal of Signal Processing.

[5]  Elchanan Mossel,et al.  Complexity of Bayesian belief exchange over a network , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[6]  Lance Kaplan,et al.  Non-Bayesian Social Learning with Uncertain Models over Time-Varying Directed Graphs , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[7]  Philippe Smets,et al.  The Transferable Belief Model , 1991, Artif. Intell..

[8]  P. Gustafson,et al.  Conservative prior distributions for variance parameters in hierarchical models , 2006 .

[9]  Shahin Shahrampour,et al.  Exponentially fast parameter estimation in networks using distributed dual averaging , 2013, 52nd IEEE Conference on Decision and Control.

[10]  Pooya Molavi,et al.  (Non-)Bayesian learning without recall , 2014, 53rd IEEE Conference on Decision and Control.

[11]  Audun Jøsang,et al.  Subjective Logic: A Formalism for Reasoning Under Uncertainty , 2016 .

[12]  Lance Kaplan,et al.  Non-Bayesian Social Learning With Uncertain Models , 2020, IEEE Transactions on Signal Processing.

[13]  Peter Walley,et al.  STATISTICAL INFERENCES BASED ON A SECOND-ORDER POSSIBILITY DISTRIBUTION , 1997 .

[14]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[15]  Ali Jadbabaie,et al.  On Malicious Agents in Non-Bayesian Social Learning with Uncertain Models , 2019, 2019 22th International Conference on Information Fusion (FUSION).

[16]  P. Walley Inferences from Multinomial Data: Learning About a Bag of Marbles , 1996 .

[17]  D. Rubin Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician , 1984 .

[18]  Ali H. Sayed,et al.  Social Learning Over Weakly Connected Graphs , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[19]  Douglas Gale,et al.  Bayesian learning in social networks , 2003, Games Econ. Behav..

[20]  Kamiar Rahnama Rad,et al.  Distributed parameter estimation in networks , 2010, 49th IEEE Conference on Decision and Control (CDC).

[21]  Ali Jadbabaie,et al.  A Theory of Non‐Bayesian Social Learning , 2018 .

[22]  Ali Jadbabaie,et al.  Non-Bayesian Social Learning , 2011, Games Econ. Behav..

[23]  Angelia Nedic,et al.  Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization , 2008, J. Optim. Theory Appl..

[24]  Nitin H. Vaidya,et al.  Defending non-Bayesian learning against adversarial attacks , 2018, Distributed Computing.

[25]  Shreyas Sundaram,et al.  A New Approach to Distributed Hypothesis Testing and Non-Bayesian Learning: Improved Learning Rate and Byzantine Resilience , 2019, IEEE Transactions on Automatic Control.

[26]  Ali Jadbabaie,et al.  On Increasing Self-Confidence in Non-Bayesian Social Learning over Time-Varying Directed Graphs , 2018, 2019 American Control Conference (ACC).

[27]  Ali H. Sayed,et al.  Belief control strategies for interactions over weak graphs , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Wee Peng Tay,et al.  Non-Bayesian social learning with observation reuse and soft switching , 2017, 2017 IEEE International Conference on Communications (ICC).

[29]  Yashodhan Kanoria,et al.  Tractable Bayesian Social Learning on Trees , 2012, IEEE Journal on Selected Areas in Communications.

[30]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[31]  Angelia Nedic,et al.  Distributed Learning for Cooperative Inference , 2017, ArXiv.

[32]  Didier Dubois,et al.  Possibility theory , 2018, Scholarpedia.

[33]  Angelia Nedić,et al.  Fast Convergence Rates for Distributed Non-Bayesian Learning , 2015, IEEE Transactions on Automatic Control.