A New Approach for Distributed Hypothesis Testing with Extensions to Byzantine-Resilience

We study a setting where a group of agents, each receiving partially informative private observations, seek to collaboratively learn the true state (among a set of hypotheses) that explains their joint observation profiles over time. To solve this problem, we propose a distributed learning rule that differs fundamentally from existing approaches, in the sense that it does not employ any form of “belief-averaging”. Specifically, every agent maintains a local belief on each hypothesis that is updated in a Bayesian manner without any network influence, and an actual belief that is updated (up to normalization) as the minimum of its own local belief and the actual beliefs of its neighbors. Under minimal requirements on the signal structures of the agents and the underlying communication graph, we establish consistency of the proposed belief update rule, i.e., we show that the actual beliefs of the agents asymptotically concentrate on the true state almost surely. As one of the key benefits of our approach, we show that our learning rule can be extended to scenarios that capture misbehavior on the part of certain agents in the network, modeled via the Byzantine adversary model. In particular, we prove that each non-adversarial agent can asymptotically learn the true state of the world almost surely, under appropriate conditions on the observation model and the network topology.

[1]  Shahin Shahrampour,et al.  Distributed Detection: Finite-Time Analysis and Impact of Network Topology , 2014, IEEE Transactions on Automatic Control.

[2]  Nitin H. Vaidya,et al.  Fault-Tolerant Multi-Agent Optimization: Optimal Iterative Distributed Algorithms , 2016, PODC.

[3]  Nitin H. Vaidya,et al.  Matrix Representation of Iterative Approximate Byzantine Consensus in Directed Graphs , 2012, ArXiv.

[4]  Angelia Nedic,et al.  Nonasymptotic convergence rates for cooperative learning over time-varying directed graphs , 2014, 2015 American Control Conference (ACC).

[5]  Shahin Shahrampour,et al.  Exponentially fast parameter estimation in networks using distributed dual averaging , 2013, 52nd IEEE Conference on Decision and Control.

[6]  Lewis Tseng,et al.  Iterative approximate byzantine consensus in arbitrary directed graphs , 2012, PODC '12.

[7]  Chiu-Yuen Koo,et al.  Broadcast in radio networks tolerating byzantine adversarial behavior , 2004, PODC '04.

[8]  T. Javidi,et al.  Social learning and distributed hypothesis testing , 2014, 2014 IEEE International Symposium on Information Theory.

[9]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[10]  Shreyas Sundaram,et al.  Distributed Observers for LTI Systems , 2016, IEEE Transactions on Automatic Control.

[11]  Gustavo L. Gilardoni,et al.  On Reaching a Consensus Using Degroot's Iterative Pooling , 1993 .

[12]  B. Gharesifard,et al.  Distributed Optimization Under Adversarial Nodes , 2016, IEEE Transactions on Automatic Control.

[13]  Nitin H. Vaidya,et al.  Defending non-Bayesian learning against adversarial attacks , 2018, Distributed Computing.

[14]  Lin Wang,et al.  Social learning with time-varying weights , 2014, Journal of Systems Science and Complexity.

[15]  Shreyas Sundaram,et al.  Byzantine-resilient distributed observers for LTI systems , 2018, Autom..

[16]  H. Vincent Poor,et al.  Decentralized Sequential Detection with a Fusion Center Performing the Sequential Test , 1992 .

[17]  Pooya Molavi,et al.  Information Heterogeneity and the Speed of Learning in Social Networks , 2013 .

[18]  Angelia Nedić,et al.  Fast Convergence Rates for Distributed Non-Bayesian Learning , 2015, IEEE Transactions on Automatic Control.

[19]  Shreyas Sundaram,et al.  Resilient Distributed State Estimation for LTI Systems , 2018, ArXiv.

[20]  Kamiar Rahnama Rad,et al.  Distributed parameter estimation in networks , 2010, 49th IEEE Conference on Decision and Control (CDC).

[21]  Ali Jadbabaie,et al.  Non-Bayesian Social Learning , 2011, Games Econ. Behav..

[22]  Seth Hutchinson,et al.  Fault-Tolerant Rendezvous of Multirobot Systems , 2017, IEEE Transactions on Robotics.

[23]  Shreyas Sundaram,et al.  Resilient Asymptotic Consensus in Robust Networks , 2013, IEEE Journal on Selected Areas in Communications.

[24]  Nancy A. Lynch,et al.  Reaching approximate agreement in the presence of faults , 1986, JACM.