Distributed Detection via Gaussian Running Consensus: Large Deviations Asymptotic Analysis

We study, by large deviations analysis, the asymptotic performance of Gaussian running consensus distributed detection over random networks; in other words, we determine the exponential decay rate of the detection error probability. With running consensus, at each time step, each sensor averages its decision variable with the neighbors' decision variables and accounts on-the-fly for its new observation. We show that: 1) when the rate of network information flow (the speed of averaging) is above a threshold, then Gaussian running consensus is asymptotically equivalent to the optimal centralized detector, i.e., the exponential decay rate of the error probability for running consensus equals the Chernoff information; and 2) when the rate of information flow is below a threshold, running consensus achieves only a fraction of the Chernoff information rate. We quantify this achievable rate as a function of the network rate of information flow. Simulation examples demonstrate our theoretical findings on the behavior of running consensus detection over random networks.

[1]  Van Trees,et al.  Detection, Estimation, and Modulation Theory. Part 1 - Detection, Estimation, and Linear Modulation Theory. , 1968 .

[2]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[3]  J. Tsitsiklis Decentralized Detection' , 1993 .

[4]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[5]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[6]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[7]  Venugopal V. Veeravalli,et al.  Decentralized detection in sensor networks , 2003, IEEE Trans. Signal Process..

[8]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[9]  José M. F. Moura,et al.  Detection in Sensor Networks: The Saddlepoint Approximation , 2007, IEEE Transactions on Signal Processing.

[10]  Paolo Braca,et al.  Enforcing Consensus While Monitoring the Environment in Wireless Sensor Networks , 2008, IEEE Transactions on Signal Processing.

[11]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[12]  Soummya Kar,et al.  Topology for Distributed Inference on Graphs , 2006, IEEE Transactions on Signal Processing.

[13]  Ioannis D. Schizas,et al.  Distributed Recursive Least-Squares for Consensus-Based In-Network Adaptive Estimation , 2009, IEEE Transactions on Signal Processing.

[14]  Ali H. Sayed,et al.  Diffusion LMS-based distributed detection over adaptive networks , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[15]  Ioannis D. Schizas,et al.  Distributed LMS for Consensus-Based In-Network Adaptive Processing , 2009, IEEE Transactions on Signal Processing.

[16]  Ali H. Sayed,et al.  Distributed detection over adaptive networks based on diffusion estimation schemes , 2009, 2009 IEEE 10th Workshop on Signal Processing Advances in Wireless Communications.

[17]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[18]  José M. F. Moura,et al.  Weight Optimization for Consensus Algorithms With Correlated Switching Topology , 2009, IEEE Transactions on Signal Processing.

[19]  Soummya Kar,et al.  Gossip Algorithms for Distributed Signal Processing , 2010, Proceedings of the IEEE.

[20]  Paolo Braca,et al.  Asymptotic Optimality of Running Consensus in Testing Binary Hypotheses , 2010, IEEE Transactions on Signal Processing.

[21]  José M. F. Moura,et al.  Distributed detection over time varying networks: Large deviations analysis , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[22]  Ali H. Sayed,et al.  Distributed Detection Over Adaptive Networks Using Diffusion Adaptation , 2011, IEEE Transactions on Signal Processing.

[23]  Soummya Kar,et al.  Distributed Parameter Estimation in Sensor Networks: Nonlinear Observation Models and Imperfect Communication , 2008, IEEE Transactions on Information Theory.