Large Deviations Performance of Consensus+Innovations Distributed Detection With Non-Gaussian Observations

We establish the large deviations asymptotic performance (error exponent) of consensus+innovations distributed detection over random networks with generic (non-Gaussian) sensor observations. At each time instant, sensors 1) combine theirs with the decision variables of their neighbors (consensus) and 2) assimilate their new observations (innovations). This paper shows for general non-Gaussian distributions that consensus+innovations distributed detection exhibits a phase transition behavior with respect to the network degree of connectivity. Above a threshold, distributed is as good as centralized, with the same optimal asymptotic detection performance, but, below the threshold, distributed detection is suboptimal with respect to centralized detection. We determine this threshold and quantify the performance loss below threshold. Finally, we show the dependence of the threshold and of the performance on the distribution of the observations: the asymptotic performance of distributed detectors over the same random network with different observations' distributions, for example, Gaussian, Laplace, or quantized, may be different, even though the asymptotic performance of the corresponding centralized detectors is the same.

[1]  Soummya Kar,et al.  Topology for Distributed Inference on Graphs , 2006, IEEE Transactions on Signal Processing.

[2]  Venugopal V. Veeravalli,et al.  Asymptotic results for decentralized detection in power constrained wireless sensor networks , 2004, IEEE Journal on Selected Areas in Communications.

[3]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[4]  José M. F. Moura,et al.  Distributed Detection via Gaussian Running Consensus: Large Deviations Asymptotic Analysis , 2011, IEEE Transactions on Signal Processing.

[5]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[6]  J.-F. Chamberland,et al.  Wireless Sensors in Distributed Detection Applications , 2007, IEEE Signal Processing Magazine.

[7]  H. Vincent Poor,et al.  Distributed detection in noisy sensor networks , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[8]  Ali H. Sayed,et al.  Distributed Detection Over Adaptive Networks Using Diffusion Adaptation , 2011, IEEE Transactions on Signal Processing.

[9]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[10]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[11]  Nemanja Ilic,et al.  Distributed change detection based on a randomized consensus algorithm , 2010, Proceedings of Papers 5th European Conference on Circuits and Systems for Communications (ECCSC'10).

[12]  Zhi Chen,et al.  Optimal Precoding Design and Power Allocation for Decentralized Detection of Deterministic Signals , 2012, IEEE Transactions on Signal Processing.

[13]  Soummya Kar,et al.  Distributed Parameter Estimation in Sensor Networks: Nonlinear Observation Models and Imperfect Communication , 2008, IEEE Transactions on Information Theory.

[14]  Ioannis D. Schizas,et al.  Distributed Recursive Least-Squares for Consensus-Based In-Network Adaptive Estimation , 2009, IEEE Transactions on Signal Processing.

[15]  José M. F. Moura,et al.  Distributed detection over time varying networks: Large deviations analysis , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[16]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[17]  Ali H. Sayed,et al.  Diffusion LMS-based distributed detection over adaptive networks , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[18]  Ali H. Sayed,et al.  Distributed detection over adaptive networks based on diffusion estimation schemes , 2009, 2009 IEEE 10th Workshop on Signal Processing Advances in Wireless Communications.

[19]  José M. F. Moura,et al.  Detection in Sensor Networks: The Saddlepoint Approximation , 2007, IEEE Transactions on Signal Processing.

[20]  João M. F. Xavier,et al.  Sensor Selection for Event Detection in Wireless Sensor Networks , 2010, IEEE Transactions on Signal Processing.

[21]  M. Alanyali,et al.  Distributed Detection in Sensor Networks With Packet Losses and Finite Capacity Links , 2006, IEEE Transactions on Signal Processing.

[22]  Paolo Braca,et al.  Asymptotic Optimality of Running Consensus in Testing Binary Hypotheses , 2010, IEEE Transactions on Signal Processing.

[23]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[24]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[25]  S. Varadhan,et al.  Large deviations , 2019, Graduate Studies in Mathematics.

[26]  José M. F. Moura,et al.  Topology of Sensor Networks in Distributed Detection , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[27]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[28]  Nemanja Ilic,et al.  Distributed Change Detection Based on a Consensus Algorithm , 2011, IEEE Transactions on Signal Processing.

[29]  Soummya Kar,et al.  Distributed Average Consensus in Sensor Networks with Random Link Failures and Communication Channel Noise , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[30]  Venugopal V. Veeravalli,et al.  Decentralized detection in sensor networks , 2003, IEEE Trans. Signal Process..

[31]  José M. F. Moura,et al.  Weight Optimization for Consensus Algorithms With Correlated Switching Topology , 2009, IEEE Transactions on Signal Processing.

[32]  Ioannis D. Schizas,et al.  Distributed LMS for Consensus-Based In-Network Adaptive Processing , 2009, IEEE Transactions on Signal Processing.

[33]  João M. F. Xavier,et al.  Consensus and Products of Random Stochastic Matrices: Exact Rate for Convergence in Probability , 2012, IEEE Transactions on Signal Processing.

[34]  José M. F. Moura,et al.  Distributed Detection Over Noisy Networks: Large Deviations Analysis , 2011, IEEE Transactions on Signal Processing.