Large deviations analysis of consensus+innovations detection in random networks

We study the large deviations performance of consensus+innovations distributed detection over random networks, where each sensor, at each time k, weight averages its decision variable with its neighbors decision variables (consensus), and accounts for its new observation (innovation). Sensor observations are independent identically distributed (i.i.d.) both in time and space, but have generic (non Gaussian) distributions. The underlying network is random, described by a sequence of i.i.d. stochastic, symmetric weight matrices W(k); we measure the corresponding speed of consensus by |logr|, where r is the second largest eigenvalue of the second moment of W(k). We show that distributed detection exhibits a phase transition behavior with respect to | logr|: when |logr| is above a threshold, distributed detection is equivalent to the optimal centralized detector, i.e., has the error exponent equal to the Chernoff information. We explicitly quantify the optimality threshold for | log r| as a function of the log-moment generating function Λ0(·) of a sensor's log-likelihood ratio. When below the threshold, we analytically find the achievable error exponent as a function of r and Λ0(·). Finally, we illustrate by an example the dependence of the optimality threshold on the type of the sensor observations distribution.

[1]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[2]  Venugopal V. Veeravalli,et al.  Asymptotic results for decentralized detection in power constrained wireless sensor networks , 2004, IEEE Journal on Selected Areas in Communications.

[3]  Soummya Kar,et al.  Topology for Distributed Inference on Graphs , 2006, IEEE Transactions on Signal Processing.

[4]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[5]  José M. F. Moura,et al.  Distributed detection over time varying networks: Large deviations analysis , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[6]  Rick S. Blum,et al.  Distributed detection with multiple sensors I. Advanced topics , 1997, Proc. IEEE.

[7]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[8]  Paolo Braca,et al.  Asymptotic Optimality of Running Consensus in Testing Binary Hypotheses , 2010, IEEE Transactions on Signal Processing.

[9]  Ali H. Sayed,et al.  Distributed detection over adaptive networks based on diffusion estimation schemes , 2009, 2009 IEEE 10th Workshop on Signal Processing Advances in Wireless Communications.

[10]  José M. F. Moura,et al.  Detection in Sensor Networks: The Saddlepoint Approximation , 2007, IEEE Transactions on Signal Processing.

[11]  João M. F. Xavier,et al.  Sensor Selection for Event Detection in Wireless Sensor Networks , 2010, IEEE Transactions on Signal Processing.

[12]  José M. F. Moura,et al.  Distributed Detection Over Noisy Networks: Large Deviations Analysis , 2011, IEEE Transactions on Signal Processing.

[13]  José M. F. Moura,et al.  Distributed Detection via Gaussian Running Consensus: Large Deviations Asymptotic Analysis , 2011, IEEE Transactions on Signal Processing.

[14]  Ali H. Sayed,et al.  Distributed Detection Over Adaptive Networks Using Diffusion Adaptation , 2011, IEEE Transactions on Signal Processing.

[15]  M. Alanyali,et al.  Distributed Detection in Sensor Networks With Packet Losses and Finite Capacity Links , 2006, IEEE Transactions on Signal Processing.

[16]  H. Vincent Poor,et al.  Distributed detection in noisy sensor networks , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.