An isotropic universal decentralized estimation scheme for a bandwidth constrained ad hoc sensor network

Consider a decentralized estimation problem whereby an ad hoc network of K distributed sensors wish to cooperate to estimate an unknown parameter over a bounded interval [-U,U]. Each sensor collects one noise-corrupted sample, performs a local data quantization according to a fixed (but possibly probabilistic) rule, and transmits the resulting discrete message to its neighbors. These discrete messages are then percolated in the network and used by each sensor to form its own minimum mean squared error (MMSE) estimate of the unknown parameter according to a fixed fusion rule. In this paper, we propose a simple probabilistic local quantization rule: each sensor quantizes its observation to the first most significant bit (MSB) with probability 1/2, the second MSB with probability 1/4, and so on. Assuming the noises are uncorrelated and identically distributed across sensors and are bounded to [-U,U], we show that this local quantization strategy together with a fusion rule can guarantee a MSE of 4U/sup 2//K, and that the average length of local messages is bounded (no more than 2.5 bits). Compared with the worst case Cramer-Rao lower bound of U/sup 2//K (even for the centralized counterpart), this is within a factor of at most 4 to the minimum achievable MSE. Moreover, the proposed scheme is isotropic and universal in the sense that the local quantization rules and the final fusion rules are independent of sensor index, noise distribution, network size, or topology. In fact, the proposed scheme allows sensors in the network to operate identically and autonomously even when the network undergoes changes in size or topology.

[1]  Andrea J. Goldsmith,et al.  Joint estimation in sensor networks under energy constraints , 2004, 2004 First Annual IEEE Communications Society Conference on Sensor and Ad Hoc Communications and Networks, 2004. IEEE SECON 2004..

[2]  Jason Speyer,et al.  Computation and transmission requirements for a decentralized linear-quadratic-Gaussian control problem , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[3]  D. Teneketzis,et al.  Coordinator , 2020, EuroPLoP.

[4]  Pramod K. Varshney,et al.  Distributed Bayesian hypothesis testing with distributed data fusion , 1988, IEEE Trans. Syst. Man Cybern..

[5]  A. Willsky,et al.  Combining and updating of local estimates and regional maps along sets of one-dimensional tracks , 1982 .

[6]  Zhi-Quan Luo,et al.  Universal decentralized detection in a bandwidth-constrained sensor network , 2004, IEEE Transactions on Signal Processing.

[7]  Zhi-Quan Luo,et al.  Universal decentralized estimation in a bandwidth constrained sensor network , 2005, IEEE Transactions on Information Theory.

[8]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[9]  Haralabos C. Papadopoulos,et al.  Sequential signal encoding from noisy measurements using quantizers with dynamic bias control , 2001, IEEE Trans. Inf. Theory.

[10]  Amy R. Reibman,et al.  Design of quantizers for decentralized estimation systems , 1993, IEEE Trans. Commun..

[11]  Haralabos C. Papadopoulos,et al.  Sequential signal encoding and estimation for distributed sensor networks , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[12]  Zhi-Quan Luo,et al.  Decentralized estimation in an inhomogeneous environment , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[13]  Yasutada Oohama,et al.  The Rate-Distortion Function for the Quadratic Gaussian CEO Problem , 1998, IEEE Trans. Inf. Theory.

[14]  K. Ramchandran,et al.  Distributed source coding using syndromes (DISCUS): design and construction , 1999, Proceedings DCC'99 Data Compression Conference (Cat. No. PR00096).

[15]  John A. Gubner,et al.  Distributed estimation and quantization , 1993, IEEE Trans. Inf. Theory.

[16]  Vasileios Megalooikonomou,et al.  Quantizer design for distributed estimation with communication constraints and unknown observation statistics , 2000, IEEE Trans. Commun..

[17]  John N. Tsitsiklis,et al.  Data fusion with minimal communication , 1994, IEEE Trans. Inf. Theory.

[18]  Zhi-Quan Luo,et al.  Universal decentralized detection in a bandwidth-constrained sensor network , 2005, IEEE Trans. Signal Process..

[19]  Jon M. Kleinberg,et al.  Spatial gossip and resource location protocols , 2001, JACM.

[20]  Kannan Ramchandran,et al.  Distributed source coding using syndromes (DISCUSS): design and construction , 1999 .