Minimax Quantization for Distributed Maximum Likelihood Estimation

We consider the design of quantizers for the distributed estimation of a deterministic parameter, when the fusion center uses a maximum-likelihood estimator. We define a new metric of performance, which is to minimize the maximum ratio between the Fisher information of the unquantized and quantized observations. Since the estimator is M-L, the criterion is equivalent to minimizing the maximum asymptotic relative efficiency due to quantization. We propose an algorithm to obtain the quantizer that optimizes the metric and prove its convergence. Through simulations, we illustrate that the quantizer performance is close to the best possible Fisher information as the number of quantization bits increases. Furthermore, under certain conditions, the quantizer structure is found to belong to the class of score-function quantizers, which maximizes Fisher information for a given value of the parameter

[1]  P. Strevens Iii , 1985 .

[2]  John N. Tsitsiklis,et al.  Extremal properties of likelihood-ratio quantizers , 1993, IEEE Trans. Commun..

[3]  J. G. Gander,et al.  An introduction to signal detection and estimation , 1990 .

[4]  Lang Tong,et al.  Type based estimation over multiaccess channels , 2006, IEEE Transactions on Signal Processing.

[5]  Zhi-Quan Luo,et al.  Universal decentralized estimation in a bandwidth constrained sensor network , 2005, IEEE Transactions on Information Theory.

[6]  Shun-ichi Amari,et al.  Statistical Inference Under Multiterminal Data Compression , 1998, IEEE Trans. Inf. Theory.

[7]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[8]  Amy R. Reibman,et al.  Design of quantizers for decentralized estimation systems , 1993, IEEE Trans. Commun..

[9]  A. Swami,et al.  Quantization For Distributed Estimation in Large Scale Sensor Networks , 2005, 2005 3rd International Conference on Intelligent Sensing and Information Processing.

[10]  John A. Gubner,et al.  Distributed estimation and quantization , 1993, IEEE Trans. Inf. Theory.

[11]  Alejandro Ribeiro,et al.  Non-parametric distributed quantization-estimation using wireless sensor networks , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[12]  X.R. Li,et al.  Optimal sensor data quantization for best linear unbiased estimation fusion , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).