Parameter Estimation From Quantized Observations in Multiplicative Noise Environments

The problem of distributed parameter estimation from binary quantized observations is studied when the unquantized observations are corrupted by combined multiplicative and additive Gaussian noise. These results are applicable to sensor networks where the sensors observe a parameter in combined additive and nonadditive noise and to a case where dispersed receivers are employed with analog communication over fading channels where the receivers employ binary quantization before noise-free digital communications to a fusion center. We first discuss the case in which all the quantizers use an identical threshold. The parameter identifiability condition is given, and, surprisingly, it is shown that unless the common threshold is chosen properly and the parameter lies in an open interval, the parameter will not generally be identifiable, in contrast to the additive noise case. The best achievable mean square error (MSE) performance is characterized by deriving the corresponding Cramér-Rao Lower Bound (CRLB). A closed-form expression describing the corresponding maximum likelihood (ML) estimator is presented. The stability of the performance of the ML estimators is improved when a nonidentical threshold strategy is utilized to estimate the unknown parameter. The thresholds are designed by maximizing the minimum asymptotic relative efficiency (ARE) between quantized and unquantized ML estimators. Although the ML estimation problem is nonconvex, it is shown that one can relax the optimization to make it convex. The solution to the relaxed problem is used as an initial solution in a gradient algorithm to solve the original problem. Next, the case where both the variances of the additive noise and multiplicative noise are unknown is studied. The corresponding CRLB is obtained, and the ML estimation problem is transformed to a convex optimization, which can be solved efficiently. Finally, numerical simulations are performed to substantiate the theoretical analysis.

[1]  A. Swami,et al.  Quantization For Distributed Estimation in Large Scale Sensor Networks , 2005, 2005 3rd International Conference on Intelligent Sensing and Information Processing.

[2]  Pramod K. Varshney,et al.  Theory of the Stochastic Resonance Effect in Signal Detection—Part II: Variable Detectors , 2007, IEEE Transactions on Signal Processing.

[3]  François Chapeau-Blondeau,et al.  Suprathreshold stochastic resonance and noise-enhanced Fisher information in arrays of threshold devices. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Krishna R. Pattipati,et al.  IMM estimation for multitarget-multisensor air traffic surveillance , 1997 .

[5]  Zhi-Quan Luo,et al.  Universal decentralized estimation in a bandwidth constrained sensor network , 2005, IEEE Transactions on Information Theory.

[6]  Iickho Song,et al.  Locally optimum detection of signals in a generalized observation model: The known signal case , 1990, IEEE Trans. Inf. Theory.

[7]  Sinan Gezici,et al.  On the Performance of Single-Threshold Detectors for Binary Communications in the Presence of Gaussian Mixture Noise , 2010, IEEE Transactions on Communications.

[8]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[9]  Jun Fang,et al.  Hyperplane-Based Vector Quantization for Distributed Estimation in Wireless Sensor Networks , 2009, IEEE Transactions on Information Theory.

[10]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[11]  P.K. Varshney,et al.  Target Location Estimation in Sensor Networks With Quantized Data , 2006, IEEE Transactions on Signal Processing.

[12]  Gordon L. Stüber Principles of mobile communication , 1996 .

[13]  Xiaokang Lin,et al.  Maximum Likelihood Estimation From Sign Measurements With Sensing Matrix Perturbation , 2013, IEEE Transactions on Signal Processing.

[14]  Zhi-Quan Luo An isotropic universal decentralized estimation scheme for a bandwidth constrained ad hoc sensor network , 2005, IEEE J. Sel. Areas Commun..

[15]  Ananthram Swami,et al.  Quantization for Maximin ARE in Distributed Estimation , 2007, IEEE Transactions on Signal Processing.

[16]  Carlos Alberto de Bragança Pereira,et al.  ON IDENTIFIABILITY OF PARAMETRIC STATISTICAL MODELS , 1994 .

[17]  John P. Miller,et al.  Broadband neural encoding in the cricket cereal sensory system enhanced by stochastic resonance , 1996, Nature.

[18]  Nikos D. Sidiropoulos,et al.  Sparse Conjoint Analysis Through Maximum Likelihood Estimation , 2013, IEEE Transactions on Signal Processing.

[19]  G. Giannakis,et al.  Kalman Filtering in Wireless Sensor Networks , 2010, IEEE Control Systems.

[20]  Frank Moss,et al.  Noise enhancement of information transfer in crayfish mechanoreceptors by stochastic resonance , 1993, Nature.

[21]  William Bialek,et al.  Information flow in sensory neurons , 1995 .

[22]  Jun Fang,et al.  Distributed Adaptive Quantization for Wireless Sensor Networks: From Delta Modulation to Maximum Likelihood , 2008, IEEE Transactions on Signal Processing.

[23]  Petre Stoica,et al.  Approximate maximum likelihood estimators for array processing in multiplicative noise environments , 2000, IEEE Trans. Signal Process..

[24]  Onkar Dabeer,et al.  Signal Parameter Estimation Using 1-Bit Dithered Quantization , 2006, IEEE Transactions on Information Theory.

[25]  Y. Bar-Shalom,et al.  IMM estimation for multitarget-multisensor air traffic surveillance , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[26]  Alejandro Ribeiro,et al.  Bandwidth-constrained distributed estimation for wireless sensor networks-part II: unknown probability density function , 2006, IEEE Transactions on Signal Processing.

[27]  Iickho Song,et al.  Locally optimum detection of signals in a generalized observation model: The random signal case , 1990, IEEE Trans. Inf. Theory.

[28]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[29]  Ami Wiesel,et al.  Linear Regression With Gaussian Model Uncertainty: Algorithms and Bounds , 2008, IEEE Transactions on Signal Processing.

[30]  M.L. Fowler,et al.  Fisher-information-based data compression for estimation using two sensors , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[31]  Ami Wiesel,et al.  Maximum likelihood estimation in linear models with a Gaussian model matrix , 2006, IEEE Signal Processing Letters.

[32]  E. Lehmann Elements of large-sample theory , 1998 .

[33]  Alejandro Ribeiro,et al.  Bandwidth-constrained distributed estimation for wireless sensor Networks-part I: Gaussian case , 2006, IEEE Transactions on Signal Processing.

[34]  J.E. Mazo,et al.  Digital communications , 1985, Proceedings of the IEEE.

[35]  Zhi-Quan Luo,et al.  Decentralized estimation in an inhomogeneous sensing environment , 2005, IEEE Transactions on Information Theory.

[36]  Sukun Kim,et al.  Health Monitoring of Civil Infrastructures Using Wireless Sensor Networks , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[37]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[38]  Haralabos C. Papadopoulos,et al.  Sequential signal encoding from noisy measurements using quantizers with dynamic bias control , 2001, IEEE Trans. Inf. Theory.

[39]  Abebe Geletu,et al.  Solving Optimization Problems using the Matlab Optimization Toolbox - a Tutorial , 2007 .

[40]  Hugh F. Durrant-Whyte,et al.  A Fully Decentralized Multi-Sensor System For Tracking and Surveillance , 1993, Int. J. Robotics Res..

[41]  Thomas L. Marzetta,et al.  Parameter estimation problems with singular information matrices , 2001, IEEE Trans. Signal Process..

[42]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[43]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[44]  Sinan Gezici,et al.  CRLB Based Optimal Noise Enhanced Parameter Estimation Using Quantized Observations , 2010, IEEE Signal Processing Letters.

[45]  Pramod K. Varshney,et al.  Theory of the Stochastic Resonance Effect in Signal Detection: Part I—Fixed Detectors , 2007, IEEE Transactions on Signal Processing.