On Distributed Linear Estimation With Observation Model Uncertainties

We consider distributed estimation of a Gaussian source in a heterogenous bandwidth constrained sensor network, where the source is corrupted by independent multiplicative and additive observation noises. We assume the additive observation noise is zero-mean Gaussian with known variance, however, the system designer is unaware of the distribution of multiplicative observation noise and only knows its first- and second-order moments. For multibit quantizers, we derive an accurate closed-form approximation for the mean-square error (MSE) of the linear minimum MSE) estimator at the fusion center. For both error-free and erroneous communication channels, we propose several rate allocation methods named as longest root to leaf path, greedy, integer relaxation, and individual rate allocation to minimize the MSE given a network bandwidth constraint, and minimize the required network bandwidth given a target MSE. We also derive the Bayesian Cramér–Rao lower bound (CRLB) for an arbitrarily distributed multiplicative observation noise and compare the MSE performance of our proposed methods against the CRLB. Our results corroborate that, for the low-power multiplicative observation noise and adequate network bandwidth, the gaps between the MSE of greedy and integer relaxation methods and the CRLB are negligible, while the MSE of individual rate allocation and uniform methods is not satisfactory. Through analysis and simulations, we also explore why maximum likelihood and maximum a posteriori estimators based on one-bit quantization perform poorly for the low-power additive observation noise.

[1]  Khashayar Kotobi,et al.  Spectrum sharing via hybrid cognitive players evaluated by an M/D/1 queuing model , 2017, EURASIP J. Wirel. Commun. Netw..

[2]  Toby Berger,et al.  An upper bound on the sum-rate distortion function and its corresponding rate allocation schemes for the CEO problem , 2004, IEEE Journal on Selected Areas in Communications.

[3]  Ghassan Al-Regib,et al.  Rate-Constrained Distributed Estimation in Wireless Sensor Networks , 2006, IEEE Transactions on Signal Processing.

[4]  Zhi-Quan Luo,et al.  Universal decentralized estimation in a bandwidth constrained sensor network , 2005, IEEE Transactions on Information Theory.

[5]  Iain B. Collings,et al.  Random Field Reconstruction With Quantization in Wireless Sensor Networks , 2013, IEEE Transactions on Signal Processing.

[6]  Toby Berger,et al.  The quadratic Gaussian CEO problem , 1997, IEEE Trans. Inf. Theory.

[7]  Henry Leung,et al.  A Novel Statistical Model for Distributed Estimation in Wireless Sensor Networks , 2015, IEEE Transactions on Signal Processing.

[8]  Saeed Vahidian,et al.  Network-Coded Two-Way Relaying in Spectrum-Sharing Systems With Quality-of-Service Requirements , 2017, IEEE Transactions on Vehicular Technology.

[9]  Azadeh Vosoughi,et al.  Distributed Vector Estimation for Power- and Bandwidth-Constrained Wireless Sensor Networks , 2015, IEEE Transactions on Signal Processing.

[10]  M. Reza Soleymani,et al.  Distortion sum-rate performance of successive coding strategy in quadratic gaussian CEO problem , 2007, IEEE Transactions on Wireless Communications.

[11]  Alejandro Ribeiro,et al.  Bandwidth-constrained distributed estimation for wireless sensor Networks-part I: Gaussian case , 2006, IEEE Transactions on Signal Processing.

[12]  Xiaokang Lin,et al.  Maximum Likelihood Estimation From Sign Measurements With Sensing Matrix Perturbation , 2013, IEEE Transactions on Signal Processing.

[13]  Mark C. Reed,et al.  On the performance analysis of finite wireless network , 2015, 2015 IEEE International Conference on Communications (ICC).

[14]  Hao He,et al.  On Quantizer Design for Distributed Bayesian Estimation in Sensor Networks , 2014, IEEE Transactions on Signal Processing.

[15]  Ami Wiesel,et al.  Linear Regression With Gaussian Model Uncertainty: Algorithms and Bounds , 2008, IEEE Transactions on Signal Processing.

[16]  Aliazam Abbasfar,et al.  Qos-aware discrete bit loading for OFDMA networks , 2013, 2013 International Conference on Computing, Networking and Communications (ICNC).

[17]  Onkar Dabeer,et al.  Signal Parameter Estimation Using 1-Bit Dithered Quantization , 2006, IEEE Transactions on Information Theory.

[18]  John Taylor,et al.  Discrete Mathematics: Proofs, Structures and Applications, Third Edition , 2009 .

[19]  Rick S. Blum,et al.  Parameter Estimation From Quantized Observations in Multiplicative Noise Environments , 2015, IEEE Transactions on Signal Processing.

[20]  Kenneth E. Barner,et al.  Constrained Decentralized Estimation Over Noisy Channels for Sensor Networks , 2008, IEEE Transactions on Signal Processing.

[21]  Yasutada Oohama,et al.  Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder , 2005, IEEE Transactions on Information Theory.

[22]  Azadeh Vosoughi,et al.  On Quantizer Design for Distributed Estimation in Bandwidth Constrained Networks , 2015, 2015 IEEE 82nd Vehicular Technology Conference (VTC2015-Fall).

[23]  Yonina C. Eldar,et al.  Robust mean-squared error estimation in the presence of model uncertainties , 2005, IEEE Transactions on Signal Processing.

[24]  Andrea J. Goldsmith,et al.  Power scheduling of universal decentralized estimation in sensor networks , 2006, IEEE Transactions on Signal Processing.

[25]  S. Marano,et al.  Quantizer Precision for Distributed Estimation in a Large Sensor Network , 2006, IEEE Transactions on Signal Processing.

[26]  Pramod K. Varshney,et al.  Optimal Identical Binary Quantizer Design for Distributed Estimation , 2012, IEEE Transactions on Signal Processing.

[27]  Yonina C. Eldar Minimax estimation of deterministic parameters in linear models with a random model matrix , 2006, IEEE Transactions on Signal Processing.

[28]  Azadeh Vosoughi,et al.  Bandwidth and power constrained distributed vector estimation in wireless sensor networks , 2015, MILCOM 2015 - 2015 IEEE Military Communications Conference.

[29]  Rowan Garnier,et al.  Discrete mathematics : proofs, structures, and applications , 2010 .

[30]  Babak Hossein Khalaj,et al.  Novel Power Control Algorithms for Underlay Cognitive Radio Networks , 2011, 2011 21st International Conference on Systems Engineering.

[31]  Jun Fang,et al.  Hyperplane-Based Vector Quantization for Distributed Estimation in Wireless Sensor Networks , 2009, IEEE Transactions on Information Theory.

[32]  Luc Vandendorpe,et al.  Power Constrained Linear Estimation in Wireless Sensor Networks With Correlated Data and Digital Modulation , 2012, IEEE Transactions on Signal Processing.

[33]  A. Abbasfar,et al.  Discrete bit-loading for OFDMA downlink with QoS consideration , 2012, 2012 15th International Telecommunications Network Strategy and Planning Symposium (NETWORKS).

[34]  Natalia A. Schmid,et al.  Distributed Estimation of a Parametric Field: Algorithms and Performance Analysis , 2013, IEEE Transactions on Signal Processing.

[35]  Aliazam Abbasfar,et al.  Discrete bit loading and power allocation for OFDMA downlink with minimum rate guarantee for users , 2014 .

[36]  Bernard Widrow,et al.  Quantization Noise: Roundoff Error in Digital Computation, Signal Processing, Control, and Communications , 2008 .

[37]  Ahmed M. Eltawil,et al.  Decentralized Estimation Under Correlated Noise , 2014, IEEE Transactions on Signal Processing.

[38]  Emil Grosswald,et al.  The Theory of Partitions , 1984 .

[39]  Besma Smida,et al.  ComSens: Exploiting pilot diversity for pervasive integration of communication and sensing in MIMO-TDD-Frameworks , 2017, MILCOM 2017 - 2017 IEEE Military Communications Conference (MILCOM).

[40]  Jun Fang,et al.  Distributed Adaptive Quantization for Wireless Sensor Networks: From Delta Modulation to Maximum Likelihood , 2008, IEEE Transactions on Signal Processing.

[41]  Azadeh Vosoughi,et al.  Noise enhanced distributed Bayesian estimation , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[43]  Mohamed-Slim Alouini,et al.  The Effect of Correlated Observations on the Performance of Distributed Estimation , 2013, IEEE Transactions on Signal Processing.

[44]  Stephen P. Boyd,et al.  Sensor Selection via Convex Optimization , 2009, IEEE Transactions on Signal Processing.