Distributed Channel-Aware Quantization Based on Maximum Mutual Information

In distributed sensing systems with constrained communication capabilities, sensors' noisy measurements must be quantized locally before transmitting to the fusion centre. When the same parameter is observed by a number of sensors, the local quantization rules must be jointly designed to optimize a global objective function. In this work we jointly design the local quantizers by maximizing the mutual information as the optimization criterion, so that the quantized measurements carry the most information about the unknown parameter. A low-complexity iterative approach is suggested for finding the local quantization rules. Using the mutual information as the design criterion, we can easily integrate the effect of communication channels in the design and consequently design channel-aware quantization rules. We observe that the optimal design depends on both the measurement and channel noises. Moreover, our algorithm can be used to design quantizers that can be deployed in different applications. We demonstrate the success of our technique through simulating estimation and detection applications, where our method achieves estimation and detection errors as low as when designing for those special purposes.

[1]  Jamal El Abbadi,et al.  A Multiresolution Channel Decomposition for H.264/AVC Unequal Error Protection , 2012 .

[2]  Naftali Tishby,et al.  The information bottleneck method , 2000, ArXiv.

[3]  Bin Liu Channel aware distributed detection in wireless sensor networks , 2006 .

[4]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[5]  R. Gray,et al.  Vector quantization , 1984, IEEE ASSP Magazine.

[6]  Luc Vandendorpe,et al.  Power Constrained Linear Estimation in Wireless Sensor Networks With Correlated Data and Digital Modulation , 2012, IEEE Transactions on Signal Processing.

[7]  P. Wintz,et al.  Quantizing for Noisy Channels , 1969 .

[8]  H. V. Poor,et al.  Applications of Ali-Silvey Distance Measures in the Design of Generalized Quantizers for Binary Decision Systems , 1977, IEEE Trans. Commun..

[9]  Maurizio Longo,et al.  Quantization for decentralized hypothesis testing under communication constraints , 1990, IEEE Trans. Inf. Theory.

[10]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[11]  Ender Ayanoglu,et al.  On optimal quantization of noisy sources , 1990, IEEE Trans. Inf. Theory.

[12]  Robert M. Gray,et al.  A unified approach for encoding clean and noisy sources by means of waveform and autoregressive model vector quantization , 1988, IEEE Trans. Inf. Theory.

[13]  Ioannis D. Schizas,et al.  Distortion-Rate Bounds for Distributed Estimation Using Wireless Sensor Networks , 2008, EURASIP J. Adv. Signal Process..

[14]  Jean-Yves Chouinard,et al.  Progressive Coding and Side Information Updating for Distributed Video Coding , 2012, J. Inf. Hiding Multim. Signal Process..

[15]  T. Duman,et al.  Decentralized detection over multiple-access channels , 1998 .

[16]  Ananthram Swami,et al.  Quantization for Maximin ARE in Distributed Estimation , 2007, IEEE Transactions on Signal Processing.

[17]  S. M. Ali,et al.  A General Class of Coefficients of Divergence of One Distribution from Another , 1966 .

[18]  Lei Liu,et al.  Adaptive Distributed Compressed Video Sensing , 2014, J. Inf. Hiding Multim. Signal Process..

[19]  Toby Berger,et al.  The CEO problem [multiterminal source coding] , 1996, IEEE Trans. Inf. Theory.

[20]  Amy R. Reibman,et al.  Design of quantizers for decentralized estimation systems , 1993, IEEE Trans. Commun..

[21]  Tsachy Weissman,et al.  Multiterminal Source Coding Under Logarithmic Loss , 2011, IEEE Transactions on Information Theory.

[22]  Bin Liu,et al.  Channel-optimized quantizers for decentralized detection in sensor networks , 2006, IEEE Transactions on Information Theory.

[23]  H. Poor,et al.  Fine quantization in signal detection and estimation , 1988, IEEE Trans. Inf. Theory.

[24]  M.L. Fowler,et al.  Fisher-information-based data compression for estimation using two sensors , 2005, IEEE Transactions on Aerospace and Electronic Systems.

[25]  Mehrdad Valipour,et al.  Channel Optimized Distributed Multiple Description Coding , 2012, IEEE Transactions on Signal Processing.

[26]  Mikael Skoglund,et al.  Distributed quantization over noisy channels , 2009, IEEE Transactions on Communications.

[27]  Yunmin Zhu,et al.  An efficient sensor quantization algorithm for decentralized estimation fusion , 2011, Autom..

[28]  Nariman Farvardin,et al.  On the performance and complexity of channel-optimized vector quantizers , 1991, IEEE Trans. Inf. Theory.

[29]  Terrence L. Fine,et al.  Optimum mean-square quantization of a noisy input (Corresp.) , 1965, IEEE Trans. Inf. Theory.

[30]  Richard E. Blahut,et al.  Computation of channel capacity and rate-distortion functions , 1972, IEEE Trans. Inf. Theory.

[31]  Yao Zhao,et al.  Distributed Multiple Description Coding - Principles, Algorithms and Systems , 2011 .

[32]  David G. Messerschmitt,et al.  Quantizing for maximum output entropy (Corresp.) , 1971, IEEE Trans. Inf. Theory.

[33]  John A. Gubner,et al.  Distributed estimation and quantization , 1993, IEEE Trans. Inf. Theory.

[34]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[35]  NARIMAN FARVARDIN,et al.  Optimal quantizer design for noisy channels: An approach to combined source - channel coding , 1987, IEEE Trans. Inf. Theory.

[36]  David L. Neuhoff,et al.  Quantization , 2022, IEEE Trans. Inf. Theory.