1-bit Compressive Diffusion in Networks Based on Bayesian Inference

Compressive diffusion strategy, especially the 1-bit compressive diffusion, has the potential to greatly reduce the communication load between nodes in a network for distributed parameter estimation. However, how to deal with the hybrid data, i.e., the 1-bit quantized external information from other nodes and the high-precision local data, has heavy impact on the overall estimation performance. Most existing estimation algorithms based on Least Mean Square (LMS) cannot work very well in such a context, i.e., the combination of the above information is not guaranteed beneficial in general unless certain combination rule is properly chosen. In this paper, from a perspective of Bayesian inference framework instead, a parameter estimation algorithm is proposed for 1-bit compressive diffusion. Based on the vertex-message inference, the inherent combination policy assigns different weights to measurements depending on their data types and degrees of uncertainty. In this way, nodes in the network can always take advantage of the extra information in 1-bit exchanged data to enhance the accuracy of local estimation, and at the same time avoid any possible performance loss caused by the high uncertainty of compressive data.

[1]  Wen-An Zhang,et al.  Distributed consensus-based Kalman filtering in sensor networks with quantised communications and random sensor failures , 2014, IET Signal Process..

[2]  Sundeep Rangan,et al.  Generalized approximate message passing for estimation with random linear mixing , 2010, 2011 IEEE International Symposium on Information Theory Proceedings.

[3]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[4]  Suleyman Serdar Kozat,et al.  Compressive Diffusion Strategies Over Distributed Networks for Reduced Communication Load , 2014, IEEE Transactions on Signal Processing.

[5]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[6]  Giuseppe Notarstefano,et al.  A Bayesian Framework for Distributed Estimation of Arrival Rates in Asynchronous Networks , 2016, IEEE Transactions on Signal Processing.

[7]  Ali H. Sayed,et al.  Performance Limits for Distributed Estimation Over LMS Adaptive Networks , 2012, IEEE Transactions on Signal Processing.

[8]  H.-A. Loeliger,et al.  An introduction to factor graphs , 2004, IEEE Signal Process. Mag..

[9]  Shi Jin,et al.  Bayes-Optimal Joint Channel-and-Data Estimation for Massive MIMO With Low-Precision ADCs , 2015, IEEE Transactions on Signal Processing.

[10]  Ali H. Sayed,et al.  Diffusion strategies for adaptation and learning over networks: an examination of distributed strategies and network behavior , 2013, IEEE Signal Processing Magazine.

[11]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks: Quantized Data and Random Link Failures , 2007, IEEE Transactions on Signal Processing.

[12]  Ali H. Sayed,et al.  Diffusion Adaptation Over Networks Under Imperfect Information Exchange and Non-Stationary Data , 2011, IEEE Transactions on Signal Processing.

[13]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[14]  Gregory J. Pottie,et al.  Instrumenting the world with wireless sensor networks , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[15]  Suleyman Serdar Kozat,et al.  Single Bit and Reduced Dimension Diffusion Strategies Over Distributed Networks , 2013, IEEE Signal Processing Letters.

[16]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[17]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[18]  Yu Hen Hu,et al.  Detection, classification, and tracking of targets , 2002, IEEE Signal Process. Mag..

[19]  Ali H. Sayed,et al.  On the Influence of Informed Agents on Learning and Adaptation Over Networks , 2012, IEEE Transactions on Signal Processing.

[20]  Caijun Zhong,et al.  One-Bit Quantized Massive MIMO Detection Based on Variational Approximate Message Passing , 2018, IEEE Transactions on Signal Processing.