Distributed ADMM for in-network reconstruction of sparse signals with innovations

In this paper, we address the problem of in-network reconstruction of correlated sparse signals. Specifically, we adopt a JSM-1 model by which the signals to be reconstructed are the sum of a common sparse term and an individual sparse term (or innovation). We tackle the problem using an Alternating Direction Method of Multipliers approach, which is prone to be distributed. We also propose a version that requires to exchange only binary messages among neighboring nodes. Performance of the different methods is shown to be satisfactory.

[1]  João M. F. Xavier,et al.  D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization , 2012, IEEE Transactions on Signal Processing.

[2]  Enrico Magli,et al.  Distributed support detection of jointly sparse signals , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Chinmay Hegde,et al.  Texas Hold 'Em algorithms for distributed compressive sensing , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Asuman E. Ozdaglar,et al.  On the O(1=k) convergence of asynchronous distributed alternating Direction Method of Multipliers , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[5]  James T. Kwok,et al.  Asynchronous Distributed ADMM for Consensus Optimization , 2014, ICML.

[6]  Yonina C. Eldar,et al.  Distributed Compressed Sensing for Static and Time-Varying Networks , 2013, IEEE Transactions on Signal Processing.

[7]  Asuman E. Ozdaglar,et al.  Distributed Alternating Direction Method of Multipliers , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[8]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[9]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[10]  Chen Li,et al.  Distributed Compressive Spectrum Sensing in Cooperative Multihop Cognitive Networks , 2011, IEEE Journal of Selected Topics in Signal Processing.

[11]  R.G. Baraniuk,et al.  Distributed Compressed Sensing of Jointly Sparse Signals , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[12]  Georgios B. Giannakis,et al.  Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity , 2010, IEEE Transactions on Signal Processing.

[13]  João M. F. Xavier,et al.  Distributed Basis Pursuit , 2010, IEEE Transactions on Signal Processing.

[14]  J. Borwein,et al.  Convex Analysis And Nonlinear Optimization , 2000 .

[15]  Richard G. Baraniuk,et al.  An Information-Theoretic Approach to Distributed Compressed Sensing ∗ , 2005 .

[16]  Mikael Skoglund,et al.  Distributed greedy pursuit algorithms , 2013, Signal Process..

[17]  Richard G. Baraniuk,et al.  Joint Sparsity Models for Distributed Compressed Sensing , 2005 .

[18]  Massimo Fornasier,et al.  Numerical Methods for Sparse Recovery , 2010 .

[19]  Peter Richtárik,et al.  Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function , 2011, Mathematical Programming.

[20]  Georgios B. Giannakis,et al.  Distributed In-Network Channel Decoding , 2009, IEEE Transactions on Signal Processing.

[21]  João M. F. Xavier,et al.  D-ADMM: A distributed algorithm for compressed sensing and other separable optimization problems , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Enrico Magli,et al.  Joint recovery algorithms using difference of innovations for distributed compressed sensing , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[23]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[24]  Enrico Magli,et al.  Distributed soft thresholding for sparse signal recovery , 2013, 2013 IEEE Global Communications Conference (GLOBECOM).

[25]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[26]  Massimo Fornasier,et al.  Theoretical Foundations and Numerical Methods for Sparse Recovery , 2010, Radon Series on Computational and Applied Mathematics.

[27]  Enrico Magli,et al.  Lossy compression of distributed sparse sources: A practical scheme , 2011, 2011 19th European Signal Processing Conference.

[28]  Qing Ling,et al.  A multi-block alternating direction method with parallel splitting for decentralized consensus optimization , 2012, EURASIP J. Wirel. Commun. Netw..