Polynomial Filtering for Fast Convergence in Distributed Consensus

In the past few years, the problem of distributed consensus has received a lot of attention, particularly in the framework of ad hoc sensor networks. Most methods proposed in the literature address the consensus averaging problem by distributed linear iterative algorithms, with asymptotic convergence of the consensus solution. The convergence rate of such distributed algorithms typically depends on the network topology and the weights given to the edges between neighboring sensors, as described by the network matrix. In this paper, we propose to accelerate the convergence rate for given network matrices by the use of polynomial filtering algorithms. The main idea of the proposed methodology is to apply a polynomial filter on the network matrix that will shape its spectrum in order to increase the convergence rate. Such an algorithm is equivalent to periodic updates in each of the sensors by aggregating a few of its previous estimates. We formulate the computation of the coefficients of the optimal polynomial as a semidefinite program that can be efficiently and globally solved for both static and dynamic network topologies. We finally provide simulation results that demonstrate the effectiveness of the proposed solutions in accelerating the convergence of distributed consensus averaging problems.

[1]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[2]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[3]  Stephen P. Boyd,et al.  Distributed Average Consensus with Time-Varying Metropolis Weights ? , 2006 .

[4]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[5]  F. Moura Distributed Average Consensus in SensorNetworks withRandomLinkFailures , 2007 .

[6]  Alexandros G. Dimakis,et al.  Geographic Gossip: Efficient Averaging for Sensor Networks , 2007, IEEE Transactions on Signal Processing.

[7]  Pascal Frossard,et al.  Accelerating Distributed Consensus Using Extrapolation , 2007, IEEE Signal Processing Letters.

[8]  R.M. Murray,et al.  Asynchronous Distributed Averaging on Communication Networks , 2007, IEEE/ACM Transactions on Networking.

[9]  Panganamala Ramana Kumar,et al.  RHEINISCH-WESTFÄLISCHE TECHNISCHE HOCHSCHULE AACHEN , 2001 .

[10]  Benjamin Van Roy,et al.  Consensus Propagation , 2005, IEEE Transactions on Information Theory.

[11]  Wen J. Li,et al.  Location-Aided Fast Distributed Consensus , 2007, ArXiv.

[12]  Kyomin Jung,et al.  Fast Gossip via Non-reversible Random Walk , 2006, 2006 IEEE Information Theory Workshop - ITW '06 Punta del Este.

[13]  Soummya Kar,et al.  Distributed Average Consensus in Sensor Networks with Random Link Failures and Communication Channel Noise , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[14]  Alireza Tahbaz-Salehi,et al.  On consensus over random networks , 2006 .

[15]  Stephen P. Boyd,et al.  A space-time diffusion scheme for peer-to-peer least-squares estimation , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[16]  S. Sundaram,et al.  Distributed Consensus and Linear Functional Calculation in Networks: An Observability Perspective , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[17]  Yousef Saad,et al.  Polynomial filtering in latent semantic indexing for information retrieval , 2004, SIGIR '04.

[18]  M. Rabbat,et al.  Decentralized compression and predistribution via randomized gossiping , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[19]  Alireza Tahbaz-Salehi,et al.  A Necessary and Sufficient Condition for Consensus Over Random Networks , 2008, IEEE Transactions on Automatic Control.

[20]  Johan Efberg,et al.  YALMIP : A toolbox for modeling and optimization in MATLAB , 2004 .

[21]  J.N. Tsitsiklis,et al.  Convergence Rates in Distributed Consensus and Averaging , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[22]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[23]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[24]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[25]  Wen J. Li,et al.  Cluster-Based Fast Distributed Consensus , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[26]  T. C. Aysal,et al.  Distributed average consensus with increased convergence rate , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  J.N. Tsitsiklis,et al.  Convergence in Multiagent Coordination, Consensus, and Flocking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[28]  Harris A. Schilling,et al.  Applied Numerical Methods for Engineers Using MATLAB , 1999 .

[29]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[30]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[31]  Alexandros G. Dimakis,et al.  Gossip along the way: order-optimal consensus through randomized path averaging , 2007 .

[32]  Gerard Salton,et al.  Research and Development in Information Retrieval , 1982, Lecture Notes in Computer Science.

[33]  Mehran Mesbahi,et al.  Agreement over random networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[34]  Wen J. Li,et al.  Location-Aided Fast Distributed Consensus in Wireless Networks , 2010, IEEE Transactions on Information Theory.

[35]  Soummya Kar,et al.  Sensor Networks With Random Links: Topology Design for Distributed Consensus , 2007, IEEE Transactions on Signal Processing.

[36]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[37]  S. L. Harris,et al.  Applied Numerical Methods for Engineers Using MATLAB and C , 1999 .

[38]  Jos F. Sturm,et al.  Implementation of interior point methods for mixed semidefinite and second order cone optimization problems , 2002, Optim. Methods Softw..

[39]  A. Scaglione,et al.  Differential Nested Lattice Encoding for Consensus Problems , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[40]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[41]  Fang Chen,et al.  Lifting Markov chains to speed up mixing , 1999, STOC '99.

[42]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.