Optimal Filter Design for Signal Processing on Random Graphs: Accelerated Consensus

In graph signal processing, filters arise from polynomials in shift matrices that respect the graph structure, such as the graph adjacency matrix or the graph Laplacian matrix. Hence, filter design for graph signal processing benefits from knowledge of the spectral decomposition of these matrices. Often, stochastic influences affect the network structure and, consequently, the shift matrix empirical spectral distribution. Although the joint distribution of the shift matrix eigenvalues is typically inaccessible, deterministic functions that asymptotically approximate the matrix empirical spectral distribution can be found for suitable random graph models using tools from random matrix theory. We employ this information regarding the density of eigenvalues to develop criteria for optimal graph filter design. In particular, we consider filter design for distributed average consensus and related problems, leading to improvements in short-term error minimization or in asymptotic convergence rate.

[1]  L. Trefethen,et al.  Barycentric-Remez algorithms for best polynomial approximation in the chebfun system , 2009 .

[2]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[3]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[4]  Z. Bai METHODOLOGIES IN SPECTRAL ANALYSIS OF LARGE DIMENSIONAL RANDOM MATRICES , A REVIEW , 1999 .

[5]  Alain Sarlette,et al.  Accelerating Consensus by Spectral Clustering and Polynomial Filters , 2017, IEEE Transactions on Control of Network Systems.

[6]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[7]  Carlos Sagüés,et al.  Chebyshev Polynomials in Distributed Consensus Applications , 2011, IEEE Transactions on Signal Processing.

[8]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[9]  R. Olfati-Saber Ultrafast consensus in small-world networks , 2005, Proceedings of the 2005, American Control Conference, 2005..

[10]  J. Moura,et al.  Topology for Global Average Consensus , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[11]  Soummya Kar,et al.  Finite-time distributed consensus through graph filters , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  E. Wigner On the Distribution of the Roots of Certain Symmetric Matrices , 1958 .

[13]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[14]  H. Poincaré,et al.  Percolation ? , 1982 .

[15]  R. Couillet,et al.  Random Matrix Methods for Wireless Communications: Estimation , 2011 .

[16]  C.N. Hadjicostis,et al.  Finite-Time Distributed Consensus in Graphs with Time-Invariant Topologies , 2007, 2007 American Control Conference.

[17]  Soummya Kar,et al.  Consensus + innovations distributed inference over networks: cooperation and sensing in networked systems , 2013, IEEE Signal Processing Magazine.

[18]  Antonia Maria Tulino,et al.  Random Matrix Theory and Wireless Communications , 2004, Found. Trends Commun. Inf. Theory.

[19]  V. Girko,et al.  Theory of stochastic canonical equations , 2001 .

[20]  C. Tracy,et al.  The Distribution of the Largest Eigenvalue in the Gaussian Ensembles: β = 1, 2, 4 , 1997, solv-int/9707001.

[21]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[22]  Alejandro Ribeiro,et al.  Weak law of large numbers for stationary graph processes , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[24]  Pascal Frossard,et al.  Polynomial Filtering for Fast Convergence in Distributed Consensus , 2008, IEEE Transactions on Signal Processing.

[25]  Laura Cottatellucci,et al.  Spectral properties of random matrices for stochastic block model , 2015, 2015 13th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[26]  José M. F. Moura,et al.  Spectral Statistics of Lattice Graph Percolation Models , 2016, ArXiv.

[27]  Béla Bollobás,et al.  Random Graphs , 1985 .

[28]  José M. F. Moura,et al.  Spectral statistics of lattice graph structured, non-uniform percolations , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Tiefeng Jiang,et al.  SPECTRAL DISTRIBUTIONS OF ADJACENCY AND LAPLACIAN MATRICES OF RANDOM GRAPHS , 2010, 1011.2608.

[30]  Geert Leus,et al.  Distributed Autoregressive Moving Average Graph Filters , 2015, IEEE Signal Processing Letters.

[31]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.