Consensus state gram matrix estimation for stochastic switching networks from spectral distribution moments

Reaching distributed average consensus quickly and accurately over a network through iterative dynamics represents an important task in numerous distributed applications. Suitably designed filters applied to the state values can significantly improve the convergence rate. For constant networks, these filters can be viewed in terms of graph signal processing as polynomials in a single matrix, the consensus iteration matrix, with filter response evaluated at its eigenvalues. For random, time-varying networks, filter design becomes more complicated, involving eigendecompositions of sums and products of random, time-varying iteration matrices. This paper focuses on deriving an estimate for the Gram matrix of error in the state vectors over a filtering window for large-scale, stationary, switching random networks. The result depends on the moments of the empirical spectral distribution, which can be estimated through Monte-Carlo simulation. This work then defines a quadratic objective function to minimize the expected consensus estimate error norm. Simulation results provide support for the approximation.

[1]  Béla Bollobás,et al.  Random Graphs , 1985 .

[2]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[3]  José M. F. Moura,et al.  Spectral statistics of lattice graph structured, non-uniform percolations , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  José M. F. Moura,et al.  Optimal Filter Design for Signal Processing on Random Graphs: Accelerated Consensus , 2018, IEEE Transactions on Signal Processing.

[5]  José M. F. Moura,et al.  Graph signal processing: Filter design and spectral statistics , 2017, 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[6]  V. Girko,et al.  Theory of stochastic canonical equations , 2001 .

[7]  Pascal Frossard,et al.  Polynomial Filtering for Fast Convergence in Distributed Consensus , 2008, IEEE Transactions on Signal Processing.

[8]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[9]  Alejandro Ribeiro,et al.  Weak law of large numbers for stationary graph processes , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  J. Moura,et al.  Topology for Global Average Consensus , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[11]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[12]  Geert Leus,et al.  Distributed Autoregressive Moving Average Graph Filters , 2015, IEEE Signal Processing Letters.

[13]  Soummya Kar,et al.  Consensus + innovations distributed inference over networks: cooperation and sensing in networked systems , 2013, IEEE Signal Processing Magazine.

[14]  Panganamala Ramana Kumar,et al.  RHEINISCH-WESTFÄLISCHE TECHNISCHE HOCHSCHULE AACHEN , 2001 .

[15]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[16]  Laura Cottatellucci,et al.  Spectral properties of random matrices for stochastic block model , 2015, 2015 13th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[17]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[18]  Soummya Kar,et al.  Finite-time distributed consensus through graph filters , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[20]  R. Couillet,et al.  Random Matrix Methods for Wireless Communications: Estimation , 2011 .

[21]  Carlos Sagüés,et al.  Chebyshev Polynomials in Distributed Consensus Applications , 2011, IEEE Transactions on Signal Processing.

[22]  Alain Sarlette,et al.  Accelerating Consensus by Spectral Clustering and Polynomial Filters , 2017, IEEE Transactions on Control of Network Systems.