A Distributed Tracking Algorithm for Reconstruction of Graph Signals

The rapid development of signal processing on graphs provides a new perspective for processing large-scale data associated with irregular domains. In many practical applications, it is necessary to handle massive data sets through complex networks, in which most nodes have limited computing power. Designing efficient distributed algorithms is critical for this task. This paper focuses on the distributed reconstruction of a time-varying bandlimited graph signal based on observations sampled at a subset of selected nodes. A distributed least square reconstruction (DLSR) algorithm is proposed to recover the unknown signal iteratively, by allowing neighboring nodes to communicate with one another and make fast updates. DLSR uses a decay scheme to annihilate the out-of-band energy occurring in the reconstruction process, which is inevitably caused by the transmission delay in distributed systems. Proof of convergence and error bounds for DLSR are provided in this paper, suggesting that the algorithm is able to track time-varying graph signals and perfectly reconstruct time-invariant signals. The DLSR algorithm is numerically experimented with synthetic data and real-world sensor network data, which verifies its ability in tracking slowly time-varying graph signals.

[1]  Isaac Z. Pesenson,et al.  Sampling, Filtering and Sparse Approximations on Combinatorial Graphs , 2010, ArXiv.

[2]  Louette R. Johnson Lutjens Research , 2006 .

[3]  K. Gröchenig A discrete theory of irregular sampling , 1993 .

[4]  Hans G. Feichtinger,et al.  Theory and practice of irregular sampling , 2021, Wavelets.

[5]  C. Guestrin,et al.  Distributed regression: an efficient framework for modeling sensor network data , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[6]  Pengfei Liu,et al.  Graph signal coarsening: Dimensionality reduction in irregular domain , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[7]  O. Christensen An introduction to frames and Riesz bases , 2002 .

[8]  Isaac Z. Pesenson,et al.  Variational Splines and Paley–Wiener Spaces on Combinatorial Graphs , 2009, ArXiv.

[9]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[10]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[11]  José M. F. Moura,et al.  Adaptive graph filtering: Multiresolution classification on graphs , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[12]  Pengfei Liu,et al.  Iterative reconstruction of graph signal in low-frequency subspace , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[13]  Sunil K. Narang,et al.  Graph-wavelet filterbanks for edge-aware image processing , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[14]  Pierre Vandergheynst,et al.  A Framework for Multiscale Transforms on Graphs , 2013, arXiv.org.

[15]  Pascal Frossard,et al.  Parametric dictionary learning for graph signals , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[16]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[17]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[18]  Carlos Guestrin,et al.  A robust architecture for distributed inference in sensor networks , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[19]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[20]  F. Marvasti Nonuniform sampling : theory and practice , 2001 .

[21]  Jan P. Allebach,et al.  Iterative reconstruction of bandlimited images from nonuniformly spaced samples , 1987 .

[22]  Sunil K. Narang,et al.  Signal processing techniques for interpolation in graph structured data , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Antonio Ortega,et al.  Towards a sampling theorem for signals on arbitrary graphs , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Reza Olfati-Saber,et al.  Distributed Kalman filtering for sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[25]  Michael G. Rabbat,et al.  Graph spectral compressed sensing for sensor networks , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Farrokh Marvasti,et al.  Recovery of signals from nonuniform samples using iterative methods , 1991, IEEE Trans. Signal Process..

[27]  Pengfei Liu,et al.  Coarsening graph signal with spectral invariance , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[29]  Kannan Ramchandran,et al.  Multiresolution graph signal processing via circulant structures , 2013, 2013 IEEE Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[30]  Pascal Frossard,et al.  Chebyshev polynomial approximation for distributed signal processing , 2011, 2011 International Conference on Distributed Computing in Sensor Systems and Workshops (DCOSS).

[31]  J. Benedetto Irregular sampling and frames , 1993 .

[32]  K. Gröchenig RECONSTRUCTION ALGORITHMS IN IRREGULAR SAMPLING , 1992 .

[33]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[34]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[35]  Boris Polyak,et al.  The method of projections for finding the common point of convex sets , 1967 .

[36]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[37]  Pierre Vandergheynst,et al.  A Multiscale Pyramid Transform for Graph Signals , 2013, IEEE Transactions on Signal Processing.

[38]  Peter F. Stadler,et al.  Laplacian Eigenvectors of Graphs , 2007 .

[39]  Sunil K. Narang,et al.  Localized iterative methods for interpolation in graph structured data , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[40]  Michael G. Rabbat,et al.  Approximating signals supported on graphs , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  Yakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Principles and Techniques , 1995 .

[42]  Pengfei Liu,et al.  Local-Set-Based Graph Signal Reconstruction , 2014, IEEE Transactions on Signal Processing.

[43]  Yue M. Lu,et al.  A Spectral Graph Uncertainty Principle , 2012, IEEE Transactions on Information Theory.

[44]  I. Pesenson Sampling in paley-wiener spaces on combinatorial graphs , 2008, 1111.5896.

[45]  W. Cheney,et al.  Proximity maps for convex sets , 1959 .