A-Optimal Sampling and Robust Reconstruction for Graph Signals via Truncated Neumann Series

Graph signal processing (GSP) studies signals that live on irregular data kernels described by graphs. One fundamental problem in GSP is sampling—from which subset of graph nodes to collect samples in order to reconstruct a bandlimited graph signal in high fidelity. In this letter, we seek a sampling strategy that minimizes the mean square error (MSE) of the reconstructed bandlimited graph signals assuming an independent and identically distributed noise model—leading naturally to the A-optimal design criterion. To avoid matrix inversion, we first prove that the inverse of the information matrix in the A-optimal criterion is equivalent to a Neumann matrix series. We then transform the truncated Neumann series-based sampling problem into an equivalent expression that replaces eigenvectors of the Laplacian operator with a submatrix of an ideal low-pass graph filter. Finally, we approximate the ideal filter using a Chebyshev matrix polynomial. We design a greedy algorithm to iteratively minimize the simplified objective. For signal reconstruction, we propose an accompanied signal reconstruction strategy that reuses the approximated filter submatrix and is provably more robust than conventional least square recovery. Simulation results show that our sampling strategy outperforms two previous strategies in MSE performance at comparable complexity.

[1]  J. Kovacevic,et al.  Sampling theory for graph signals , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Alejandro Ribeiro,et al.  Rethinking Sketching as Sampling: A Graph Signal Processing Approach , 2016, Signal Process..

[3]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[4]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[5]  F. Pukelsheim Optimal Design of Experiments , 1993 .

[6]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[7]  Alejandro Ribeiro,et al.  Greedy Sampling of Graph Signals , 2017, IEEE Transactions on Signal Processing.

[8]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[9]  Ilan Shomorony,et al.  Sampling large data on graphs , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[10]  Pierre Vandergheynst,et al.  GSPBOX: A toolbox for signal processing on graphs , 2014, ArXiv.

[11]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[12]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[13]  Antonio Ortega,et al.  Towards a sampling theorem for signals on arbitrary graphs , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Antonio Ortega,et al.  Submitted to Ieee Transactions on Signal Processing 1 Efficient Sampling Set Selection for Bandlimited Graph Signals Using Graph Spectral Proxies , 2022 .

[15]  Pierre Vandergheynst,et al.  Random sampling of bandlimited signals on graphs , 2015, NIPS 2015.

[16]  I. Pesenson Sampling in paley-wiener spaces on combinatorial graphs , 2008, 1111.5896.

[17]  Sergio Barbarossa,et al.  Signals on Graphs: Uncertainty Principle and Sampling , 2015, IEEE Transactions on Signal Processing.

[18]  Sunil K. Narang,et al.  Localized iterative methods for interpolation in graph structured data , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[19]  Virginia Vassilevska Williams Multiplying matrices in O(n 2:373 ) time , 2014 .

[20]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[21]  E. S. Coakley,et al.  A fast divide-and-conquer algorithm for computing the spectra of real symmetric tridiagonal matrices , 2013 .

[22]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[23]  Antonio Ortega,et al.  Active semi-supervised learning using sampling theory for graph signals , 2014, KDD.