Practical graph signal sampling with log-linear size scaling

Graph signal sampling is the problem of selecting a subset of representative graph vertices whose values can be used to interpolate missing values on the remaining graph vertices. Optimizing the choice of sampling set can help minimize the effect of noise in the input signal. While many existing sampling set selection methods are computationally intensive because they require an eigendecomposition, existing eigendecompostion-free methods are still much slower than random sampling algorithms for large graphs. In this paper, we propose a sampling algorithm that can achieve speeds similar to random sampling, while reaching accuracy similar to existing eigendecomposition-free methods for a broad range of graph types. Keywords—Graph, signal, sampling, D-optimal, volume, coherence.

[1]  T. Minka Inferring a Gaussian distribution , 2001 .

[2]  Sunil K. Narang,et al.  Localized iterative methods for interpolation in graph structured data , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[3]  Alexander Jung,et al.  Localized Linear Regression in Networked Data , 2019, IEEE Signal Processing Letters.

[4]  Alexander Jung,et al.  Random walk sampling for big data over networks , 2017, 2017 International Conference on Sampling Theory and Applications (SampTA).

[5]  Malik Magdon-Ismail,et al.  On selecting a maximum volume sub-matrix of a matrix and related problems , 2009, Theor. Comput. Sci..

[6]  Yuanchao Bai,et al.  Fast Graph Sampling Set Selection Using Gershgorin Disc Alignment , 2019, IEEE Transactions on Signal Processing.

[7]  Alexander Jung,et al.  Graph Signal Sampling via Reinforcement Learning , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  I. Pesenson Sampling in paley-wiener spaces on combinatorial graphs , 2008, 1111.5896.

[9]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[10]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[11]  Eli Upfal,et al.  The Web as a graph , 2000, PODS.

[12]  Mark Crovella,et al.  Graph wavelets for spatial traffic analysis , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[13]  Antonio Ortega,et al.  A probabilistic interpretation of sampling theory of graph signals , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[15]  A. Berlinet,et al.  Reproducing kernel Hilbert spaces in probability and statistics , 2004 .

[16]  Antonio Ortega,et al.  Submitted to Ieee Transactions on Signal Processing 1 Efficient Sampling Set Selection for Bandlimited Graph Signals Using Graph Spectral Proxies , 2022 .

[17]  Henry P. Wynn,et al.  Maximum entropy sampling , 1987 .

[18]  Ilan Shomorony,et al.  Sampling large data on graphs , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[19]  Pierre Vandergheynst,et al.  GSPBOX: A toolbox for signal processing on graphs , 2014, ArXiv.

[20]  Pierre-Olivier Amblard,et al.  Graph sampling with determinantal processes , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[21]  S. Goreinov,et al.  How to find a good submatrix , 2010 .

[22]  Stephen P. Boyd,et al.  Sensor Selection via Convex Optimization , 2009, IEEE Transactions on Signal Processing.

[23]  Daniel L. Lau,et al.  Blue-Noise Sampling on Graphs , 2019, IEEE Transactions on Signal and Information Processing over Networks.

[24]  Gene Cheung,et al.  A-Optimal Sampling and Robust Reconstruction for Graph Signals via Truncated Neumann Series , 2018, IEEE Signal Processing Letters.

[25]  Yonina C. Eldar,et al.  Sampling Signals on Graphs: From Theory to Applications , 2020, IEEE Signal Processing Magazine.

[26]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[27]  Alejandro Ribeiro,et al.  Greedy Sampling of Graph Signals , 2017, IEEE Transactions on Signal Processing.

[28]  Toshihisa Tanaka,et al.  Eigendecomposition-Free Sampling Set Selection for Graph Signals , 2018, IEEE Transactions on Signal Processing.

[29]  Pierre Vandergheynst,et al.  Random sampling of bandlimited signals on graphs , 2015, NIPS 2015.

[30]  Antonio Ortega,et al.  Grasp: A matlab toolbox for graph signal processing , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Alejandro Parada-Mayorga Blue noise and optimal sampling on graphs , 2019 .

[32]  Antonio Ortega,et al.  A Distance-Based Formulation for Sampling Signals on Graphs , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  Sergio Barbarossa,et al.  Signals on Graphs: Uncertainty Principle and Sampling , 2015, IEEE Transactions on Signal Processing.

[34]  Luis Rademacher,et al.  Efficient Volume Sampling for Row/Column Subset Selection , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[35]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.