Submitted to Ieee Transactions on Signal Processing 1 Efficient Sampling Set Selection for Bandlimited Graph Signals Using Graph Spectral Proxies

We study the problem of selecting the best sampling set for bandlimited reconstruction of signals on graphs. A frequency domain representation for graph signals can be defined using the eigenvectors and eigenvalues of variation operators that take into account the underlying graph connectivity. Smoothly varying signals defined on the nodes are of particular interest in various applications, and tend to be approximately bandlimited in the frequency basis. Sampling theory for graph signals deals with the problem of choosing the best subset of nodes for reconstructing a bandlimited signal from its samples. Most approaches to this problem require a computation of the frequency basis (i.e., the eigenvectors of the variation operator), followed by a search procedure using the basis elements. This can be impractical, in terms of storage and time complexity, for real datasets involving very large graphs. We circumvent this issue in our formulation by introducing quantities called graph spectral proxies, defined using the powers of the variation operator, in order to approximate the spectral content of graph signals. This allows us to formulate a direct sampling set selection approach that does not require the computation and storage of the basis elements. We show that our approach also provides stable reconstruction when the samples are noisy or when the original signal is only approximately bandlimited. Furthermore, the proposed approach is valid for any choice of the variation operator, thereby covering a wide range of graphs and applications. We demonstrate its effectiveness through various numerical experiments.

[1]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[2]  I. Pesenson Sampling in paley-wiener spaces on combinatorial graphs , 2008, 1111.5896.

[3]  Dorin Bucur,et al.  Optimal Partitions for Eigenvalues , 2009, SIAM J. Sci. Comput..

[4]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[5]  Antonio Ortega,et al.  Towards a sampling theorem for signals on arbitrary graphs , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  D. Sorensen Numerical methods for large eigenvalue problems , 2002, Acta Numerica.

[7]  F. Chung Laplacians and the Cheeger Inequality for Directed Graphs , 2005 .

[8]  Sunil K. Narang,et al.  Compact Support Biorthogonal Wavelet Filterbanks for Arbitrary Undirected Graphs , 2012, IEEE Transactions on Signal Processing.

[9]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[10]  Pierre Vandergheynst,et al.  Random sampling of bandlimited signals on graphs , 2015, NIPS 2015.

[11]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[12]  Sunil K. Narang,et al.  Localized iterative methods for interpolation in graph structured data , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[13]  W. Haemers Interlacing eigenvalues and graphs , 1995 .

[14]  Andrew V. Knyazev,et al.  Toward the Optimal Preconditioned Eigensolver: Locally Optimal Block Preconditioned Conjugate Gradient Method , 2001, SIAM J. Sci. Comput..

[15]  Stephen P. Boyd,et al.  Sensor Selection via Convex Optimization , 2009, IEEE Transactions on Signal Processing.

[16]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[17]  Sunil K. Narang,et al.  Bilateral filter: Graph spectral interpretation and extensions , 2013, 2013 IEEE International Conference on Image Processing.

[18]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[19]  K. Gröchenig A discrete theory of irregular sampling , 1993 .

[20]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[21]  Pengfei Liu,et al.  Local-Set-Based Graph Signal Reconstruction , 2014, IEEE Transactions on Signal Processing.

[22]  Isaac Z. Pesenson,et al.  Variational Splines and Paley–Wiener Spaces on Combinatorial Graphs , 2009, ArXiv.

[23]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[24]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[25]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[26]  Minh N. Do,et al.  Downsampling of Signals on Graphs Via Maximum Spanning Trees , 2015, IEEE Transactions on Signal Processing.

[27]  Ilan Shomorony,et al.  Sampling large data on graphs , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[28]  Thomas Hofmann,et al.  Semi-supervised Learning on Directed Graphs , 2004, NIPS.

[29]  Y. Saad Numerical Methods for Large Eigenvalue Problems , 2011 .

[30]  Sunil K. Narang,et al.  Signal processing techniques for interpolation in graph structured data , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[31]  Sergio Barbarossa,et al.  Signals on Graphs: Uncertainty Principle and Sampling , 2015, IEEE Transactions on Signal Processing.

[32]  Braxton Osting,et al.  Minimal Dirichlet Energy Partitions for Graphs , 2013, SIAM J. Sci. Comput..

[33]  Y. Saad,et al.  Numerical Methods for Large Eigenvalue Problems , 2011 .

[34]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[35]  Antonio Ortega,et al.  Active semi-supervised learning using sampling theory for graph signals , 2014, KDD.

[36]  Antonio Ortega,et al.  Edge-adaptive depth map coding with lifting transform on graphs , 2015, 2015 Picture Coding Symposium (PCS).

[37]  Sunil K. Narang,et al.  Graph-wavelet filterbanks for edge-aware image processing , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[38]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[39]  Bernhard Schölkopf,et al.  Learning from labeled and unlabeled data on a directed graph , 2005, ICML.

[40]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[41]  Yonina C. Eldar Sampling with Arbitrary Sampling and Reconstruction Spaces and Oblique Dual Frame Vectors , 2003 .

[42]  Andrew Knyazev,et al.  Angles between infinite dimensional subspaces with applications to the Rayleigh-Ritz and alternating projectors methods ✩ , 2007, 0705.1023.

[43]  J. Kovacevic,et al.  Sampling theory for graph signals , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[44]  Sergio Barbarossa,et al.  Uncertainty principle and sampling of signals defined on graphs , 2015, 2015 49th Asilomar Conference on Signals, Systems and Computers.

[45]  Sunil K. Narang,et al.  Local two-channel critically sampled filter-banks on graphs , 2010, 2010 IEEE International Conference on Image Processing.