Signals on Graphs: Uncertainty Principle and Sampling

In many applications, the observations can be represented as a signal defined over the vertices of a graph. The analysis of such signals requires the extension of standard signal processing tools. In this paper, first, we provide a class of graph signals that are maximally concentrated on the graph domain and on its dual. Then, building on this framework, we derive an uncertainty principle for graph signals and illustrate the conditions for the recovery of band-limited signals from a subset of samples. We show an interesting link between uncertainty principle and sampling and propose alternative signal recovery algorithms, including a generalization to frame-based reconstruction methods. After showing that the performance of signal recovery algorithms is significantly affected by the location of samples, we suggest and compare a few alternative sampling strategies. Finally, we provide the conditions for perfect recovery of a useful signal corrupted by sparse noise, showing that this problem is also intrinsically related to vertex-frequency localization properties.

[1]  Vincent Gripon,et al.  Toward an uncertainty principle for weighted graphs , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[2]  Francesco Bullo,et al.  Controllability Metrics, Limitations and Algorithms for Complex Networks , 2013, IEEE Transactions on Control of Network Systems.

[3]  H. Pollak,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — III: The dimension of the space of essentially time- and band-limited signals , 1962 .

[4]  Gene H. Golub,et al.  Numerical methods for computing angles between linear subspaces , 1971, Milestones in Matrix Computation.

[5]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[6]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[7]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[8]  Pengfei Liu,et al.  Local-Set-Based Graph Signal Reconstruction , 2014, IEEE Transactions on Signal Processing.

[9]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[10]  Paul J. Koprowski Finite Frames and Graph Theoretic Uncertainty Principles , 2015 .

[11]  Antonio Ortega,et al.  Towards a sampling theorem for signals on arbitrary graphs , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Sunil K. Narang,et al.  Localized iterative methods for interpolation in graph structured data , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[13]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[14]  M. Randic,et al.  Resistance distance , 1993 .

[15]  R. Duffin,et al.  A class of nonharmonic Fourier series , 1952 .

[16]  Isaac Z. Pesenson,et al.  Sampling, Filtering and Sparse Approximations on Combinatorial Graphs , 2010, ArXiv.

[17]  G. Folland,et al.  The uncertainty principle: A mathematical survey , 1997 .

[18]  D. Donoho,et al.  Uncertainty principles and signal recovery , 1989 .

[19]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[20]  W. G. Hunter,et al.  Experimental Design: Review and Comment , 1984 .

[21]  Sergio Barbarossa,et al.  On the degrees of freedom of signals on graphs , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[22]  F. Chung Laplacians and the Cheeger Inequality for Directed Graphs , 2005 .

[23]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[24]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[25]  Sergio Barbarossa,et al.  On the Graph Fourier Transform for Directed Graphs , 2016, IEEE Journal of Selected Topics in Signal Processing.

[26]  D. Slepian,et al.  Prolate spheroidal wave functions, fourier analysis and uncertainty — II , 1961 .

[27]  慧 廣瀬 A Mathematical Introduction to Compressive Sensing , 2015 .

[28]  Christos Boutsidis,et al.  Faster Subset Selection for Matrices and Applications , 2011, SIAM J. Matrix Anal. Appl..

[29]  Michael G. Rabbat,et al.  Approximating signals supported on graphs , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Sergio Barbarossa,et al.  Uncertainty principle and sampling of signals defined on graphs , 2015, 2015 49th Asilomar Conference on Signals, Systems and Computers.

[31]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[32]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[33]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[34]  Yue M. Lu,et al.  A Spectral Graph Uncertainty Principle , 2012, IEEE Transactions on Information Theory.

[35]  I. Pesenson Sampling in paley-wiener spaces on combinatorial graphs , 2008, 1111.5896.

[36]  Markus Püschel,et al.  Algebraic Signal Processing Theory: Foundation and 1-D Time , 2008, IEEE Transactions on Signal Processing.

[37]  José M. F. Moura,et al.  Algebraic Signal Processing Theory: 1-D Space , 2008, IEEE Transactions on Signal Processing.

[38]  Martin Vetterli,et al.  Near-Optimal Sensor Placement for Linear Inverse Problems , 2013, IEEE Transactions on Signal Processing.

[39]  Isaac Z. Pesenson,et al.  Sampling, splines and frames on compact manifolds , 2014, 1405.7063.

[40]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[41]  R. Coifman,et al.  Diffusion Wavelets , 2004 .

[42]  John J. Benedetto,et al.  Graph theoretic uncertainty principles , 2015, 2015 International Conference on Sampling Theory and Applications (SampTA).

[43]  Sunil K. Narang,et al.  Signal processing techniques for interpolation in graph structured data , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.