Sampling and Reconstruction of Graph Signals via Weak Submodularity and Semidefinite Relaxation

We study the problem of sampling a bandlimited graph signal in the presence of noise, where the objective is to select a node subset of prescribed cardinality that minimizes the signal reconstruction mean squared error (MSE). To that end, we formulate the task at hand as the minimization of MSE subject to binary constraints, and approximate the resulting NP-hard problem via semidefinite programming (SDP) relaxation. Moreover, we provide an alternative formulation based on maximizing a monotone weak submodular function and propose a randomized-greedy algorithm to find a sub-optimal subset. We then derive a worst-case performance guarantee on the MSE returned by the randomized greedy algorithm for general non-stationary graph signals. The efficacy of the proposed methods is illustrated through numerical simulations on synthetic and realworld graphs. Notably, the randomized greedy algorithm yields an order-of-magnitude speedup over state-of-the-art greedy sampling schemes, while incurring only a marginal MSE performance loss.

[1]  Sanjeev Arora,et al.  Fast algorithms for approximate semidefinite programming using the multiplicative weights update method , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[2]  Chris Arney Probably Approximately Correct: Nature's Algorithms for Learning and Prospering in a Complex World , 2014 .

[3]  Haris Vikalo,et al.  Sparse linear regression via generalized orthogonal least-squares , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[4]  Benjamin Girault Stationary graph signals using an isometric graph translation , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[5]  Stephen P. Boyd,et al.  Sensor Selection via Convex Optimization , 2009, IEEE Transactions on Signal Processing.

[6]  Pierre Vandergheynst,et al.  Stationary Signal Processing on Graphs , 2016, IEEE Transactions on Signal Processing.

[7]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[8]  Joel A. Tropp,et al.  An Introduction to Matrix Concentration Inequalities , 2015, Found. Trends Mach. Learn..

[9]  Sergio Barbarossa,et al.  On the Graph Fourier Transform for Directed Graphs , 2016, IEEE Journal of Selected Topics in Signal Processing.

[10]  Andreas Krause,et al.  Lazier Than Lazy Greedy , 2014, AAAI.

[11]  Abhimanyu Das,et al.  Submodular meets Spectral: Greedy Algorithms for Subset Selection, Sparse Approximation and Dictionary Selection , 2011, ICML.

[12]  Haris Vikalo,et al.  Greedy Sensor Selection under Channel Uncertainty , 2012, IEEE Wireless Communications Letters.

[13]  Alejandro Ribeiro,et al.  Rethinking sketching as sampling: Linear transforms of graph signals , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[14]  Richard Bellman,et al.  Introduction to Matrix Analysis , 1972 .

[15]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[16]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[17]  Gonzalo Mateos,et al.  A digraph fourier transform with spread frequency components , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[18]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[19]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[20]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[21]  Santiago Segarra,et al.  Stationary Graph Processes and Spectral Estimation , 2016, IEEE Transactions on Signal Processing.

[22]  Sergio Barbarossa,et al.  Signals on Graphs: Uncertainty Principle and Sampling , 2015, IEEE Transactions on Signal Processing.

[23]  José M. F. Moura,et al.  Spectral Projector-Based Graph Fourier Transforms , 2017, IEEE Journal of Selected Topics in Signal Processing.

[24]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[25]  Ilan Shomorony,et al.  Sampling large data on graphs , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[26]  Jelena Kovacevic,et al.  Signal Recovery on Graphs: Fundamental Limits of Sampling Strategies , 2015, IEEE Transactions on Signal and Information Processing over Networks.

[27]  Antonio Ortega,et al.  Submitted to Ieee Transactions on Signal Processing 1 Efficient Sampling Set Selection for Bandlimited Graph Signals Using Graph Spectral Proxies , 2022 .

[28]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[29]  Ufuk Topcu,et al.  A Randomized Greedy Algorithm for Near-Optimal Sensor Scheduling in Large-Scale Sensor Networks , 2017, 2018 Annual American Control Conference (ACC).

[30]  Alejandro Ribeiro,et al.  Greedy Sampling of Graph Signals , 2017, IEEE Transactions on Signal Processing.

[31]  Sundeep Prabhakar Chepuri,et al.  Subsampling for graph power spectrum estimation , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).