Rethinking sketching as sampling: Efficient approximate solution to linear inverse problems

Sampling and reconstruction of bandlimited graph signals have well-appreciated merits for dimensionality reduction, affordable storage, and online processing of streaming network data. However, these parsimonious signals are oftentimes encountered with high-dimensional linear inverse problems. Hence, interest shifts from reconstructing the signal itself towards instead approximating the input to a prescribed linear operator efficiently. In this context, we propose a novel sampling scheme that leverages the bandlimitedness of the output as well as the transformation whose input we wish to approximate. We formulate problems to jointly optimize sample selection and a sketch of the target inverse mapping, so when the latter is affordably applied to the sampled output signal, the result is close to the desired input. The developed sampling plus reduced-complexity processing pipeline is particularly useful for streaming data, where the linear transform has to be applied fast and repeatedly to successive response signals.

[1]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[2]  Santiago Segarra,et al.  Stationary Graph Processes and Spectral Estimation , 2016, IEEE Transactions on Signal Processing.

[3]  Isaac Z. Pesenson,et al.  Sampling, Filtering and Sparse Approximations on Combinatorial Graphs , 2010, ArXiv.

[4]  Markus Püschel,et al.  Algebraic Signal Processing Theory: Foundation and 1-D Time , 2008, IEEE Transactions on Signal Processing.

[5]  David P. Woodruff Sketching as a Tool for Numerical Linear Algebra , 2014, Found. Trends Theor. Comput. Sci..

[6]  Georgios B. Giannakis,et al.  Online Censoring for Large-Scale Regressions with Application to Streaming Big Data , 2015, IEEE Transactions on Signal Processing.

[7]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[8]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs , 2012, IEEE Transactions on Signal Processing.

[9]  Sergio Barbarossa,et al.  Signals on Graphs: Uncertainty Principle and Sampling , 2015, IEEE Transactions on Signal Processing.

[10]  Sundeep Prabhakar Chepuri,et al.  Sensor Selection for Estimation with Correlated Measurement Noise , 2015, IEEE Transactions on Signal Processing.

[11]  José M. F. Moura,et al.  Big Data Analysis with Signal Processing on Graphs: Representation and processing of massive data sets with irregular structure , 2014, IEEE Signal Processing Magazine.

[12]  Sunil K. Narang,et al.  Perfect Reconstruction Two-Channel Wavelet Filter Banks for Graph Structured Data , 2011, IEEE Transactions on Signal Processing.

[13]  Jelena Kovacevic,et al.  Spectrum-blind signal recovery on graphs , 2015, 2015 IEEE 6th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[14]  William W. Hager,et al.  Updating the Inverse of a Matrix , 1989, SIAM Rev..

[15]  Jelena Kovacevic,et al.  Discrete Signal Processing on Graphs: Sampling Theory , 2015, IEEE Transactions on Signal Processing.

[16]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[17]  Pierre Vandergheynst,et al.  Random sampling of bandlimited signals on graphs , 2015, NIPS 2015.

[18]  Santiago Segarra,et al.  Sampling of Graph Signals With Successive Local Aggregations , 2015, IEEE Transactions on Signal Processing.

[19]  Calyampudi R. Rao,et al.  Linear statistical inference and its applications , 1965 .

[20]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[21]  Jelena Kovacevic,et al.  Signal recovery on graphs: Random versus experimentally designed sampling , 2015, 2015 International Conference on Sampling Theory and Applications (SampTA).

[22]  Robert M. Gray Quantization in Task-Driven Sensing and Distributed Processing , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.