Kernel Regression for Graph Signal Prediction in Presence of Sparse Noise

In presence of sparse noise we propose kernel regression for predicting output vectors which are smooth over a given graph. Sparse noise models the training outputs being corrupted either with missing samples or large perturbations. The presence of sparse noise is handled using appropriate use of ℓ1-norm along-with use of ℓ2-norm in a convex cost function. For optimization of the cost function, we propose an iteratively reweighted least-squares (IRLS) approach that is suitable for kernel substitution or kernel trick due to availability of a closed form solution. Simulations using real-world temperature data show efficacy of our proposed method, mainly for limited-size training datasets.

[1]  Peter Händel,et al.  Multi-Kernel Regression for Graph Signal Processing , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Peter Händel,et al.  Kernel Regression for Signals over Graphs , 2017, ArXiv.

[3]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[4]  Georgios B. Giannakis,et al.  Estimating signals over graphs via multi-kernel learning , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[5]  Georgios B. Giannakis,et al.  Kernel-Based Reconstruction of Space-Time Functions on Dynamic Graphs , 2016, IEEE Journal of Selected Topics in Signal Processing.

[6]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[8]  Georgios B. Giannakis,et al.  Kernel-Based Structural Equation Models for Topology Identification of Directed Networks , 2016, IEEE Transactions on Signal Processing.

[9]  José M. F. Moura,et al.  Signal Processing on Graphs: Causal Modeling of Unstructured Data , 2015, IEEE Transactions on Signal Processing.

[10]  Lawrence K. Saul,et al.  Kernel Methods for Deep Learning , 2009, NIPS.

[11]  Peter Händel,et al.  Gaussian Processes Over Graphs , 2018, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Georgios B. Giannakis,et al.  Kernel-Based Reconstruction of Graph Signals , 2016, IEEE Transactions on Signal Processing.

[13]  C. Loan The ubiquitous Kronecker product , 2000 .

[14]  Georgios B. Giannakis,et al.  Kernel-based reconstruction of space-time functions via extended graphs , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[15]  Yuantao Gu,et al.  Time-Varying Graph Signal Reconstruction , 2017, IEEE Journal of Selected Topics in Signal Processing.

[16]  Georgios B. Giannakis,et al.  Kernel-based Inference of Functions over Graphs , 2017, ArXiv.

[17]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[18]  Moo K. Chung,et al.  Unified Heat Kernel Regression for Diffusion, Kernel Smoothing and Wavelets on Manifolds and Its Application to Mandible Growth Modeling in CT Images , 2014, Medical Image Anal..

[19]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[20]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[21]  Geert Leus,et al.  Forecasting Time Series With VARMA Recursions on Graphs , 2018, IEEE Transactions on Signal Processing.