Graph Structured Dictionary for Regression

Transformations for signals defined on graphs are playing significant role in applying the emerging graph signal processing techniques to different tasks. In this paper we focus on utilizing graph signal dictionary, a data-driven transformation, for regression. Apart from spelling out the joint optimization formulation, as well as the associated iteration steps to arrive at the dictionary and the regression coefficients, the paper provides some initial results to bring out the usefulness of the proposed approach.

[1]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[2]  Pascal Frossard,et al.  Learning Parametric Dictionaries for Signals on Graphs , 2014, IEEE Transactions on Signal Processing.

[3]  Lu Fang,et al.  Analysis of sports statistics via graph-signal smoothness prior , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[4]  Pascal Frossard,et al.  Dictionary Learning , 2011, IEEE Signal Processing Magazine.

[5]  Pierre Vandergheynst,et al.  GSPBOX: A toolbox for signal processing on graphs , 2014, ArXiv.

[6]  Pascal Frossard,et al.  Laplacian matrix learning for smooth graph signal representation , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Rama Chellappa,et al.  Design of Non-Linear Kernel Dictionaries for Object Recognition , 2013, IEEE Transactions on Image Processing.

[8]  Angshul Majumdar,et al.  Regressing Kernel Dictionary Learning , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Pascal Frossard,et al.  Learning of structured graph dictionaries , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Rebecca Willett,et al.  Sparse Linear Regression With Missing Data , 2015, ArXiv.

[12]  Athanasios Tsanas,et al.  Accurate quantitative estimation of energy performance of residential buildings using statistical machine learning tools , 2012 .

[13]  Michael Elad,et al.  K-SVD and its non-negative variant for dictionary design , 2005, SPIE Optics + Photonics.

[14]  Larry S. Davis,et al.  Label Consistent K-SVD: Learning a Discriminative Dictionary for Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Michael Elad,et al.  Dual Graph Regularized Dictionary Learning , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[16]  Michael Elad,et al.  Linearized Kernel Dictionary Learning , 2015, IEEE Journal of Selected Topics in Signal Processing.

[17]  Zuowei Shen,et al.  Dictionary Learning for Sparse Coding: Algorithms and Convergence Analysis , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Pascal Frossard,et al.  Dictionary learning: What is the right representation for my signal? , 2011 .

[19]  Hong Cheng,et al.  An Efficient Two-Stage Sparse Representation Method , 2014, Int. J. Pattern Recognit. Artif. Intell..

[20]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[21]  Guillermo Sapiro,et al.  Supervised Dictionary Learning , 2008, NIPS.

[22]  Deanna Needell,et al.  Compressed Sensing and Dictionary Learning , 2014 .

[23]  Karthikeyan Natesan Ramamurthy,et al.  Learning dictionaries with graph embedding constraints , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[24]  Ke-Lin Du,et al.  Compressed Sensing and Dictionary Learning , 2019, Neural Networks and Statistical Learning.

[25]  Kjersti Engan,et al.  Method of optimal directions for frame design , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[26]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[27]  Michael Elad,et al.  Graph-constrained supervised dictionary learning for multi-label classification , 2016, 2016 IEEE International Conference on the Science of Electrical Engineering (ICSEE).