Regularized Recovery by Multi-Order Partial Hypergraph Total Variation

Capturing complex high-order interactions among data is an important task in many scenarios. A common way to model high-order interactions is to use hypergraphs whose topology can be mathematically represented by tensors. Existing methods use a fixed-order tensor to describe the topology of the whole hypergraph, which ignores the divergence of different-order interactions. In this work, we take this divergence into consideration, and propose a multi-order hypergraph Laplacian and the corresponding total variation. Taking this total variation as a regularization term, we can utilize the topology information contained by it to smooth the hypergraph signal. This can help distinguish different-order interactions and represent high-order interactions accurately.

[1]  Hiroshi Mamitsuka,et al.  Learning on Hypergraphs with Sparsity , 2020, IEEE transactions on pattern analysis and machine intelligence.

[2]  Liqun Qi,et al.  Eigenvalues of a real supersymmetric tensor , 2005, J. Symb. Comput..

[3]  Jihua Zhu,et al.  Self-Weighting and Hypergraph Regularization for Multi-view Spectral Clustering , 2020, IEEE Signal Processing Letters.

[4]  Zhi Ding,et al.  Introducing Hypergraph Signal Processing: Theoretical Foundation and Practical Applications , 2019, IEEE Internet of Things Journal.

[5]  L. Qi,et al.  An even order symmetric B tensor is positive definite , 2014, 1404.0452.

[6]  Matthias Hein,et al.  The Total Variation on Hypergraphs - Learning on Hypergraphs Revisited , 2013, NIPS.

[7]  Liqun Qi,et al.  Hypergraph Clustering Using a New Laplacian Tensor with Applications in Image Processing , 2020, SIAM J. Imaging Sci..

[8]  Joshua N. Cooper,et al.  Spectra of Uniform Hypergraphs , 2011, 1106.4856.

[9]  José M. F. Moura,et al.  Discrete Signal Processing on Graphs: Frequency Analysis , 2013, IEEE Transactions on Signal Processing.

[10]  Vaidy S. Sunderam,et al.  CP-ORTHO: An Orthogonal Tensor Factorization Framework for Spatio-Temporal Data , 2017, SIGSPATIAL/GIS.

[11]  Sergio Barbarossa,et al.  An introduction to hypergraph signal processing , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Stéphane Marchand-Maillet,et al.  On Adjacency and e-Adjacency in General Hypergraphs: Towards a New e-Adjacency Tensor , 2018, Electron. Notes Discret. Math..

[13]  Anirban Banerjee,et al.  Spectra of general hypergraphs , 2016, 1601.02136.

[14]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[15]  Georgios B. Giannakis,et al.  Kernel-Based Reconstruction of Graph Signals , 2016, IEEE Transactions on Signal Processing.

[16]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[17]  Zoubin Ghahramani,et al.  Learning from labeled and unlabeled data with label propagation , 2002 .

[18]  Serge J. Belongie,et al.  Higher order learning with graphs , 2006, ICML.

[19]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.