Sparse Partial Least Squares for Coarse Noisy Graph Alignment

Graph signal processing (GSP) provides a powerful framework for analyzing signals arising in a variety of domains. In many applications of GSP, multiple network structures are available, each of which captures different aspects of the same underlying phenomenon. To integrate these different data sources, graph alignment techniques attempt to find the best correspondence between vertices of two graphs. We consider a generalization of this problem, where there is no natural one-to-one mapping between vertices, but where there is correspondence between the community structures of each graph. Because we seek to learn structure at this higher community level, we refer to this problem as "coarse" graph alignment. To this end, we propose a novel regularized partial least squares method which both incorporates the observed graph structures and imposes sparsity in order to reflect the underlying block community structure. We provide efficient algorithms for our method and demonstrate its effectiveness in simulations.

[1]  Harrison H. Zhou,et al.  Sparse CCA: Adaptive Estimation and Computational Barriers , 2014, 1409.8565.

[2]  Zhixin Zhou,et al.  Optimal Bipartite Network Clustering , 2018, J. Mach. Learn. Res..

[3]  Gang Wang,et al.  Graph Multiview Canonical Correlation Analysis , 2018, IEEE Transactions on Signal Processing.

[4]  Gang Wang,et al.  Canonical Correlation Analysis of Datasets With a Common Source Graph , 2018, IEEE Transactions on Signal Processing.

[5]  Michael Weylandt,et al.  Multi-Rank Sparse and Functional PCA Manifold Optimization and Iterative Deflation Techniques , 2019, 2019 IEEE 8th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[6]  Pierre Vandergheynst,et al.  Graph Signal Processing: Overview, Challenges, and Applications , 2017, Proceedings of the IEEE.

[7]  Michael M. Bronstein,et al.  MADMM: A Generic Algorithm for Non-smooth Optimization on Manifolds , 2015, ECCV.

[8]  Jiaming Xu,et al.  Spectral Graph Matching and Regularized Quadratic Relaxations: Algorithm and Theory , 2020, ICML.

[9]  John N. Tsitsiklis,et al.  Blind identification of stochastic block models from dynamical observations , 2019, SIAM J. Math. Data Sci..

[10]  Giovanni Chierchia,et al.  Wasserstein-Based Graph Alignment , 2020, IEEE Transactions on Signal and Information Processing over Networks.

[11]  Shiqian Ma,et al.  An Alternating Manifold Proximal Gradient Method for Sparse Principal Component Analysis and Sparse Canonical Correlation Analysis , 2020, INFORMS J. Optim..

[12]  Anthony Randal McIntosh,et al.  Partial Least Squares (PLS) methods for neuroimaging: A tutorial and review , 2011, NeuroImage.

[13]  Naotaka Fujii,et al.  Higher Order Partial Least Squares (HOPLS): A Generalized Multilinear Regression Method , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Tijl De Bie,et al.  Eigenproblems in Pattern Recognition , 2005 .

[15]  Xi Chen,et al.  Structured Sparse Canonical Correlation Analysis , 2012, AISTATS.

[16]  R. Tibshirani,et al.  A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. , 2009, Biostatistics.

[17]  Shiqian Ma,et al.  Proximal Gradient Method for Nonsmooth Optimization over the Stiefel Manifold , 2018, SIAM J. Optim..

[18]  Shinji Umeyama,et al.  An Eigendecomposition Approach to Weighted Graph Matching Problems , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Genevera I. Allen,et al.  Sparse and Functional Principal Components Analysis , 2013, 2019 IEEE Data Science Workshop (DSW).

[20]  Zhixin Zhou,et al.  Analysis of spectral clustering algorithms for community detection: the general bipartite setting , 2018, J. Mach. Learn. Res..

[21]  Gholam-Ali Hossein-Zadeh,et al.  Structured and Sparse Canonical Correlation Analysis as a Brain-Wide Multi-Modal Data Fusion Approach , 2017, IEEE Transactions on Medical Imaging.

[22]  Jin Tang,et al.  Graph-Laplacian PCA: Closed-Form Solution and Robustness , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.