A Hyperbolic-to-Hyperbolic Graph Convolutional Network

Hyperbolic graph convolutional networks (GCNs) demonstrate powerful representation ability to model graphs with hierarchical structure. Existing hyperbolic GCNs resort to tangent spaces to realize graph convolution on hyperbolic manifolds, which is inferior because tangent space is only a local approximation of a manifold. In this paper, we propose a hyperbolic-to-hyperbolic graph convolutional network (H2H-GCN) that directly works on hyperbolic manifolds. Specifically, we developed a manifold-preserving graph convolution that consists of a hyperbolic feature transformation and a hyperbolic neighborhood aggregation. The hyperbolic feature transformation works as linear transformation on hyperbolic manifolds. It ensures the transformed node representations still lie on the hyperbolic manifold by imposing the orthogonal constraint on the transformation sub-matrix. The hyperbolic neighborhood aggregation updates each node representation via the Einstein midpoint. The H2H-GCN avoids the distortion caused by tangent space approximations and keeps the global hyperbolic structure. Extensive experiments show that the H2H-GCN achieves substantial improvements on the link prediction, node classification, and graph classification tasks.

[1]  Douwe Kiela,et al.  Learning Continuous Hierarchies in the Lorentz Model of Hyperbolic Geometry , 2018, ICML.

[2]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[3]  Sanjiv Kumar,et al.  Robust Large-Margin Learning in Hyperbolic Space , 2020, NeurIPS.

[4]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[5]  W. Floyd,et al.  HYPERBOLIC GEOMETRY , 1996 .

[6]  Heng Tao Shen,et al.  Searching for Actions on the Hyperbole , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Yixin Chen,et al.  An End-to-End Deep Learning Architecture for Graph Classification , 2018, AAAI.

[8]  P. Dobson,et al.  Distinguishing enzyme structures from non-enzymes without alignments. , 2003, Journal of molecular biology.

[9]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[10]  Marián Boguñá,et al.  Popularity versus similarity in growing networks , 2011, Nature.

[11]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[12]  Valentin Khrulkov,et al.  Hyperbolic Image Embeddings , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Douwe Kiela,et al.  Hyperbolic Graph Neural Networks , 2019, NeurIPS.

[14]  Yu-Gang Jiang,et al.  Hyperbolic Visual Embedding Learning for Zero-Shot Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  M. Fréchet Les éléments aléatoires de nature quelconque dans un espace distancié , 1948 .

[16]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[17]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[18]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[19]  Thomas Hofmann,et al.  Hyperbolic Neural Networks , 2018, NeurIPS.

[20]  Anna C. Gilbert,et al.  Tree! I am no Tree! I am a Low Dimensional Hyperbolic Embedding , 2020, NeurIPS.

[21]  Kevin Chen-Chuan Chang,et al.  Geom-GCN: Geometric Graph Convolutional Networks , 2020, ICLR.

[22]  R. Benedetti,et al.  Lectures on Hyperbolic Geometry , 1992 .

[23]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[24]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[25]  Christopher De Sa,et al.  Representation Tradeoffs for Hyperbolic Embeddings , 2018, ICML.

[26]  Douwe Kiela,et al.  Poincaré Embeddings for Learning Hierarchical Representations , 2017, NIPS.

[27]  Davide Bacciu,et al.  A Fair Comparison of Graph Neural Networks for Graph Classification , 2020, ICLR.

[28]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[29]  P. Thomas Fletcher,et al.  Geodesic Regression and the Theory of Least Squares on Riemannian Manifolds , 2012, International Journal of Computer Vision.

[30]  Shiguang Shan,et al.  Cross Euclidean-to-Riemannian Metric Learning with Application to Face Recognition from Video , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[32]  Antje Chang,et al.  BRENDA , the enzyme database : updates and major new developments , 2003 .

[33]  Liming Zhu,et al.  Going Deep: Graph Convolutional Ladder-Shape Networks , 2020, AAAI.

[34]  W. Boothby An introduction to differentiable manifolds and Riemannian geometry , 1975 .

[35]  Jure Leskovec,et al.  Hyperbolic Graph Convolutional Neural Networks , 2019, NeurIPS.

[36]  Yanfang Ye,et al.  Hyperbolic Graph Attention Network , 2019, IEEE Transactions on Big Data.

[37]  P. Kaye Infectious diseases of humans: Dynamics and control , 1993 .

[38]  Wei Zhang,et al.  Knowledge Association with Hyperbolic Knowledge Graph Embeddings , 2020, EMNLP.

[39]  Hans-Peter Kriegel,et al.  Protein function prediction via graph kernels , 2005, ISMB.

[40]  A. Ungar,et al.  Analytic Hyperbolic Geometry: Mathematical Foundations And Applications , 2005 .

[41]  Nikos Komodakis,et al.  Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Kilian Q. Weinberger,et al.  Simplifying Graph Convolutional Networks , 2019, ICML.

[43]  Albert Gu,et al.  From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clustering , 2020, NeurIPS.

[44]  Fatih Murat Porikli,et al.  Pedestrian Detection via Classification on Riemannian Manifolds , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[46]  Timothy M. Hospedales,et al.  Multi-relational Poincaré Graph Embeddings , 2019, NeurIPS.

[47]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..

[48]  Amin Vahdat,et al.  Hyperbolic Geometry of Complex Networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.