Real Quadratic-Form-Based Graph Pooling for Graph Neural Networks

Graph neural networks (GNNs) have developed rapidly in recent years because they can work over non-Euclidean data and possess promising prediction power in many real-word applications. The graph classification problem is one of the central problems in graph neural networks, and aims to predict the label of a graph with the help of training graph neural networks over graph-structural datasets. The graph pooling scheme is an important part of graph neural networks for the graph classification objective. Previous works typically focus on using the graph pooling scheme in a linear manner. In this paper, we propose the real quadratic-form-based graph pooling framework for graph neural networks in graph classification. The quadratic form can capture a pairwise relationship, which brings a stronger expressive power than existing linear forms. Experiments on benchmarks verify the effectiveness of the proposed graph pooling scheme based on the quadratic form in graph classification tasks.

[1]  Chuan Shi,et al.  Heterogeneous Graph Propagation Network , 2023, IEEE Transactions on Knowledge and Data Engineering.

[2]  Soledad Villar,et al.  A Short Tutorial on The Weisfeiler-Lehman Test And Its Variants , 2021, ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Shuiwang Ji,et al.  Topology-Aware Graph Pooling Networks , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Shuiwang Ji,et al.  Second-Order Pooling for Graph Neural Networks , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Seongok Ryu,et al.  Predicting Drug-Target Interaction Using a Novel Graph Neural Network with 3D Structure-Embedded Graph Representation , 2019, J. Chem. Inf. Model..

[6]  Nitesh V. Chawla,et al.  Heterogeneous Graph Neural Network , 2019, KDD.

[7]  Kenli Li,et al.  Gated Residual Recurrent Graph Neural Networks for Traffic Prediction , 2019, AAAI.

[8]  Xiao Wang,et al.  Hyperbolic Heterogeneous Information Network Embedding , 2019, AAAI.

[9]  Yaron Lipman,et al.  Provably Powerful Graph Networks , 2019, NeurIPS.

[10]  Gabriel Peyré,et al.  Universal Invariant and Equivariant Graph Neural Networks , 2019, NeurIPS.

[11]  Yuan He,et al.  Graph Neural Networks for Social Recommendation , 2019, WWW.

[12]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[13]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[14]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[15]  Donald F. Towsley,et al.  Diffusion-Convolutional Neural Networks , 2015, NIPS.

[16]  Pinar Yanardag,et al.  Deep Graph Kernels , 2015, KDD.

[17]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[18]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[19]  Alessandro Sperduti,et al.  Graph Kernels Exploiting Weisfeiler-Lehman Graph Isomorphism Test Extensions , 2014, ICONIP.

[20]  Ping Li,et al.  A new space for comparing graphs , 2014, 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014).

[21]  Gerben de Vries A Fast Approximation of the Weisfeiler-Lehman Graph Kernel for RDF Data , 2013, ECML/PKDD.

[22]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[23]  Kurt Mehlhorn,et al.  Weisfeiler-Lehman Graph Kernels , 2011, J. Mach. Learn. Res..

[24]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[25]  George Karypis,et al.  Comparison of descriptor spaces for chemical compound retrieval and classification , 2006, Sixth International Conference on Data Mining (ICDM'06).

[26]  Christos Faloutsos,et al.  Graphs over time: densification laws, shrinking diameters and possible explanations , 2005, KDD '05.

[27]  Ashwin Srinivasan,et al.  Statistical Evaluation of the Predictive Toxicology Challenge 2000-2001 , 2003, Bioinform..

[28]  A. Debnath,et al.  Structure-activity relationship of mutagenic aromatic and heteroaromatic nitro compounds. Correlation with molecular orbital energies and hydrophobicity. , 1991, Journal of medicinal chemistry.

[29]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[30]  Hannu Toivonen,et al.  Statistical evaluation of the predictive toxicology challenge , 2000 .