State of the Art and Potentialities of Graph-level Learning

Graphs have a superior ability to represent relational data, like chemical compounds, proteins, and social networks. Hence, graph-level learning, which takes a set of graphs as input, has been applied to many tasks including comparison, regression, classification, and more. Traditional approaches to learning a set of graphs heavily rely on hand-crafted features, such as substructures. But while these methods benefit from good interpretability, they often suffer from computational bottlenecks as they cannot skirt the graph isomorphism problem. Conversely, deep learning has helped graph-level learning adapt to the growing scale of graphs by extracting features automatically and encoding graphs into low-dimensional representations. As a result, these deep graph learning methods have been responsible for many successes. Yet, there is no comprehensive survey that reviews graph-level learning starting with traditional learning and moving through to the deep learning approaches. This article fills this gap and frames the representative algorithms into a systematic taxonomy covering traditional learning, graph-level deep neural networks, graph-level graph neural networks, and graph pooling. To ensure a thoroughly comprehensive survey, the evolutions, interactions, and communications between methods from four different branches of development are also examined. This is followed by a brief review of the benchmark data sets, evaluation metrics, and common downstream applications. The survey concludes with a broad overview of 12 current and future directions in this booming field.

[1]  Jia Wu,et al.  Minimum Entropy Principle Guided Graph Neural Networks , 2023, WSDM.

[2]  Andrea Passerini,et al.  Global Explainability of GNNs via Logic Combination of Learned Concepts , 2022, ICLR.

[3]  Fabio Vandin,et al.  SizeShiftReg: a Regularization Method for Improving Size-Generalization in Graph Neural Networks , 2022, NeurIPS.

[4]  Junran Wu,et al.  Structural Entropy Guided Graph Hierarchical Pooling , 2022, ICML.

[5]  Haitz S'aez de Oc'ariz Borde,et al.  Sheaf Neural Networks with Connection Laplacians , 2022, ArXiv.

[6]  Shuiwang Ji,et al.  GOOD: A Graph Out-of-Distribution Benchmark , 2022, NeurIPS.

[7]  Keyulu Xu,et al.  A Simple yet Effective Method for Graph Classification , 2022, IJCAI.

[8]  Jianheng Tang,et al.  Rethinking Graph Neural Networks for Anomaly Detection , 2022, ICML.

[9]  Maja R. Rudolph,et al.  Raising the Bar in Graph-level Anomaly Detection , 2022, IJCAI.

[10]  Jiliang Tang,et al.  A Comprehensive Survey on Trustworthy Graph Neural Networks: Privacy, Robustness, Fairness, and Explainability , 2022, ArXiv.

[11]  Juan L. Reutter,et al.  Expressiveness and Approximation Properties of Graph Neural Networks , 2022, ICLR.

[12]  Yu Rong,et al.  Geometrically Equivariant Graph Neural Networks: A Survey , 2022, ArXiv.

[13]  Francesco Di Giovanni,et al.  Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs , 2022, NeurIPS.

[14]  Pan Li,et al.  Interpretable and Generalizable Graph Learning via Stochastic Attention Mechanism , 2022, ICML.

[15]  Xiangnan He,et al.  Discovering Invariant Rationales for Graph Neural Networks , 2022, ICLR.

[16]  Anton van den Hengel,et al.  Deep Graph-level Anomaly Detection by Glocal Knowledge Distillation , 2021, WSDM.

[17]  Neil Shah,et al.  Imbalanced Graph Classification via Graph-of-Graph Neural Networks , 2021, CIKM.

[18]  Jiang Liu,et al.  Uncertainty-guided graph attention network for parapneumonic effusion diagnosis , 2021, Medical Image Anal..

[19]  Muhan Zhang,et al.  Nested Graph Neural Networks , 2021, NeurIPS.

[20]  Boris Knyazev,et al.  Parameter Prediction for Unseen Deep Architectures , 2021, NeurIPS.

[21]  Leman Akoglu,et al.  Fast Attributed Graph Embedding via Density of States , 2021, 2021 IEEE International Conference on Data Mining (ICDM).

[22]  L. Akoglu,et al.  From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness , 2021, ICLR.

[23]  M. Bronstein,et al.  Equivariant Subgraph Aggregation Networks , 2021, ICLR.

[24]  Shu Wu,et al.  An Empirical Study of Graph Contrastive Learning , 2021, NeurIPS Datasets and Benchmarks.

[25]  Quanming Yao,et al.  Pooling Architecture Search for Graph Classification , 2021, CIKM.

[26]  Chang Zhou,et al.  Are we really making much progress?: Revisiting, benchmarking and refining heterogeneous graph neural networks , 2021, KDD.

[27]  Ninghao Liu,et al.  EDITS: Modeling and Mitigating Data Bias for Graph Neural Networks , 2021, WWW.

[28]  Carl Yang,et al.  Federated Graph Classification over Non-IID Graphs , 2021, NeurIPS.

[29]  Yu Guang Wang,et al.  Weisfeiler and Lehman Go Cellular: CW Networks , 2021, NeurIPS.

[30]  Quan Z. Sheng,et al.  A Comprehensive Survey on Graph Anomaly Detection With Deep Learning , 2021, IEEE Transactions on Knowledge and Data Engineering.

[31]  Hua Wu,et al.  Geometry-enhanced molecular representation learning for property prediction , 2021, Nature Machine Intelligence.

[32]  Zhangyang Wang,et al.  Graph Contrastive Learning Automated , 2021, ICML.

[33]  Pascal Vasseur,et al.  Breaking the Limits of Message Passing Graph Neural Networks , 2021, ICML.

[34]  Florian Becker,et al.  GemNet: Universal Directional Graph Neural Networks for Molecules , 2021, NeurIPS.

[35]  Quan Z. Sheng,et al.  A Comprehensive Survey on Community Detection With Deep Learning , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Joan Bruna,et al.  Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges , 2021, ArXiv.

[37]  Philip S. Yu,et al.  User Preference-aware Fake News Detection , 2021, SIGIR.

[38]  Luoyi Fu,et al.  Bridging the Gap between von Neumann Graph Entropy and Structural Information: Theory and Applications , 2021, WWW.

[39]  Guojie Song,et al.  Theoretically Improving Graph Neural Networks via Anonymous Walk Graph Kernels , 2021, WWW.

[40]  Bruno Ribeiro,et al.  Size-Invariant Graph Representations for Graph Classification Extrapolations , 2021, ICML.

[41]  Guido Mont'ufar,et al.  Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networks , 2021, ICML.

[42]  Jinheon Baek,et al.  Accurate Learning of Graph Representations with Graph Multiset Pooling , 2021, ICLR.

[43]  Amir Barati Farimani,et al.  Molecular contrastive learning of representations via graph neural networks , 2021, Nature Machine Intelligence.

[44]  Max Welling,et al.  E(n) Equivariant Graph Neural Networks , 2021, ICML.

[45]  Ming Li,et al.  How Framelets Enhance Graph Neural Networks , 2021, ICML.

[46]  Christopher Leckie,et al.  Embracing Domain Differences in Fake News: Cross-domain Fake News Detection using Multi-modal Data , 2021, AAAI.

[47]  Shuiwang Ji,et al.  On Explainability of Graph Neural Networks via Subgraph Explorations , 2021, ICML.

[48]  Hao Peng,et al.  SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanism , 2021, WWW.

[49]  Xiao Wang,et al.  Beyond Low-frequency Information in Graph Convolutional Networks , 2021, AAAI.

[50]  Shuiwang Ji,et al.  Explainability in Graph Neural Networks: A Taxonomic Survey , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  L. Akoglu,et al.  On Using Classification Datasets to Evaluate Graph Outlier Detection: Peculiar Observations and New Insights , 2020, Big Data.

[52]  Duen Horng Chau,et al.  A Large-Scale Database for Graph Representation Learning , 2020, NeurIPS Datasets and Benchmarks.

[53]  Bo Zong,et al.  Parameterized Explainer for Graph Neural Network , 2020, NeurIPS.

[54]  Samuel Kaski,et al.  Rethinking pooling in graph neural networks , 2020, NeurIPS.

[55]  Zhangyang Wang,et al.  Graph Contrastive Learning with Augmentations , 2020, NeurIPS.

[56]  Weihua Hu,et al.  The Open Catalyst 2020 (OC20) Dataset and Community Challenges , 2020, ACS Catalysis.

[57]  Eli A. Meirom,et al.  From Local Structures to Size Generalization in Graph Neural Networks , 2020, ICML.

[58]  My T. Thai,et al.  PGM-Explainer: Probabilistic Graphical Model Explanations for Graph Neural Networks , 2020, NeurIPS.

[59]  Thomas Lukasiewicz,et al.  The Surprising Power of Graph Neural Networks with Random Node Initialization , 2020, IJCAI.

[60]  Ken-ichi Kawarabayashi,et al.  How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks , 2020, ICLR.

[61]  Chang-Yu Hsieh,et al.  Could graph neural networks learn better molecular representation for drug discovery? A comparison study of descriptor-based and graph-based models , 2020, Journal of Cheminformatics.

[62]  Suhang Wang,et al.  Say No to the Discrimination: Learning Fair Graph Neural Networks with Limited Sensitive Attribute Information , 2020, WSDM.

[63]  Kristian Kersting,et al.  TUDataset: A collection of benchmark datasets for learning with graphs , 2020, ArXiv.

[64]  E-53: Solutio problematis ad geometriam situs pertinentis , 2020, Spectrum.

[65]  Yang Zhang,et al.  Learning Differential Diagnosis of Skin Conditions with Co-occurrence Supervision using Graph Convolutional Networks , 2020, MICCAI.

[66]  Hanghang Tong,et al.  InFoRM: Individual Fairness on Graph Mining , 2020, KDD.

[67]  Marc Lelarge,et al.  Expressive Power of Invariant and Equivariant Graph Neural Networks , 2020, ICLR.

[68]  Andreas Loukas,et al.  Building powerful and equivariant graph neural networks with structural message-passing , 2020, NeurIPS.

[69]  Michelle M. Li,et al.  Subgraph Neural Networks , 2020, NeurIPS.

[70]  Yuxiao Dong,et al.  GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training , 2020, KDD.

[71]  M. Bronstein,et al.  Improving Graph Neural Network Expressivity via Subgraph Isomorphism Counting , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  Eran Yahav,et al.  On the Bottleneck of Graph Neural Networks and its Practical Implications , 2020, ICLR.

[73]  Aristides Gionis,et al.  Explainable Classification of Brain Networks via Contrast Subgraphs , 2020, KDD.

[74]  Shuiwang Ji,et al.  XGNN: Towards Model-Level Explanations of Graph Neural Networks , 2020, KDD.

[75]  Shuiwang Ji,et al.  Second-Order Pooling for Graph Neural Networks , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[76]  Kaveh Hassani,et al.  Contrastive Multi-View Representation Learning on Graphs , 2020, ICML.

[77]  Wei Zhao,et al.  Interpretable and Efficient Heterogeneous Graph Convolutional Network , 2020, IEEE Transactions on Knowledge and Data Engineering.

[78]  Philip S. Yu,et al.  Algorithms for Estimating the Partition Function of Restricted Boltzmann Machines (Extended Abstract) , 2020 .

[79]  Lu Qin,et al.  GoGNN: Graph of Graphs Neural Network for Predicting Structured Entity Interactions , 2020, IJCAI.

[80]  J. Leskovec,et al.  Open Graph Benchmark: Datasets for Machine Learning on Graphs , 2020, NeurIPS.

[81]  Shuiwang Ji,et al.  StructPool: Structured Graph Pooling via Conditional Random Fields , 2020, ICLR.

[82]  Le Song,et al.  Hoppity: Learning Graph Transformations to Detect and Fix Bugs in Programs , 2020, ICLR.

[83]  Rainer Gemulla,et al.  You CAN Teach an Old Dog New Tricks! On Training Knowledge Graph Embeddings , 2020, ICLR.

[84]  Pietro Liò,et al.  Abstract Diagrammatic Reasoning with Multiplex Graph Networks , 2020, ICLR.

[85]  Yufeng Zhang,et al.  Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks , 2020, ACL.

[86]  俊一 甘利 5分で分かる!? 有名論文ナナメ読み:Jacot, Arthor, Gabriel, Franck and Hongler, Clement : Neural Tangent Kernel : Convergence and Generalization in Neural Networks , 2020 .

[87]  Dominique Beaini,et al.  Principal Neighbourhood Aggregation for Graph Nets , 2020, NeurIPS.

[88]  Pang-Ning Tan,et al.  Bursting the Filter Bubble: Fairness-Aware Network Link Prediction , 2020, AAAI.

[89]  Chunxiao Liu,et al.  Graph Structured Network for Image-Text Matching , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[90]  Paul Honeine,et al.  Bridging the Gap Between Spectral and Spatial Domains in Graph Neural Networks , 2020, ArXiv.

[91]  Xifeng Yan,et al.  Adaptive-Step Graph Meta-Learner for Few-Shot Graph Classification , 2020, CIKM.

[92]  Joelle Pineau,et al.  Evaluating Logical Generalization in Graph Neural Networks , 2020, ArXiv.

[93]  Julien Mairal,et al.  Convolutional Kernel Networks for Graph-Structured Data , 2020, ICML.

[94]  Ryoma Sato,et al.  A Survey on The Expressive Power of Graph Neural Networks , 2020, ArXiv.

[95]  Bryan Perozzi,et al.  Just SLaQ When You Approximate: Accurate Spectral Distances for Web-Scale Graphs , 2020, WWW.

[96]  Manohar Kaul,et al.  Few-Shot Learning on Graphs via Super-Classes based on Graph Spectral Measures , 2020, ICLR.

[97]  Jure Leskovec,et al.  Learning to Simulate Complex Physics with Graph Networks , 2020, ICML.

[98]  Joan Bruna,et al.  Can graph neural networks count substructures? , 2020, NeurIPS.

[99]  Emma J. Chory,et al.  A Deep Learning Approach to Antibiotic Discovery , 2020, Cell.

[100]  Liang Zhang,et al.  Structure-Feature based Graph Self-adaptive Pooling , 2020, WWW.

[101]  Weinan Zhang,et al.  GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generation , 2020, ICLR.

[102]  A. Micheli,et al.  A Fair Comparison of Graph Neural Networks for Graph Classification , 2019, ICLR.

[103]  Ludovic Dos Santos,et al.  Coloring graph neural networks for node disambiguation , 2019, IJCAI.

[104]  P. Talukdar,et al.  ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations , 2019, AAAI.

[105]  Evgeny Burnaev,et al.  Understanding Isomorphism Bias in Graph Data Sets , 2019, ArXiv.

[106]  Marc Brockschmidt,et al.  CodeSearchNet Challenge: Evaluating the State of Semantic Code Search , 2019, ArXiv.

[107]  Murat Cihan Sorkun,et al.  AqSolDB, a curated reference set of aqueous solubility and 2D descriptors for a diverse set of compounds , 2019, Scientific Data.

[108]  Jian Tang,et al.  InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization , 2019, ICLR.

[109]  Gitta Kutyniok,et al.  Transferability of Spectral Graph Convolutional Neural Networks , 2019, J. Mach. Learn. Res..

[110]  Cesare Alippi,et al.  Spectral Clustering with Graph Neural Networks for Graph Pooling , 2019, ICML.

[111]  Heiko Hoffmann,et al.  Explainability Methods for Graph Convolutional Neural Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[112]  Ruosong Wang,et al.  Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernels , 2019, NeurIPS.

[113]  Yaron Lipman,et al.  Provably Powerful Graph Networks , 2019, NeurIPS.

[114]  Frederik Diehl,et al.  Edge Contraction Pooling for Graph Neural Networks , 2019, ArXiv.

[115]  Karsten M. Borgwardt,et al.  A Persistent Weisfeiler-Lehman Procedure for Graph Classification , 2019, ICML.

[116]  William L. Hamilton,et al.  Compositional Fairness Constraints for Graph Embeddings , 2019, ICML.

[117]  Shuiwang Ji,et al.  Graph U-Nets , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[118]  Yansong Feng,et al.  Cross-lingual Knowledge Graph Alignment via Graph Matching Neural Network , 2019, ACL.

[119]  Charu C. Aggarwal,et al.  Graph Convolutional Networks with EigenPooling , 2019, KDD.

[120]  Bryan Perozzi,et al.  DDGK: Learning Graph Representations for Deep Divergence Graph Kernels , 2019, WWW.

[121]  Jaewoo Kang,et al.  Self-Attention Graph Pooling , 2019, ICML.

[122]  Xueqi Cheng,et al.  Graph Wavelet Neural Network , 2019, ICLR.

[123]  Parantu K. Shah,et al.  Applications of machine learning in drug discovery and development , 2019, Nature Reviews Drug Discovery.

[124]  Xiu-Shen Wei,et al.  Multi-Label Image Recognition With Graph Convolutional Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[125]  Nils M. Kriege,et al.  A survey on graph kernels , 2019, Applied Network Science.

[126]  J. Leskovec,et al.  GNNExplainer: Generating Explanations for Graph Neural Networks , 2019, NeurIPS.

[127]  Vinayak A. Rao,et al.  Relational Pooling for Graph Representations , 2019, ICML.

[128]  Peter J. Bentley,et al.  Capsule Neural Networks for Graph Classification using Explicit Tensorial Graph Representations , 2019, ArXiv.

[129]  Lorenzo Livi,et al.  Graph Neural Networks With Convolutional ARMA Filters , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[130]  Wenwu Zhu,et al.  Deep Learning on Graphs: A Survey , 2018, IEEE Transactions on Knowledge and Data Engineering.

[131]  Floris Geerts,et al.  On the Expressive Power of Linear Algebra on Graphs , 2018, ICDT.

[132]  Oleg Verbitsky,et al.  On Weisfeiler-Leman Invariance: Subgraph Counts and Related Graph Properties , 2018, FCT.

[133]  Chen Cai,et al.  A simple yet effective baseline for non-attribute graph classification , 2018, ArXiv.

[134]  Pietro Liò,et al.  Towards Sparse Hierarchical Graph Classifiers , 2018, ArXiv.

[135]  Jure Leskovec,et al.  Evolution of resilience in protein interactomes across the tree of life , 2018, Proceedings of the National Academy of Sciences.

[136]  Philippe Cudré-Mauroux,et al.  Are Meta-Paths Necessary?: Revisiting Heterogeneous Graph Embeddings , 2018, CIKM.

[137]  Martin Grohe,et al.  Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networks , 2018, AAAI.

[138]  Jure Leskovec,et al.  How Powerful are Graph Neural Networks? , 2018, ICLR.

[139]  Lihui Chen,et al.  Capsule Graph Neural Network , 2018, ICLR.

[140]  Yoshua Bengio,et al.  Learning deep representations by mutual information estimation and maximization , 2018, ICLR.

[141]  Ryan A. Rossi,et al.  Graph Classification using Structural Attention , 2018, KDD.

[142]  Oriol Vinyals,et al.  Representation Learning with Contrastive Predictive Coding , 2018, ArXiv.

[143]  Alexander Binder,et al.  Deep One-Class Classification , 2018, ICML.

[144]  Philip S. Yu,et al.  Multiple Structure-View Learning for Graph Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[145]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[146]  Razvan Pascanu,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[147]  Olaf Sporns,et al.  Graph theory methods: applications in brain networks , 2018, Dialogues in clinical neuroscience.

[148]  Xindong Wu,et al.  Multi-Instance Learning with Discriminative Bag Mapping , 2018, IEEE Transactions on Knowledge and Data Engineering.

[149]  Sergey Ivanov,et al.  Anonymous Walk Embeddings , 2018, ICML.

[150]  Zhi-Li Zhang,et al.  Graph Capsule Convolutional Neural Networks , 2018, ArXiv.

[151]  Sijia Liu,et al.  Fast Incremental von Neumann Graph Entropy Computation: Theory, Algorithm, and Applications , 2018, ICML.

[152]  Bo Zong,et al.  Substructure Assembling Network for Graph Classification , 2018, AAAI.

[153]  Yixin Chen,et al.  An End-to-End Deep Learning Architecture for Graph Classification , 2018, AAAI.

[154]  Jianxin Li,et al.  Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN , 2018, WWW.

[155]  Stephan Günnemann,et al.  NetGAN: Generating Graphs via Random Walks , 2018, ICML.

[156]  Jure Leskovec,et al.  GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models , 2018, ICML.

[157]  Jure Leskovec,et al.  Modeling polypharmacy side effects with graph convolutional networks , 2018, bioRxiv.

[158]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[159]  Marc Brockschmidt,et al.  Learning to Represent Programs with Graphs , 2017, ICLR.

[160]  Kristian Kersting,et al.  Glocalized Weisfeiler-Lehman Graph Kernels: Global-Local Feature Maps of Graphs , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[161]  Michalis Vazirgiannis,et al.  Kernel Graph Convolutional Neural Networks , 2017, ICANN.

[162]  Jan Van den Bussche,et al.  On the Expressive Power of Query Languages for Matrices , 2017, ICDT.

[163]  Tao Shen,et al.  DiSAN: Directional Self-Attention Network for RNN/CNN-free Language Understanding , 2017, AAAI.

[164]  Yannis Stavrakas,et al.  Shortest-Path Graph Kernels for Document Similarity , 2017, EMNLP.

[165]  Yang Liu,et al.  graph2vec: Learning Distributed Representations of Graphs , 2017, ArXiv.

[166]  Regina Barzilay,et al.  Deriving Neural Architectures from Sequence and Graph Kernels , 2017, ICML.

[167]  Nikos Komodakis,et al.  Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[168]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[169]  Jianxin Li,et al.  An Efficient Approach to Event Detection and Forecasting in Dynamic Multivariate Social Media Networks , 2017, WWW.

[170]  Xindong Wu,et al.  Positive and Unlabeled Multi-Graph Learning , 2017, IEEE Transactions on Cybernetics.

[171]  Vijay S. Pande,et al.  MoleculeNet: a benchmark for molecular machine learning , 2017, Chemical science.

[172]  Chengqi Zhang,et al.  Task Sensitive Feature Exploration and Learning for Multitask Graph Classification , 2017, IEEE Transactions on Cybernetics.

[173]  Danfei Xu,et al.  Scene Graph Generation by Iterative Message Passing , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[174]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[175]  Razvan Pascanu,et al.  Interaction Networks for Learning about Objects, Relations and Physics , 2016, NIPS.

[176]  Jonathan Masci,et al.  Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[177]  Vijay S. Pande,et al.  Low Data Drug Discovery with One-Shot Learning , 2016, ACS central science.

[178]  Kaitlyn M. Gayvert,et al.  A Data-Driven Approach to Predicting Successes and Failures of Clinical Trials. , 2016, Cell chemical biology.

[179]  Vijay S. Pande,et al.  Computational Modeling of β-Secretase 1 (BACE-1) Inhibitors Using Ligand Based Approaches , 2016, J. Chem. Inf. Model..

[180]  Alexandre Tkatchenko,et al.  Quantum-chemical insights from deep tensor neural networks , 2016, Nature Communications.

[181]  Antony J. Williams,et al.  ToxCast Chemical Landscape: Paving the Road to 21st Century Toxicology. , 2016, Chemical research in toxicology.

[182]  Chengqi Zhang,et al.  Multi-graph-view subgraph mining for graph classification , 2016, Knowledge and Information Systems.

[183]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[184]  Yang Liu,et al.  subgraph2vec: Learning Distributed Representations of Rooted Sub-graphs from Large Graphs , 2016, ArXiv.

[185]  Mathias Niepert,et al.  Learning Convolutional Neural Networks for Graphs , 2016, ICML.

[186]  Angsheng Li,et al.  Structural Information and Dynamical Complexity of Networks , 2016, IEEE Transactions on Information Theory.

[187]  Philip S. Yu,et al.  Joint Structure Feature Exploration and Regularization for Multi-Task Graph Classification , 2016, IEEE Transactions on Knowledge and Data Engineering.

[188]  R. Garnett,et al.  Propagation kernels: efficient graph kernels from propagated information , 2016, Machine Learning.

[189]  László Babai,et al.  Graph isomorphism in quasipolynomial time [extended abstract] , 2015, STOC.

[190]  Samy Bengio,et al.  Order Matters: Sequence to sequence for sets , 2015, ICLR.

[191]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[192]  Donald F. Towsley,et al.  Diffusion-Convolutional Neural Networks , 2015, NIPS.

[193]  Andrea Torsello,et al.  Transitive Assignment Kernels for Structural Classification , 2015, SIMBAD.

[194]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[195]  Devdatt P. Dubhashi,et al.  Learning with Similarity Functions on Graphs using Matchings of Geometric Embeddings , 2015, KDD.

[196]  Pinar Yanardag,et al.  Deep Graph Kernels , 2015, KDD.

[197]  Chengqi Zhang,et al.  Multi-Graph-View Learning for Complicated Object Classification , 2015, IJCAI.

[198]  Michalis Vazirgiannis,et al.  Text Categorization as a Graph Classification Problem , 2015, ACL.

[199]  Joan Bruna,et al.  Deep Convolutional Networks on Graph-Structured Data , 2015, ArXiv.

[200]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[201]  Chengqi Zhang,et al.  Graph Ensemble Boosting for Imbalanced Noisy Graph Stream Classification , 2015, IEEE Transactions on Cybernetics.

[202]  Zhihua Cai,et al.  Boosting for Multi-Graph Classification , 2015, IEEE Transactions on Cybernetics.

[203]  Chengqi Zhang,et al.  Multi-graph-view Learning for Graph Classification , 2014, 2014 IEEE International Conference on Data Mining.

[204]  David L. Mobley,et al.  FreeSolv: a database of experimental and calculated hydration free energies, with input files , 2014, Journal of Computer-Aided Molecular Design.

[205]  Philip S. Yu,et al.  Bag Constrained Structure Pattern Mining for Multi-Graph Classification , 2014, IEEE Transactions on Knowledge and Data Engineering.

[206]  Joan Bruna,et al.  Spectral Networks and Locally Connected Networks on Graphs , 2013, ICLR.

[207]  Vikas Singh,et al.  Solving the multi-way matching problem by permutation synchronization , 2013, NIPS.

[208]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[209]  Brendan D. McKay,et al.  Practical graph isomorphism, II , 2013, J. Symb. Comput..

[210]  Nils M. Kriege,et al.  Subgraph Matching Kernels for Attributed Graphs , 2012, ICML.

[211]  Luis Pinheiro,et al.  A Bayesian Approach to in Silico Blood-Brain Barrier Penetration Modeling , 2012, J. Chem. Inf. Model..

[212]  Gautam Shroff,et al.  Catching the Long-Tail: Extracting Local News Events from Twitter , 2012, ICWSM.

[213]  Ryan G. Coleman,et al.  ZINC: A Free Tool to Discover Chemistry for Biology , 2012, J. Chem. Inf. Model..

[214]  Philip S. Yu,et al.  Positive and Unlabeled Learning for Graph Classification , 2011, 2011 IEEE 11th International Conference on Data Mining.

[215]  Geoffrey E. Hinton,et al.  Transforming Auto-Encoders , 2011, ICANN.

[216]  Kurt Mehlhorn,et al.  Weisfeiler-Lehman Graph Kernels , 2011, J. Mach. Learn. Res..

[217]  Philip S. Yu,et al.  Multi-label Feature Selection for Graph Classification , 2010, 2010 IEEE International Conference on Data Mining.

[218]  Philip S. Yu,et al.  Semi-supervised feature selection for graph classification , 2010, KDD.

[219]  Melanie Hilario,et al.  Adaptive Matching Based Kernels for Labelled Graphs , 2010, PAKDD.

[220]  Fabrizio Costa,et al.  Fast Neighborhood Subgraph Pairwise Distance Kernel , 2010, ICML.

[221]  Philip S. Yu,et al.  Near-optimal Supervised Feature Selection among Frequent Subgraphs , 2009, SDM.

[222]  Pierre Vandergheynst,et al.  Wavelets on Graphs via Spectral Graph Theory , 2009, ArXiv.

[223]  Hisashi Kashima,et al.  A Linear-Time Graph Kernel , 2009, 2009 Ninth IEEE International Conference on Data Mining.

[224]  Christopher D. Manning,et al.  Random Walks for Text Semantic Similarity , 2009, Graph-based Methods for Natural Language Processing.

[225]  Kurt Mehlhorn,et al.  Efficient graphlet kernels for large graph comparison , 2009, AISTATS.

[226]  Alessio Micheli,et al.  Neural Network for Graphs: A Contextual Constructive Approach , 2009, IEEE Transactions on Neural Networks.

[227]  Sebastian G. Rohrer,et al.  Maximum Unbiased Validation (MUV) Data Sets for Virtual Screening Based on PubChem Bioactivity Data , 2009, J. Chem. Inf. Model..

[228]  S. V. N. Vishwanathan,et al.  Graph kernels , 2007 .

[229]  Philip S. Yu,et al.  Mining significant graph patterns by leap search , 2008, SIGMOD Conference.

[230]  Christian von Mering,et al.  STITCH: interaction networks of chemicals and proteins , 2007, Nucleic Acids Res..

[231]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[232]  Inderjit S. Dhillon,et al.  Weighted Graph Cuts without Eigenvectors A Multilevel Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[233]  Thad Hughes,et al.  Lexical Semantic Relatedness with Random Graph Walks , 2007, EMNLP.

[234]  George Karypis,et al.  Comparison of descriptor spaces for chemical compound retrieval and classification , 2006, Sixth International Conference on Data Mining (ICDM'06).

[235]  Hans-Peter Kriegel,et al.  Shortest-path kernels on graphs , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[236]  Andrew Y. Ng,et al.  Robust Textual Inference via Graph Matching , 2005, HLT.

[237]  Pierre Baldi,et al.  Graph kernels for chemical informatics , 2005, Neural Networks.

[238]  Christof Monz,et al.  Iterative translation disambiguation for cross-language information retrieval , 2005, SIGIR '05.

[239]  Andreas Zell,et al.  Optimal assignment kernels for attributed molecular graphs , 2005, ICML.

[240]  Tatsuya Akutsu,et al.  Extensions of marginalized graph kernels , 2004, ICML.

[241]  S. Severini,et al.  The Laplacian of a Graph as a Density Matrix: A Basic Combinatorial Approach to Separability of Mixed States , 2004, quant-ph/0406165.

[242]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[243]  John S. Delaney,et al.  ESOL: Estimating Aqueous Solubility Directly from Molecular Structure , 2004, J. Chem. Inf. Model..

[244]  P. Dobson,et al.  Distinguishing enzyme structures from non-enzymes without alignments. , 2003, Journal of molecular biology.

[245]  Jiawei Han,et al.  gSpan: graph-based substructure pattern mining , 2002, 2002 IEEE International Conference on Data Mining, 2002. Proceedings..

[246]  George Karypis,et al.  Frequent subgraph discovery , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[247]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[248]  Takashi Washio,et al.  An Apriori-Based Algorithm for Mining Frequent Substructures from Graph Data , 2000, PKDD.

[249]  Yishay Mansour,et al.  Policy Gradient Methods for Reinforcement Learning with Function Approximation , 1999, NIPS.

[250]  Neil Immerman,et al.  An optimal lower bound on the number of variables for graph identification , 1989, 30th Annual Symposium on Foundations of Computer Science.

[251]  H. L. Morgan The Generation of a Unique Machine Description for Chemical Structures-A Technique Developed at Chemical Abstracts Service. , 1965 .

[252]  Stephen J. Garland,et al.  Algorithm 97: Shortest path , 1962, Commun. ACM.

[253]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[254]  Yoshua Bengio,et al.  Benchmarking Graph Neural Networks , 2023, J. Mach. Learn. Res..

[255]  L. Akoglu,et al.  Dual-discriminative Graph Neural Network for Imbalanced Graph-level Anomaly Detection , 2022, NeurIPS.

[256]  Asiri Wijesinghe,et al.  A New Perspective on "How Graph Neural Networks Go Beyond Weisfeiler-Lehman?" , 2022, ICLR.

[257]  Paul Honeine,et al.  Analyzing the Expressive Power of Graph Neural Networks in a Spectral Perspective , 2021, ICLR.

[258]  Hongfu Liu,et al.  On Dyadic Fairness: Exploring and Mitigating Bias in Graph Connections , 2021, ICLR.

[259]  Michalis Vazirgiannis,et al.  Random Walk Graph Neural Networks , 2020, NeurIPS.

[260]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[261]  A. A. LEMAN,et al.  THE REDUCTION OF A GRAPH TO CANONICAL FORM AND THE ALGEBRA WHICH APPEARS THEREIN , 2018 .

[262]  Wei Luo,et al.  Learning Graph Representation via Frequent Subgraphs , 2018, SDM.

[263]  Zhi-Li Zhang,et al.  Hunt For The Unique, Stable, Sparse And Fast Feature Learning On Graphs , 2017, NIPS.

[264]  Yann LeCun,et al.  Spectral Networks and Deep Locally Connected Networks on Graphs , 2014 .

[265]  Chengqi Zhang,et al.  Multi-Graph Learning with Positive and Unlabeled Bags , 2014, SDM.

[266]  Charu C. Aggarwal,et al.  On Classification of Graph Streams , 2011, SDM.

[267]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[268]  Ah Chung Tsoi,et al.  The Graph Neural Network Model , 2009, IEEE Transactions on Neural Networks.

[269]  Hans-Peter Kriegel,et al.  Protein function prediction via graph kernels , 2005, ISMB.

[270]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[271]  Thomas Gärtner,et al.  On Graph Kernels: Hardness Results and Efficient Alternatives , 2003, COLT.

[272]  David Haussler,et al.  Convolution kernels on discrete structures , 1999 .

[273]  Judea Pearl,et al.  MARKOV AND BAYESIAN NETWORKS: Two Graphical Representations of Probabilistic Knowledge , 1988 .