Multi-species Protein Association Prediction Using Residual Graph Convolutional Network

Graph Convolutional Networks have recently received a lot of attention for their capability of representation learning on non-Euclidian feature spaces. Graph convolutional networks aggregate the neighbouring node features and attribute to learn graph representations. Like traditional deep learning models, the representation power of graph convolutional networks also increases with the increasing number of layers. However, it also increases the difficulty associated with training such models. Deep graph convolutional networks suffer from issues like vanishing gradient or over-fitting. In this paper, we explored skip connections in graph convolutional networks and proposed a deep residual graph convolutional neural network for predicting node properties in a protein-protein interaction network. The proposed model is an improvement over traditional deep learning models and present state-of-the-art graph learning algorithms. The implementation of the algorithm, as well as the saved model, is available online for reproducibility at https://github.com/rangan2510/R-GCN.

[1]  The Gene Ontology Consortium,et al.  The Gene Ontology Resource: 20 years and still GOing strong , 2018, Nucleic Acids Res..

[2]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[5]  Huan Liu,et al.  Relational learning via latent social dimensions , 2009, KDD.

[6]  Jure Leskovec,et al.  Open Graph Benchmark: Datasets for Machine Learning on Graphs , 2020, NeurIPS.

[7]  Dahua Lin,et al.  Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition , 2018, AAAI.

[8]  Xiao-Ming Wu,et al.  Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning , 2018, AAAI.

[9]  Ken-ichi Kawarabayashi,et al.  Representation Learning on Graphs with Jumping Knowledge Networks , 2018, ICML.

[10]  Erik Cambria,et al.  Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis , 2015, EMNLP.

[11]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[12]  Jorge Sepulcre,et al.  Neurogenetic profiles delineate large-scale connectivity dynamics of the human brain , 2018, Nature Communications.

[13]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[14]  Abhinav Gupta,et al.  Videos as Space-Time Region Graphs , 2018, ECCV.

[15]  Khalil Sima'an,et al.  Graph Convolutional Encoders for Syntax-aware Neural Machine Translation , 2017, EMNLP.

[16]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[17]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[18]  Svetha Venkatesh,et al.  Column Networks for Collective Classification , 2016, AAAI.

[19]  Ujjwal Maulik,et al.  Structural facets of POU2F1 in light of the functional annotations and sequence-structure patterns , 2020, Journal of biomolecular structure & dynamics.

[20]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[21]  Ichigaku Takigawa,et al.  Graph mining: procedure, application to drug discovery and recent advances. , 2013, Drug discovery today.

[22]  Xavier Bresson,et al.  Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks , 2017, NIPS.

[23]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[24]  James C. Hu,et al.  The Gene Ontology Resource: 20 years and still GOing strong , 2019 .

[25]  Si Zhang,et al.  Graph convolutional networks: a comprehensive review , 2019, Computational Social Networks.

[26]  Deng Cai,et al.  Learning Graph-Level Representation for Drug Discovery , 2017, ArXiv.

[27]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Shuicheng Yan,et al.  Semantic Object Parsing with Graph LSTM , 2016, ECCV.

[29]  Ujjwal Maulik,et al.  Understanding the evolutionary trend of intrinsically structural disorders in cancer relevant proteins as probed by Shannon entropy scoring and structure network analysis , 2018, BMC Bioinformatics.

[30]  Timothy Baldwin,et al.  Semi-supervised User Geolocation via Graph Convolutional Networks , 2018, ACL.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Damian Szklarczyk,et al.  STRING v11: protein–protein association networks with increased coverage, supporting functional discovery in genome-wide experimental datasets , 2018, Nucleic Acids Res..

[33]  Dieter Galea,et al.  HyperFoods: Machine intelligent mapping of cancer-beating molecules in foods , 2019, Scientific Reports.

[34]  Jeffrey C. Grossman,et al.  Graph dynamical networks for unsupervised learning of atomic scale dynamics in materials , 2019, Nature Communications.

[35]  Davide Heller,et al.  STRING v10: protein–protein interaction networks, integrated over the tree of life , 2014, Nucleic Acids Res..