Estimating latent positions of actors using Neural Networks in R with GCN4R

Network analysis methods are useful to better understand and contextualize relationships between entities. While statistical and machine learning prediction models generally assume independence between actors, network-based statistical methods for social network data allow for dyadic dependence between actors. While numerous methods have been developed for the R statistical software to analyze such data, deep learning methods have not been implemented in this language. Here, we introduce GCN4R, an R library for fitting graph neural networks on independent networks to aggregate actor covariate information to yield meaningful embeddings for a variety of network-based tasks (e.g. community detection, peer effects models, social influence). We provide an extensive overview of insights and methods utilized by the deep learning community on learning on social and biological networks, followed by a tutorial that demonstrates some of the capabilities of the GCN4R framework to make these methods more accessible to the R research community.

[1]  A James O'Malley,et al.  Hierarchical longitudinal models of relationships in social networks , 2013, Journal of the Royal Statistical Society. Series C, Applied statistics.

[2]  Jure Leskovec,et al.  Modeling polypharmacy side effects with graph convolutional networks , 2018, bioRxiv.

[3]  J R Fielding,et al.  Bayesian regression methodology for estimating a receiver operating characteristic curve with two radiologic applications: prostate biopsy and spiral CT of ureteral stones. , 2001, Academic radiology.

[4]  Cesare Alippi,et al.  Spectral Clustering with Graph Neural Networks for Graph Pooling , 2019, ICML.

[5]  Yixin Chen,et al.  Link Prediction Based on Graph Neural Networks , 2018, NeurIPS.

[6]  Julia Hirschberg,et al.  V-Measure: A Conditional Entropy-Based External Cluster Evaluation Measure , 2007, EMNLP.

[7]  Max Welling,et al.  Modeling Relational Data with Graph Convolutional Networks , 2017, ESWC.

[8]  E. Lazega Introduction : Collegial Phenomenon : The Social Mechanisms of Cooperation Among Peers in a Corporate Law Partnership , 2001 .

[9]  Francisco Gómez-Vela,et al.  Computational methods for Gene Regulatory Networks reconstruction and analysis: A review , 2019, Artif. Intell. Medicine.

[10]  A James O'Malley,et al.  The analysis of social network data: an exciting frontier for statisticians , 2012, Statistics in medicine.

[11]  A. Raftery,et al.  Model‐based clustering for social networks , 2007 .

[12]  Martina Morris,et al.  A statnet Tutorial. , 2008, Journal of statistical software.

[13]  S. Wasserman A Stochastic Model for Directed Graphs with Transition Rates Determined by Reciprocity , 1980 .

[14]  Lina Yao,et al.  Adversarially Regularized Graph Autoencoder , 2018, IJCAI.

[15]  Zhiyuan Liu,et al.  Graph Neural Networks: A Review of Methods and Applications , 2018, AI Open.

[16]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[17]  John Quackenbush,et al.  PyPanda: a Python package for gene regulatory network reconstruction , 2016, Bioinform..

[18]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[19]  Roger Th. A. J. Leenders,et al.  Modeling social influence through network autocorrelation: constructing the weight matrix , 2002, Soc. Networks.

[20]  Jure Leskovec,et al.  GNNExplainer: Generating Explanations for Graph Neural Networks , 2019, NeurIPS.

[21]  Pietro Liò,et al.  Deep Graph Infomax , 2018, ICLR.

[22]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[23]  Steve Horvath,et al.  WGCNA: an R package for weighted correlation network analysis , 2008, BMC Bioinformatics.

[24]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[25]  Jure Leskovec,et al.  Representation Learning on Graphs: Methods and Applications , 2017, IEEE Data Eng. Bull..

[26]  P. Pattison,et al.  New Specifications for Exponential Random Graph Models , 2006 .

[27]  Hui Xiong,et al.  Understanding of Internal Clustering Validation Measures , 2010, 2010 IEEE International Conference on Data Mining.

[28]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[29]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[30]  Roded Sharan,et al.  To Embed or Not: Network Embedding as a Paradigm in Computational Biology , 2019, Front. Genet..

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  Xia Hu,et al.  Deep Representation Learning for Social Network Analysis , 2019, Front. Big Data.

[33]  Peter J. Mucha,et al.  A Map Equation with Metadata: Varying the Role of Attributes in Community Detection , 2018, Physical review. E.

[34]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[35]  Éric Gaussier,et al.  Deep k-Means: Jointly Clustering with k-Means and Learning Representations , 2018, Pattern Recognit. Lett..

[36]  Pavel N Krivitsky,et al.  Fitting Position Latent Cluster Models for Social Networks with latentnet. , 2008, Journal of statistical software.

[37]  A. James O’Malley,et al.  The analysis of social networks , 2008, Health Services and Outcomes Research Methodology.

[38]  Yuxiao Dong,et al.  DeepInf: Social Influence Prediction with Deep Learning , 2018, KDD.

[39]  Martina Morris,et al.  statnet: Software Tools for the Representation, Visualization, Analysis and Simulation of Network Data. , 2008, Journal of statistical software.

[40]  Ankur Taly,et al.  Axiomatic Attribution for Deep Networks , 2017, ICML.

[41]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[42]  E. Lazega The Collegial Phenomenon , 2001 .

[43]  David Hevey,et al.  Network analysis: a brief overview and tutorial , 2018, Health psychology and behavioral medicine.

[44]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[45]  Jie Chen,et al.  EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphs , 2020, AAAI.

[46]  Mark Heimann,et al.  Generalizing Graph Neural Networks Beyond Homophily , 2020, ArXiv.

[47]  Peter D. Hoff,et al.  Latent Space Approaches to Social Network Analysis , 2002 .

[48]  Martina Morris,et al.  Specification of Exponential-Family Random Graph Models: Terms and Computational Aspects. , 2008, Journal of statistical software.

[49]  Marcus D. Ruopp,et al.  Youden Index and Optimal Cut‐Point Estimated from Observations Affected by a Lower Limit of Detection , 2008, Biometrical journal. Biometrische Zeitschrift.

[50]  Dena Marie Asta,et al.  The Geometry of Continuous Latent Space Models for Network Data , 2017, Statistical science : a review journal of the Institute of Mathematical Statistics.

[51]  Pietro Lio,et al.  Deep Graph Mapper: Seeing Graphs Through the Neural Lens , 2020, Frontiers in Big Data.

[52]  Dietrich Rebholz-Schuhmann,et al.  Deep learning-based clustering approaches for bioinformatics , 2020, Briefings Bioinform..