Adversarially Generating Rank-Constrained Graphs

Graph generation is a task that has been explored with a wide variety of methods. Recently, several papers have applied Generative Adversarial Networks (GANs) to this task, but most of these methods result in graphs of full or unknown rank. Many real-world graphs have low rank, which roughly translates to the number of communities in that graph. Furthermore, it has been shown that taking the low rank approximation of a graph can defend against adversarial attacks. This suggests that testing models against graphs of different rank may be useful. However, current methods provide no way to control the rank of generated graphs. In this paper, we propose two variants of BRGAN: GAN architectures that generates synthetic graphs, which in addition to having realistic graph features, also have bounded rank. Our first variant, BRGAN-A, generates synthetic graphs competitive with state-of-the-art models, with rank equal to or lower than the desired rank. Our second variant, BRGAN-B, generates graphs of almost exactly the desired rank, but results in less realistic results. We also propose a novel rank penalty term on the generator, which allows us to control this realism-rank tradeoff.

[1]  Nicola De Cao,et al.  MolGAN: An implicit generative model for small molecular graphs , 2018, ArXiv.

[2]  Bernhard Schölkopf,et al.  A Kernel Method for the Two-Sample-Problem , 2006, NIPS.

[3]  H. Kiers Towards a standardized notation and terminology in multiway analysis , 2000 .

[4]  Minyi Guo,et al.  GraphGAN: Graph Representation Learning with Generative Adversarial Nets , 2017, AAAI.

[5]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[6]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[7]  Yorgos Tsitsikas,et al.  NSVD: Normalized Singular Value Deviation Reveals Number of Latent Factors in Tensor Decomposition , 2020, SDM.

[8]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.

[9]  Johan Håstad,et al.  Tensor Rank is NP-Complete , 1989, ICALP.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[12]  Ove Frank,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[13]  D. Hunter,et al.  Inference in Curved Exponential Family Models for Networks , 2006 .

[14]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[15]  Xiang Wei,et al.  Improving the Improved Training of Wasserstein GANs: A Consistency Term and Its Dual Effect , 2018, ICLR.

[16]  S. Wasserman,et al.  Logit models and logistic regressions for social networks: I. An introduction to Markov graphs andp , 1996 .

[17]  Nikos Komodakis,et al.  GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders , 2018, ICANN.

[18]  Stephan Günnemann,et al.  NetGAN: Generating Graphs via Random Walks , 2018, ICML.

[19]  Saba A. Al-Sayouri,et al.  All You Need Is Low (Rank): Defending Against Adversarial Attacks on Graphs , 2020, WSDM.

[20]  Bert Huang,et al.  Labeled Graph Generative Adversarial Networks , 2019, ArXiv.

[21]  Edoardo M. Airoldi,et al.  A Survey of Statistical Network Models , 2009, Found. Trends Mach. Learn..

[22]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[23]  Jure Leskovec,et al.  GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models , 2018, ICML.

[24]  Evangelos E. Papalexakis,et al.  Automatic Unsupervised Tensor Mining with Quality Assessment , 2015, SDM.

[25]  Lise Getoor,et al.  Collective Classification in Network Data , 2008, AI Mag..