FlowGEN: A Generative Model for Flow Graphs

Flow graphs capture the directed flow of a quantity of interest (e.g., water, power, vehicles) being transported through an underlying network. Modeling and generating realistic flow graphs is key in many applications in infrastructure design, transportation, and biomedical and social sciences. However, they pose a great challenge to existing generative models due to a complex dynamics that is often governed by domain-specific physical laws or patterns. We introduce FlowGEN, an implicit generative model for flow graphs, that learns how to jointly generate graph topologies and flows with diverse dynamics directly from data using a novel (flow) graph neural network. Experiments show that our approach is able to effectively reproduce relevant local and global properties of flow graphs, including flow conservation, cyclic trends, and congestion around hotspots.

[1]  Bo Dai,et al.  Scalable Deep Generative Modeling for Sparse Graphs , 2020, ICML.

[2]  Jessica T Davis,et al.  The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak , 2020, Science.

[3]  Stefano Ermon,et al.  Permutation Invariant Graph Generation via Score-Based Generative Modeling , 2020, AISTATS.

[4]  Jessica T Davis,et al.  The effect of travel restrictions on the spread of the 2019 novel coronavirus (2019-nCoV) outbreak , 2020, medRxiv.

[5]  Weinan Zhang,et al.  GraphAF: a Flow-based Autoregressive Model for Molecular Graph Generation , 2020, ICLR.

[6]  Harsh Jain,et al.  GraphGen: A Scalable Approach to Domain-agnostic Labeled Graph Generation , 2020, WWW.

[7]  Henry A. Kautz,et al.  Hierarchical organization of urban mobility and its connection with city livability , 2019, Nature Communications.

[8]  Renjie Liao,et al.  Efficient Graph Generation with Graph Recurrent Attention Networks , 2019, NeurIPS.

[9]  Sanja Fidler,et al.  Neural Turtle Graphics for Modeling City Road Layouts , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[10]  Yang Song,et al.  Generative Modeling by Estimating Gradients of the Data Distribution , 2019, NeurIPS.

[11]  Santiago Segarra,et al.  Graph-based Semi-Supervised & Active Learning for Edge Flows , 2019, KDD.

[12]  Aviral Kumar,et al.  Graph Normalizing Flows , 2019, NeurIPS.

[13]  Tom Brown,et al.  PyPSA-Eur: An open optimisation model of the European transmission system , 2018, Energy Strategy Reviews.

[14]  Oleksandr Polozov,et al.  Generative Code Modeling with Graphs , 2018, ICLR.

[15]  Francesco Bullo,et al.  Electrical Networks and Algebraic Graph Theory: Models, Properties, and Applications , 2018, Proceedings of the IEEE.

[16]  Stefano Ermon,et al.  Graphite: Iterative Generative Modeling of Graphs , 2018, ICML.

[17]  Pradeep Ravikumar,et al.  DAGs with NO TEARS: Continuous Optimization for Structure Learning , 2018, NeurIPS.

[18]  Stephan Günnemann,et al.  NetGAN: Generating Graphs via Random Walks , 2018, ICML.

[19]  Jure Leskovec,et al.  GraphRNN: Generating Realistic Graphs with Deep Auto-regressive Models , 2018, ICML.

[20]  Razvan Pascanu,et al.  Learning Deep Generative Models of Graphs , 2018, ICLR 2018.

[21]  Regina Barzilay,et al.  Junction Tree Variational Autoencoder for Molecular Graph Generation , 2018, ICML.

[22]  Nikos Komodakis,et al.  GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders , 2018, ICANN.

[23]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[24]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[25]  Charles A. Sutton,et al.  VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning , 2017, NIPS.

[26]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[27]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[28]  Max Welling,et al.  Variational Graph Auto-Encoders , 2016, ArXiv.

[29]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[30]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Richard S. Zemel,et al.  Gated Graph Sequence Neural Networks , 2015, ICLR.

[32]  Matthias Bethge,et al.  A note on the evaluation of generative models , 2015, ICLR.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  Aaron C. Courville,et al.  Generative adversarial networks , 2014, Commun. ACM.

[35]  Florian Dörfler,et al.  Synchronization in complex networks of phase oscillators: A survey , 2014, Autom..

[36]  Mauro Garavello,et al.  Flows on networks: recent results and perspectives , 2014 .

[37]  Diederik P. Kingma,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[38]  Liang Liu,et al.  Estimating Origin-Destination Flows Using Mobile Phone Location Data , 2011, IEEE Pervasive Computing.

[39]  Jeffrey D Orth,et al.  What is flux balance analysis? , 2010, Nature Biotechnology.

[40]  David J. Hill,et al.  Power systems as dynamic networks , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[41]  Andrzej Rucinski,et al.  Random Graphs , 2018, Foundations of Data Science.

[42]  V. Latora,et al.  Modeling cascading failures in the North American power grid , 2004, cond-mat/0410318.

[43]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[44]  M. Newman,et al.  Mixing patterns in networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[46]  William F. Tinney,et al.  Optimal Power Flow Solutions , 1968 .

[47]  Ananthram Swami,et al.  Combining Physics and Machine Learning for Network Flow Estimation , 2021, ICLR.

[48]  Wenhan Shi,et al.  Conditional Structure Generation through Graph Variational Generative Adversarial Nets , 2019, NeurIPS.