Network discovery using Reinforcement Learning

A serious challenge when finding influential actors in real-world social networks is the lack of knowledge about the structure of the underlying network. Current state-of-the-art methods rely on hand-crafted sampling algorithms to sample nodes in a carefully constructed order and choose opinion leaders from this discovered network to maximize influence spread in the complete network. In this work, we propose a deep reinforcement learning framework graph neural network modules for network discovery that automatically learns useful node and graph representations that encode important structural properties of the network. At training time, the method identifies portions of the network such that the nodes selected from this sampled subgraph can effectively influence nodes in the complete network. The learned policy can be directly applied on unseen graphs of similar domain. We experiment with real-world social networks and show that the policies learned by our RL agent provide a 7-23% improvement over the current state-ofthe-art method.

[1]  Milind Tambe,et al.  End-to-End Influence Maximization in the Field , 2018, AAMAS.

[2]  Milind Tambe,et al.  Bridging the Gap Between Theory and Practice in Influence Maximization: Raising Awareness about HIV among Homeless Youth , 2018, IJCAI.

[3]  Jure Leskovec,et al.  Hierarchical Graph Representation Learning with Differentiable Pooling , 2018, NeurIPS.

[4]  Nicole Immorlica,et al.  Maximizing Influence in an Unknown Social Network , 2018, AAAI.

[5]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[6]  Ryan A. Rossi,et al.  The Network Data Repository with Interactive Graph Analytics and Visualization , 2015, AAAI.

[7]  M. Begon,et al.  Spatial analyses of wildlife contact networks , 2015, Journal of The Royal Society Interface.

[8]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[9]  Arun G. Chandrasekhar,et al.  The Diffusion of Microfinance , 2012, Science.

[10]  Jure Leskovec,et al.  Community Structure in Large Networks: Natural Cluster Sizes and the Absence of Large Well-Defined Clusters , 2008, Internet Math..

[11]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[12]  International Foundation for Autonomous Agents and MultiAgent Systems ( IFAAMAS ) , 2007 .

[13]  Éva Tardos,et al.  Influential Nodes in a Diffusion Model for Social Networks , 2005, ICALP.

[14]  Jon Kleinberg,et al.  Maximizing the spread of influence through a social network , 2003, KDD '03.

[15]  R. Hanneman Introduction to Social Network Methods , 2001 .

[16]  S. Feld Why Your Friends Have More Friends Than You Do , 1991, American Journal of Sociology.

[17]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .