Detecting Communities in Networks: a Decentralized Approach Based on Multiagent Reinforcement Learning

An important problem in network science is finding relevant community structures in complex networks. A community structure is a partition of the network nodes into clusters or modules, such that each cluster is densely connected. Current community detection algorithms have time complexity, centralization, and scalability issues. In this paper, to solve this problem, we implement a multi-agent reinforcement learning algorithm that optimizes a quality metric known as modularity. We model each node of the network as an autonomous agent that can choose other nodes to form a cluster with. They receive a reward and learn a policy that maps actions to their values. Experiments on known real-world networks show results similar to other modularity optimization methods while providing answers for decentralization, data privacy, and scalability.

[1]  Lotfi Ben Romdhane,et al.  Community detection in large-scale social networks: state-of-the-art and future directions , 2019, Social Network Analysis and Mining.

[2]  Christos Faloutsos,et al.  Graph evolution: Densification and shrinking diameters , 2006, TKDD.

[3]  Yuanqing Xia,et al.  An Extreme Learning Machine-Based Community Detection Algorithm in Complex Networks , 2018, Complex..

[4]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Lincoln Stein,et al.  Reactome: a knowledgebase of biological pathways , 2004, Nucleic Acids Res..

[6]  Sergio Gómez,et al.  Size reduction of complex networks preserving modularity , 2007, ArXiv.

[7]  A. Barabasi,et al.  Network medicine : a network-based approach to human disease , 2010 .

[8]  Réka Albert,et al.  Near linear time algorithm to detect community structures in large-scale networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  M E J Newman,et al.  Fast algorithm for detecting community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Leon Danon,et al.  Comparing community structure identification , 2005, cond-mat/0505245.

[11]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[12]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[13]  Andrea Lancichinetti,et al.  Community detection algorithms: a comparative analysis: invited presentation, extended abstract , 2009, VALUETOOLS.

[14]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[15]  Clara Pizzuti,et al.  GA-Net: A Genetic Algorithm for Community Detection in Social Networks , 2008, PPSN.

[16]  Zhaoxing Li,et al.  A novel multiobjective particle swarm optimization algorithm for signed network community detection , 2015, Applied Intelligence.

[17]  Chen Liu,et al.  A hybrid evolutionary algorithm for community detection , 2017, WI.

[18]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[19]  Dayou Liu,et al.  Genetic Algorithm with a Local Search Strategy for Discovering Communities in Complex Networks , 2013, Int. J. Comput. Intell. Syst..

[20]  Mao-Bin Hu,et al.  Detect overlapping and hierarchical community structure in networks , 2008, ArXiv.

[21]  David Lusseau,et al.  The emergent properties of a dolphin social network , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[22]  Cheng Wu,et al.  Targeted revision: A learning-based approach for incremental community detection in dynamic networks , 2016 .

[23]  Clara Pizzuti,et al.  Self-adaptive Differential Evolution for Community Detection , 2019, 2019 Sixth International Conference on Social Networks Analysis, Management and Security (SNAMS).

[24]  Camelia Chira,et al.  Evolutionary detection of community structures in complex networks: A new fitness function , 2012, 2012 IEEE Congress on Evolutionary Computation.

[25]  Rolf T. Wigand,et al.  Community Detection in Complex Networks: Multi-objective Enhanced Firefly Algorithm , 2013, Knowl. Based Syst..

[26]  Zhangtao Li,et al.  A Multiobjective Evolutionary Algorithm Based on Structural and Attribute Similarities for Community Detection in Attributed Networks , 2018, IEEE Transactions on Cybernetics.

[27]  Barbora Micenková,et al.  Clustering attributed graphs: Models, measures and methods , 2015, Network Science.

[28]  Maoguo Gong,et al.  Discrete particle swarm optimization for identifying community structures in signed social networks , 2014, Neural Networks.

[29]  Michalis Vazirgiannis,et al.  Clustering and Community Detection in Directed Networks: A Survey , 2013, ArXiv.

[30]  Francesco Folino,et al.  An Evolutionary Multiobjective Approach for Community Discovery in Dynamic Networks , 2014, IEEE Transactions on Knowledge and Data Engineering.

[31]  Xu Zhou,et al.  A multiobjective discrete bat algorithm for community detection in dynamic networks , 2018, Applied Intelligence.

[32]  Keith C. C. Chan,et al.  Evolutionary community detection in social networks , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[33]  S. Durga Bhavani,et al.  Community Detection in Social Networks Using Deep Learning , 2019, ICDCIT.

[34]  Ying Wang,et al.  Quantitative Function for Community Detection , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[36]  Yixin Chen,et al.  Detecting Community Structure in Networks Based on Ant Colony Optimization , 2012 .

[37]  Pooya Moradian Zadeh,et al.  A Multi-Population Cultural Algorithm for Community Detection in Social Networks , 2015, ANT/SEIT.

[38]  Mohammad Reza Meybodi,et al.  Distributed learning automata-based algorithm for community detection in complex networks , 2016 .

[39]  Jianwu Dang,et al.  Incorporating network structure with node contents for community detection on large networks using deep learning , 2018, Neurocomputing.

[40]  Xiaochun Cao,et al.  Modularity Based Community Detection with Deep Learning , 2016, IJCAI.

[41]  Xiangxiang Zeng,et al.  A Network Reduction-Based Multiobjective Evolutionary Algorithm for Community Detection in Large-Scale Complex Networks , 2020, IEEE Transactions on Cybernetics.

[42]  Clara Pizzuti,et al.  Community Detection in Attributed Graphs with Differential Evolution , 2020, EvoApplications.

[43]  Aboul Ella Hassanien,et al.  A Discrete Bat Algorithm for the Community Detection Problem , 2015, HAIS.

[44]  Clara Pizzuti,et al.  Evolutionary Computation for Community Detection in Networks: A Review , 2018, IEEE Transactions on Evolutionary Computation.

[45]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[46]  Boleslaw K. Szymanski,et al.  Overlapping community detection in networks: The state-of-the-art and comparative study , 2011, CSUR.

[47]  Craig Boutilier,et al.  The Dynamics of Reinforcement Learning in Cooperative Multiagent Systems , 1998, AAAI/IAAI.

[48]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[49]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[50]  Camelia Chira,et al.  A parallel evolutionary approach to community detection in complex networks , 2017, 2017 13th IEEE International Conference on Intelligent Computer Communication and Processing (ICCP).

[51]  Xu Zhou,et al.  An ant colony based algorithm for overlapping community detection in complex networks , 2015 .

[52]  Camelia Chira,et al.  Evolutionary community detection in complex and dynamic networks , 2016, 2016 IEEE 12th International Conference on Intelligent Computer Communication and Processing (ICCP).