Community Preserving Network Embedding Based on Memetic Algorithm

Network embedding aims to embed network nodes into a low-dimensional and continuous vector space, which can benefit various downstream network analysis tasks. As it is an emerging topic in recent years, a variety of methods have been proposed to learn representations by preserving a network topology structure. However, it still remains challenging to incorporate a community structure into network embedding, which is ignored by most of the methods. In this paper, we present a novel memetic algorithm for network embedding, which is termed as MemeRep. As a matter of fact, the community structure is preserved by optimizing the modularity density. In our methods, genetic algorithm is adopted to optimize a population of solutions, and a problem-specific local search procedure with the two-level learning strategies is designed to accelerate the optimization process. The first-level learning strategy enables each node to learn from its neighbors, while the second-level learning strategy expands the learning area, which enables each node to learn from communities. Experiments on real-world and computer-generated networks show that the proposed algorithm outperforms several state-of-the-art methods in visualization, node classification, and community detection.

[1]  Yi Mei,et al.  An Efficient Feature Selection Algorithm for Evolving Job Shop Scheduling Rules With Genetic Programming , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[2]  Qiongkai Xu,et al.  GraRep: Learning Graph Representations with Global Structural Information , 2015, CIKM.

[3]  Kay Chen Tan,et al.  A Multi-Facet Survey on Memetic Computation , 2011, IEEE Transactions on Evolutionary Computation.

[4]  Jian Pei,et al.  Asymmetric Transitivity Preserving Graph Embedding , 2016, KDD.

[5]  Wei Chen,et al.  Galaxy Network Embedding: A Hierarchical Community Structure Preserving Approach , 2018, IJCAI.

[6]  Andrew McCallum,et al.  Automating the Construction of Internet Portals with Machine Learning , 2000, Information Retrieval.

[7]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[8]  Carlo Drioli,et al.  Exploiting CNNs for Improving Acoustic Source Localization in Noisy and Reverberant Conditions , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[9]  Maoguo Gong,et al.  Greedy discrete particle swarm optimization for large-scale social network clustering , 2015, Inf. Sci..

[10]  Xiao Huang,et al.  Label Informed Attributed Network Embedding , 2017, WSDM.

[11]  Hanqing Lu,et al.  CONE: Community Oriented Network Embedding , 2017, ArXiv.

[12]  Qi Shi,et al.  A Deep Learning Approach to Network Intrusion Detection , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[13]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[14]  Wei Lu,et al.  Deep Neural Networks for Learning Graph Representations , 2016, AAAI.

[15]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Deli Zhao,et al.  Network Representation Learning with Rich Text Information , 2015, IJCAI.

[17]  Charu C. Aggarwal,et al.  Attributed Signed Network Embedding , 2017, CIKM.

[18]  Zhen Ji,et al.  Towards a Memetic Feature Selection Paradigm [Application Notes] , 2010, IEEE Computational Intelligence Magazine.

[19]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[20]  Ying Wang,et al.  Quantitative Function for Community Detection , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Maoguo Gong,et al.  Structure optimization based on memetic algorithm for adjusting epidemic threshold on complex networks , 2016, Appl. Soft Comput..

[22]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[23]  Maoguo Gong,et al.  A memetic algorithm for computing and transforming structural balance in signed networks , 2015, Knowl. Based Syst..

[24]  Markus Olhofer,et al.  Evolutionary Many-Objective Optimization of Hybrid Electric Vehicle Control: From General Optimization to Preference Articulation , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[25]  D. Lusseau,et al.  The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations , 2003, Behavioral Ecology and Sociobiology.

[26]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[27]  Leon Danon,et al.  Comparing community structure identification , 2005, cond-mat/0505245.

[28]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[29]  Chang Zhou,et al.  Scalable Graph Embedding for Asymmetric Proximity , 2017, AAAI.

[30]  Haluk Bingol,et al.  Community Detection in Complex Networks Using Genetic Algorithms , 2006, 0711.0491.

[31]  Xuanjing Huang,et al.  Incorporate Group Information to Enhance Network Embedding , 2016, CIKM.

[32]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Jin-Kao Hao,et al.  A Memetic Algorithm for Community Detection in Complex Networks , 2012, PPSN.

[34]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[35]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[36]  Maoguo Gong,et al.  Network Structural Balance Based on Evolutionary Multiobjective Optimization: A Two-Step Approach , 2015, IEEE Transactions on Evolutionary Computation.

[37]  Christian Blum,et al.  Hybrid metaheuristics in combinatorial optimization: A survey , 2011, Appl. Soft Comput..

[38]  Jian Pei,et al.  Community Preserving Network Embedding , 2017, AAAI.

[39]  Anfeng Liu,et al.  A Three-Layer Privacy Preserving Cloud Storage Scheme Based on Computational Intelligence in Fog Computing , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[40]  Jun Zhang,et al.  Evolutionary Computation Meets Machine Learning: A Survey , 2011, IEEE Computational Intelligence Magazine.

[41]  Zhiyuan Liu,et al.  Max-Margin DeepWalk: Discriminative Learning of Network Representation , 2016, IJCAI.

[42]  Jie Liu,et al.  Multi-level learning based memetic algorithm for community detection , 2014, Appl. Soft Comput..

[43]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  Bo Zhang,et al.  Discriminative Deep Random Walk for Network Classification , 2016, ACL.

[45]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.