Finding overlapping community from social networks based on community forest model

We extend the community forest model to overlapping community forest model.We propose the definition of overlapping community and disjoint community.We develop a novel overlapping community detection algorithm named CFM.CFM has better performance than MMSB, Louvain method and CPM. Overlapping community detection is the key research work to discover and explore the social networks. A great deal of work has been devoted to detect overlapping communities, but no one can give a clear formula definition of community from the internal structure to the external boundary. More in depth, there are four challenges to existing research works. In this paper, firstly we propose overlapping community forest model and disjoint community forest model based on the community forest model, secondly give a clear formula definition of overlapping community and disjoint community based on the backbone degree and expansion, thirdly propose a novel algorithm to find overlapping communities based on the backbone degree and expansion to resolve the four challenges. This algorithm has better performance than four related algorithms mentioned by this paper in large scale social networks. It works well on American college football, Zachary's Karate Club, Netscience-coauthor, Condensed matter collaborations, LFR etc. data sets.

[1]  Xing-yuan Wang,et al.  Detecting one-mode communities in bipartite networks by bipartite clustering triangular , 2016 .

[2]  M. Newman,et al.  The structure of scientific collaboration networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Xingyuan Wang,et al.  Community detection using local neighborhood in complex networks , 2015 .

[4]  Gan Wen.  Community Discovery Method in Networks Based on Topological Potential , 2009 .

[5]  Xingyuan Wang,et al.  Approximating web communities using subspace decomposition , 2014, Knowl. Based Syst..

[6]  Breck Baldwin,et al.  Entity-Based Cross-Document Coreferencing Using the Vector Space Model , 1998, COLING.

[7]  Boleslaw K. Szymanski,et al.  Overlapping community detection in networks: The state-of-the-art and comparative study , 2011, CSUR.

[8]  M. Newman,et al.  Finding community structure in networks using the eigenvectors of matrices. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Fergal Reid,et al.  Partitioning Breaks Communities , 2011, ASONAM.

[10]  David M Blei,et al.  Efficient discovery of overlapping communities in massive networks , 2013, Proceedings of the National Academy of Sciences.

[11]  Jianzhong Li,et al.  Efficient community detection with additive constrains on large networks , 2013, Knowl. Based Syst..

[12]  Stephen B. Seidman,et al.  Network structure and minimum degree , 1983 .

[13]  Shuang Wu,et al.  Clustering and overlapping modules detection in PPI network based on IBFO , 2013, Proteomics.

[14]  Alexander Struck,et al.  Identification of overlapping communities and their hierarchy by locally calculating community-changing resolution levels , 2010, ArXiv.

[15]  Youngdo Kim,et al.  Map equation for link communities. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  Qiang Wang,et al.  Topic oriented community detection through social objects and link analysis in social networks , 2012, Knowl. Based Syst..

[17]  T. Vicsek,et al.  Uncovering the overlapping community structure of complex networks in nature and society , 2005, Nature.

[18]  Huawei Shen,et al.  Quantifying and identifying the overlapping community structure in networks , 2009, 0905.2666.

[19]  Andrea Lancichinetti,et al.  Detecting the overlapping and hierarchical community structure in complex networks , 2008, 0802.1218.

[20]  Ronald S. Burt,et al.  Structural Holes: The Social Structure of Competition. , 1994 .

[21]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[22]  Xingyuan Wang,et al.  Epidemic spreading in time-varying community networks , 2014, Chaos.

[23]  T. S. Evans,et al.  Clique graphs and overlapping communities , 2010, ArXiv.

[24]  Hua Xu,et al.  A novel disjoint community detection algorithm for social networks based on backbone degree and expansion , 2015, Expert Syst. Appl..

[25]  Yong-Yeol Ahn,et al.  Communities and Hierarchical Organization of Links in Complex Networks , 2009 .

[26]  Xing-yuan Wang,et al.  Uncovering the overlapping community structure of complex networks by maximal cliques , 2014 .

[27]  Edoardo M. Airoldi,et al.  Mixed Membership Stochastic Blockmodels , 2007, NIPS.

[28]  Xing-yuan Wang,et al.  Detecting community structure via the maximal sub-graphs and belonging degrees in complex networks , 2014 .

[29]  Xingyuan Wang,et al.  Detecting overlapping communities by seed community in weighted complex networks , 2013 .

[30]  P. Latouche,et al.  Overlapping stochastic block models with application to the French political blogosphere , 2009, 0910.2098.

[31]  Xingyuan Wang,et al.  Uncovering overlapping community structures by the key bi-community and intimate degree in bipartite networks , 2014 .

[32]  R. Lambiotte,et al.  Line graphs, link partitions, and overlapping communities. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  Santosh S. Vempala,et al.  On clusterings: Good, bad and spectral , 2004, JACM.

[34]  Mao-Bin Hu,et al.  Detect overlapping and hierarchical community structure in networks , 2008, ArXiv.

[35]  Claudio Castellano,et al.  Defining and identifying communities in networks. , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Sune Lehmann,et al.  Link communities reveal multiscale complexity in networks , 2009, Nature.

[37]  Jure Leskovec,et al.  Empirical comparison of algorithms for network community detection , 2010, WWW '10.

[38]  Jian-Min Wang,et al.  Community Discovery Method in Networks Based on Topological Potential: Community Discovery Method in Networks Based on Topological Potential , 2009 .

[39]  Xing-yuan Wang,et al.  Overlapping community detection using neighborhood ratio matrix , 2015 .

[40]  Jure Leskovec,et al.  Overlapping community detection at scale: a nonnegative matrix factorization approach , 2013, WSDM.

[41]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Xingyi Zhang,et al.  Overlapping Community Detection based on Network Decomposition , 2016, Scientific Reports.

[43]  Xing-yuan Wang,et al.  Detecting overlapping communities in networks using the maximal sub-graph and the clustering coefficient , 2014 .

[44]  Julio Gonzalo,et al.  A comparison of extrinsic clustering evaluation metrics based on formal constraints , 2008, Information Retrieval.

[45]  Tang Jinhui,et al.  Overlapping community detection based on node location analysis , 2016 .

[46]  Xing-yuan Wang,et al.  Detecting communities by the core-vertex and intimate degree in complex networks , 2013 .

[47]  S. Fortunato,et al.  Resolution limit in community detection , 2006, Proceedings of the National Academy of Sciences.

[48]  Joydeep Ghosh,et al.  Model-based overlapping clustering , 2005, KDD '05.

[49]  Andrea Lancichinetti,et al.  Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[50]  Jon Kleinberg,et al.  Authoritative sources in a hyperlinked environment , 1999, SODA '98.

[51]  Inderjit S. Dhillon,et al.  Overlapping Community Detection Using Neighborhood-Inflated Seed Expansion , 2015, IEEE Transactions on Knowledge and Data Engineering.

[52]  Mark E. J. Newman,et al.  Spectral methods for network community detection and graph partitioning , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[53]  Julio Gonzalo,et al.  The SemEval-2007 WePS Evaluation: Establishing a benchmark for the Web People Search Task , 2007, Fourth International Workshop on Semantic Evaluations (SemEval-2007).

[54]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[55]  Jie Tang,et al.  Mining structural hole spanners through information diffusion in social networks , 2013, WWW.

[56]  Teng Wang,et al.  Identifying different community members in complex networks based on topology potential , 2011, Frontiers of Computer Science in China.

[57]  J. Connell,et al.  Mechanisms of Succession in Natural Communities and Their Role in Community Stability and Organization , 1977, The American Naturalist.