Nonparametric Bayesian modeling of complex networks: an introduction

Modeling structure in complex networks using Bayesian nonparametrics makes it possible to specify flexible model structures and infer the adequate model complexity from the observed data. This article provides a gentle introduction to nonparametric Bayesian modeling of complex networks: Using an infinite mixture model as running example, we go through the steps of deriving the model as an infinite limit of a finite parametric model, inferring the model parameters by Markov chain Monte Carlo, and checking the model?s fit and predictive performance. We explain how advanced nonparametric models for complex networks can be derived and point out relevant literature.

[1]  Hans-Peter Kriegel,et al.  Learning Infinite Hidden Relational Models , 2006 .

[2]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[3]  Radford M. Neal,et al.  A Split-Merge Markov chain Monte Carlo Procedure for the Dirichlet Process Mixture Model , 2004 .

[4]  B. Schölkopf,et al.  Modeling Dyadic Data with Binary Latent Factors , 2007 .

[5]  Edward T. Bullmore,et al.  Modular and Hierarchically Modular Organization of Brain Networks , 2010, Front. Neurosci..

[6]  Hartwig R. Siebner,et al.  Identifying modular relations in complex brain networks , 2012, 2012 IEEE International Workshop on Machine Learning for Signal Processing.

[7]  Lars Kai Hansen,et al.  Modelling dense relational data , 2012, 2012 IEEE International Workshop on Machine Learning for Signal Processing.

[8]  Mikkel N. Schmidt,et al.  Nonparametric Bayesian models of hierarchical structure in complex networks , 2013, 1311.1033.

[9]  P. McCullagh,et al.  Gibbs fragmentation trees , 2007, 0704.0945.

[10]  Naonori Ueda,et al.  Dynamic Infinite Relational Model for Time-varying Relational Data Analysis , 2010, NIPS.

[11]  Purnamrita Sarkar,et al.  Nonparametric Link Prediction in Dynamic Networks , 2012, ICML.

[12]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Ove Frank,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[14]  Naonori Ueda,et al.  Subset Infinite Relational Models , 2012, AISTATS.

[15]  P. Green,et al.  Modelling Heterogeneity With and Without the Dirichlet Process , 2001 .

[16]  Garry Robins,et al.  An introduction to exponential random graph (p*) models for social networks , 2007, Soc. Networks.

[17]  Pavel N Krivitsky,et al.  Fitting Position Latent Cluster Models for Social Networks with latentnet. , 2008, Journal of statistical software.

[18]  T. Snijders,et al.  Estimation and Prediction for Stochastic Blockstructures , 2001 .

[19]  P. Bork,et al.  A side effect resource to capture phenotypic effects of drugs , 2010, Molecular systems biology.

[20]  Hans-Peter Kriegel,et al.  Infinite Hidden Relational Models , 2006, UAI.

[21]  Radford M. Neal Bayesian Mixture Modeling , 1992 .

[22]  O. Sporns Networks of the Brain , 2010 .

[23]  S. Wasserman,et al.  Models and Methods in Social Network Analysis: An Introduction to Random Graphs, Dependence Graphs, and p * , 2005 .

[24]  Thomas L. Griffiths,et al.  Infinite latent feature models and the Indian buffet process , 2005, NIPS.

[25]  Peter D. Hoff,et al.  Multiplicative latent factor models for description and prediction of social networks , 2009, Comput. Math. Organ. Theory.

[26]  Kan Li,et al.  Detecting hierarchical structure of community members in social networks , 2015, Knowl. Based Syst..

[27]  HERBERT A. SIMON,et al.  The Architecture of Complexity , 1991 .

[28]  Jay Liebowitz The Hidden Power of Social Networks and Knowledge Sharing in Healthcare , 2007 .

[29]  Edoardo M. Airoldi,et al.  Stochastic Block Models of Mixed Membership , 2006 .

[30]  G. Cecchi,et al.  Scale-free brain functional networks. , 2003, Physical review letters.

[31]  Santo Fortunato,et al.  Community detection in graphs , 2009, ArXiv.

[32]  Roger Guimerà,et al.  Extracting the hierarchical organization of complex systems , 2007, Proceedings of the National Academy of Sciences.

[33]  Thomas L. Griffiths,et al.  Learning Systems of Concepts with an Infinite Relational Model , 2006, AAAI.

[34]  Morten Mørup,et al.  Bayesian Community Detection , 2012, Neural Computation.

[35]  Thomas L. Griffiths,et al.  The Indian Buffet Process: An Introduction and Review , 2011, J. Mach. Learn. Res..

[36]  Christos Faloutsos,et al.  Dynamics of large networks , 2008 .

[37]  Edoardo M. Airoldi,et al.  Mixed Membership Stochastic Blockmodels , 2007, NIPS.

[38]  Yee Whye Teh,et al.  The Mondrian Process , 2008, NIPS.

[39]  Carl Knappett,et al.  Introduction: Why Networks? , 2013 .

[40]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[41]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[42]  Lars Kai Hansen,et al.  Infinite multiple membership relational modeling for complex networks , 2011, 2011 IEEE International Workshop on Machine Learning for Signal Processing.

[43]  Zoubin Ghahramani,et al.  An Infinite Latent Attribute Model for Network Data , 2012, ICML.

[44]  A. Barabasi,et al.  Hierarchical Organization of Modularity in Metabolic Networks , 2002, Science.

[45]  Chris H Wiggins,et al.  Bayesian approach to network modularity. , 2007, Physical review letters.

[46]  D. Aldous Exchangeability and related topics , 1985 .

[47]  Samuel J. Gershman,et al.  A Tutorial on Bayesian Nonparametric Models , 2011, 1106.2697.

[48]  Mark E. J. Newman,et al.  Stochastic blockmodels and community structure in networks , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[50]  Thomas Hofmann,et al.  Learning annotated hierarchies from relational data , 2007 .

[51]  Zoubin Ghahramani,et al.  Infinite Sparse Factor Analysis and Infinite Independent Components Analysis , 2007, ICA.

[52]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[53]  M. Newman,et al.  Hierarchical structure and the prediction of missing links in networks , 2008, Nature.

[54]  Peng Wang,et al.  Recent developments in exponential random graph (p*) models for social networks , 2007, Soc. Networks.

[55]  C Bozzi,et al.  Branching fractions and CP asymmetries in B0-->pi0pi0, B+-->pi+pi0, and B+-->K+pi0 decays and isospin analysis of the B-->pipi system. , 2005, Physical review letters.

[56]  Alessandro Vespignani,et al.  Network science , 2007, Annu. Rev. Inf. Sci. Technol..

[57]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[58]  Martina Morris,et al.  Specification of Exponential-Family Random Graph Models: Terms and Computational Aspects. , 2008, Journal of statistical software.

[59]  Thomas L. Griffiths,et al.  Nonparametric Latent Feature Models for Link Prediction , 2009, NIPS.

[60]  Jukka-Pekka Onnela,et al.  Community Structure in Time-Dependent, Multiscale, and Multiplex Networks , 2009, Science.

[61]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..