Contextual Symmetries in Probabilistic Graphical Models

An important approach for efficient inference in probabilistic graphical models exploits symmetries among objects in the domain. Symmetric variables (states) are collapsed into meta-variables (meta-states) and inference algorithms are run over the lifted graphical model instead of the flat one. Our paper extends existing definitions of symmetry by introducing the novel notion of contextual symmetry. Two states that are not globally symmetric, can be contextually symmetric under some specific assignment to a subset of variables, referred to as the context variables. Contextual symmetry subsumes previous symmetry definitions and can rep resent a large class of symmetries not representable earlier. We show how to compute contextual symmetries by reducing it to the problem of graph isomorphism. We extend previous work on exploiting symmetries in the MCMC framework to the case of contextual symmetries. Our experiments on several domains of interest demonstrate that exploiting contextual symmetries can result in significant computational gains.

[1]  Vibhav Gogate,et al.  Scaling-up Importance Sampling for Markov Logic Networks , 2014, NIPS.

[2]  Igor Pak,et al.  The product replacement algorithm is polynomial , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[3]  Igor L. Markov,et al.  Faster symmetry discovery using sparsity of symmetries , 2008, 2008 45th ACM/IEEE Design Automation Conference.

[4]  Vibhav Gogate,et al.  On Lifting the Gibbs Sampling Algorithm , 2012, StarAI@UAI.

[5]  Pedro M. Domingos,et al.  Probabilistic theorem proving , 2011, UAI.

[6]  László Babai,et al.  Graph isomorphism in quasipolynomial time [extended abstract] , 2015, STOC.

[7]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[8]  Dan Suciu,et al.  Lifted Inference Seen from the Other Side : The Tractable Features , 2010, NIPS.

[9]  Pedro M. Domingos,et al.  Markov Logic: An Interface Layer for Artificial Intelligence , 2009, Markov Logic: An Interface Layer for Artificial Intelligence.

[10]  Vibhav Gogate,et al.  Advances in Lifted Importance Sampling , 2012, AAAI.

[11]  Heiner Stuckenschmidt,et al.  RockIt: Exploiting Parallelism and Symmetry for MAP Inference in Statistical Relational Models , 2013, AAAI.

[12]  Guy Van den Broeck On the Complexity and Approximation of Binary Evidence in Lifted Inference , 2013, StarAI@AAAI.

[13]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[14]  Pedro M. Domingos,et al.  Lifted First-Order Belief Propagation , 2008, AAAI.

[15]  Toby Walsh,et al.  General Symmetry Breaking Constraints , 2006, CP.

[16]  Guy Van den Broeck,et al.  Tractability through Exchangeability: A New Perspective on Efficient Probabilistic Inference , 2014, AAAI.

[17]  Kristian Kersting,et al.  Counting Belief Propagation , 2009, UAI.

[18]  Luc De Raedt,et al.  Lifted Probabilistic Inference by First-Order Knowledge Compilation , 2011, IJCAI.

[19]  Brendan D. McKay,et al.  Practical graph isomorphism, II , 2013, J. Symb. Comput..

[20]  Henry A. Kautz,et al.  Lifted Symmetry Detection and Breaking for MAP Inference , 2015, NIPS.

[21]  Craig Boutilier,et al.  Context-Specific Independence in Bayesian Networks , 1996, UAI.

[22]  Somdeb Sarkhel,et al.  Lifted MAP Inference for Markov Logic Networks , 2014, AISTATS.

[23]  Guy Van den Broeck,et al.  Lifted Probabilistic Inference for Asymmetric Graphical Models , 2014, AAAI.

[24]  David Poole,et al.  First-order probabilistic inference , 2003, IJCAI.

[25]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[26]  Hung Hai Bui,et al.  Automorphism Groups of Graphical Models and Lifted Variational Inference , 2012, UAI.

[27]  Dan Roth,et al.  Lifted First-Order Probabilistic Inference , 2005, IJCAI.

[28]  Pedro M. Domingos,et al.  Approximate Lifting Techniques for Belief Propagation , 2014, AAAI.

[29]  Mathias Niepert,et al.  Markov Chains on Orbits of Permutation Groups , 2012, UAI.

[30]  Kristian Kersting,et al.  Efficient Lifting of MAP LP Relaxations Using k-Locality , 2014, AISTATS.

[31]  Ian P. Gent,et al.  Groupoids and Conditional Symmetry , 2007, CP.

[32]  Patrick Groeneveld,et al.  Proceedings of the 49th Annual Design Automation Conference , 2012, DAC 2012.

[33]  Steve Linton,et al.  Conditional Symmetry Breaking , 2005, CP.

[34]  Lise Getoor,et al.  Lifted graphical models: a survey , 2011, Machine Learning.