Quantified Markov Logic Networks

Markov Logic Networks (MLNs) are well-suited for expressing statistics such as "with high probability a smoker knows another smoker" but not for expressing statements such as "there is a smoker who knows most other smokers", which is necessary for modeling, e.g. influencers in social networks. To overcome this shortcoming, we study quantified MLNs which generalize MLNs by introducing statistical universal quantifiers, allowing to express also the latter type of statistics in a principled way. Our main technical contribution is to show that the standard reasoning tasks in quantified MLNs, maximum a posteriori and marginal inference, can be reduced to their respective MLN counterparts in polynomial time.

[1]  Leslie Pack Kaelbling,et al.  Lifted Probabilistic Inference with Counting Formulas , 2008, AAAI.

[2]  Kristian Kersting,et al.  Relational Logistic Regression: The Directed Analog of Markov Logic Networks , 2014, StarAI@AAAI.

[3]  Andrew McCallum,et al.  Robust Biomedical Event Extraction with Dual Decomposition and Minimal Domain Adaptation , 2011, BioNLP@ACL.

[4]  Marie-Francine Moens,et al.  Soft quantification in statistical relational learning , 2017, Machine Learning.

[5]  A. Rinaldo,et al.  CONSISTENCY UNDER SAMPLING OF EXPONENTIAL RANDOM GRAPH MODELS. , 2011, Annals of statistics.

[6]  Guy Van den Broeck,et al.  Skolemization for Weighted First-Order Model Counting , 2013, KR.

[7]  Chen Chen,et al.  Relieving the Computational Bottleneck: Joint Inference for Event Extraction with High-Dimensional Features , 2014, EMNLP.

[8]  Larry S. Davis,et al.  Event Modeling and Recognition Using Markov Logic Networks , 2008, ECCV.

[9]  Guy Van den Broeck On the Completeness of First-Order Knowledge Compilation for Lifted Probabilistic Inference , 2011, NIPS.

[10]  Katrin Erk,et al.  On the Proper Treatment of Quantifiers in Probabilistic Logic Semantics , 2015, IWCS.

[11]  Steven Schockaert,et al.  Relational Marginal Problems: Theory and Estimation , 2017, AAAI.

[12]  Joseph Y. Halpern,et al.  From Statistics to Beliefs , 1992, AAAI.

[13]  Sargur N. Srihari,et al.  Probabilistic graphical models in modern social network analysis , 2015, Social Network Analysis and Mining.

[14]  Nico Potyka,et al.  Towards Statistical Reasoning in Description Logics over Finite Domains , 2017, SUM.

[15]  Michael Beetz,et al.  Adaptive Markov Logic Networks: Learning Statistical Relational Models with Dynamic Parameters , 2010, ECAI.

[16]  Mohit Singh,et al.  Entropy, optimization and counting , 2013, STOC.

[17]  Christoph H. Lampert,et al.  Computing the M Most Probable Modes of a Graphical Model , 2013, AISTATS.

[18]  Guy Van den Broeck,et al.  New Liftable Classes for First-Order Probabilistic Inference , 2016, NIPS.

[19]  Carsten Lutz,et al.  Weighted model counting beyond two-variable logic , 2018, LICS.

[20]  Pedro M. Domingos,et al.  Recursive Random Fields , 2007, IJCAI.

[21]  Guy Van den Broeck,et al.  Lifted generative learning of Markov logic networks , 2016, Machine Learning.

[22]  Kristian Kersting,et al.  Population Size Extrapolation in Relational Probabilistic Modelling , 2014, SUM.

[23]  Yuke Zhu,et al.  Modelling relational statistics with Bayes Nets , 2013, Machine Learning.

[24]  Guy Van den Broeck,et al.  Query Processing on Probabilistic Data: A Survey , 2017, Found. Trends Databases.

[25]  Fahiem Bacchus,et al.  Towards Completely Lifted Search-based Probabilistic Inference , 2011, ArXiv.

[26]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[27]  Carsten Lutz,et al.  Probabilistic Description Logics for Subjective Uncertainty , 2010, KR.

[28]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[29]  Guy Van den Broeck,et al.  Symmetric Weighted First-Order Model Counting , 2014, PODS.