Probabilistic Similarity Logic

Many machine learning applications require the ability to learn from and reason about noisy multi-relational data. To address this, several effective representations have been developed that provide both a language for expressing the structural regularities of a domain, and principled support for probabilistic inference. In addition to these two aspects, however, many applications also involve a third aspect-the need to reason about similarities-which has not been directly supported in existing frameworks. This paper introduces probabilistic similarity logic (PSL), a general-purpose framework for joint reasoning about similarity in relational domains that incorporates probabilistic reasoning about similarities and relational structure in a principled way. PSL can integrate any existing domain-specific similarity measures and also supports reasoning about similarities between sets of entities. We provide efficient inference and learning techniques for PSL and demonstrate its effectiveness both in common relational tasks and in settings that require reasoning about similarity.

[1]  Pedro M. Domingos,et al.  Hybrid Markov Logic Networks , 2008, AAAI.

[2]  Luc De Raedt,et al.  Bayesian Logic Programs , 2001, ILP Work-in-progress reports.

[3]  Luc De Raedt,et al.  Logical and Relational Learning: From ILP to MRDM (Cognitive Technologies) , 2008 .

[4]  Ben Taskar,et al.  Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning) , 2007 .

[5]  S. Gottwald A Treatise on Many-Valued Logics , 2001 .

[6]  Luc De Raedt,et al.  Fast learning of relational kernels , 2010, Machine Learning.

[7]  George J. Klir,et al.  Fuzzy sets and fuzzy logic - theory and applications , 1995 .

[8]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[9]  Lluis Godo,et al.  Monoidal t-norm based logic: towards a logic for left-continuous t-norms , 2001, Fuzzy Sets Syst..

[10]  Heiner Stuckenschmidt,et al.  Results of the Ontology Alignment Evaluation Initiative , 2007 .

[11]  Hyoil Han,et al.  A survey on ontology mapping , 2006, SGMD.

[12]  Ben Taskar,et al.  Learning Probabilistic Models of Link Structure , 2003, J. Mach. Learn. Res..

[13]  Lisa Turner,et al.  Applications of Second Order Cone Programming , 2012 .

[14]  Michael Collins,et al.  Discriminative Training Methods for Hidden Markov Models: Theory and Experiments with Perceptron Algorithms , 2002, EMNLP.

[15]  J. Laurie Snell,et al.  Markov Random Fields and Their Applications , 1980 .

[16]  Andrew McCallum,et al.  FACTORIE: Probabilistic Programming via Imperatively Defined Factor Graphs , 2009, NIPS.

[17]  Andrew McCallum,et al.  Introduction to Statistical Relational Learning , 2007 .

[18]  Sebastian Riedel Improving the Accuracy and Efficiency of MAP Inference for Markov Logic , 2008, UAI.

[19]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[20]  Ulrik Brandes,et al.  Network analysis of collaboration structure in Wikipedia , 2009, WWW '09.

[21]  Ben Taskar,et al.  Discriminative Probabilistic Models for Relational Data , 2002, UAI.

[22]  Divesh Srivastava,et al.  Benchmarking declarative approximate selection predicates , 2007, SIGMOD '07.

[23]  Donald Goldfarb,et al.  Second-order cone programming , 2003, Math. Program..

[24]  Luc De Raedt,et al.  Logical and relational learning , 2008, Cognitive Technologies.