Mapping and Revising Markov Logic Networks for Transfer Learning

Transfer learning addresses the problem of how to leverage knowledge acquired in a source domain to improve the accuracy and speed of learning in a related target domain. This paper considers transfer learning with Markov logic networks (MLNs), a powerful formalism for learning in relational domains. We present a complete MLN transfer system that first autonomously maps the predicates in the source MLN to the target domain and then revises the mapped structure to further improve its accuracy. Our results in several real-world domains demonstrate that our approach successfully reduces the amount of time and training data needed to learn an accurate model of a target domain over learning from scratch.

[1]  Brian Falkenhainer,et al.  The Structure-Mapping Engine: Algorithm and Examples , 1989, Artif. Intell..

[2]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[3]  Raymond J. Mooney,et al.  Learning Relations by Pathfinding , 1992, AAAI.

[4]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[5]  Raymond J. Mooney,et al.  Automated refinement of first-order horn-clause domain theories , 2005, Machine Learning.

[6]  S. Wrobel.  First Order Theory Reenement , 1996 .

[7]  De Raedt,et al.  Advances in Inductive Logic Programming , 1996 .

[8]  Raymond J. Mooney,et al.  Theory Refinement of Bayesian Networks with Hidden Variables , 1998, ICML.

[9]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[10]  Tom M. Mitchell,et al.  Learning to Extract Symbolic Knowledge from the World Wide Web , 1998, AAAI/IAAI.

[11]  Pedro M. Domingos,et al.  Learning the structure of Markov logic networks , 2005, ICML.

[12]  Alexandru Niculescu-Mizil.  Learning the Structure of Related Tasks , 2005 .

[13]  Kate Revoredo,et al.  Probabilistic First-Order Theory Revision from Examples , 2005, ILP.

[14]  Jude W. Shavlik,et al.  Using Advice to Transfer Knowledge Acquired in One Reinforcement Learning Task to Another , 2005, ECML.

[15]  Rajat Raina,et al.  Constructing informative priors using transfer learning , 2006, ICML.

[16]  Pedro M. Domingos,et al.  Sound and Efficient Inference with Probabilistic and Deterministic Dependencies , 2006, AAAI.

[17]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[18]  Matthew Richardson,et al.  The Alchemy System for Statistical Relational AI: User Manual , 2007 .

[19]  Shimon Whiteson,et al.  Transfer via inter-task mappings in policy search reinforcement learning , 2007, AAMAS '07.

[20]  Clayton T. Morrison,et al.  Learning and Transferring Action Schemas , 2007, IJCAI.