Probabilistic programing is an emerging field at the intersection of statistical learning and programming languages. An appealing property of probabilistic programming languages (PPL) is their support for constructing arbitrary probability distributions. This allows one to model many different domains and solve a variety of problems. We show the link between probabilistic planning and PPLs by introducing a translation that allows one to map probabilistic planning problems onto parameter learning in PPLs. The advantage of our approach is twofold. Firstly, having the expressivity of a programming language simplifies modeling compared to using existing planning languages such as PPDDL. Secondly, there exist effective general-purpose learning algorithms that - having the correct encoding - can readily be used to learn optimal policies. In this paper we use ProbLog - a probabilistic version of Prolog - as programming language, but our approach can be applied on any other PPL as well.
[1]
Robert Givan,et al.
FF-Replan: A Baseline for Probabilistic Planning
,
2007,
ICAPS.
[2]
Nils J. Nilsson,et al.
Probabilistic Logic *
,
2022
.
[3]
Luc De Raedt,et al.
DTProbLog: A Decision-Theoretic Probabilistic Prolog
,
2010,
AAAI.
[4]
S. Yoon.
Towards Model-lite Planning : A Proposal For Learning & Planning with Incomplete Domain Models
,
2007
.
[5]
Subbarao Kambhampati,et al.
Model-lite Planning for the Web Age Masses: The Challenges of Planning with Incomplete and Evolving Domain Models
,
2007,
AAAI.
[6]
Luc De Raedt,et al.
Parameter Learning in Probabilistic Databases: A Least Squares Approach
,
2008,
ECML/PKDD.
[7]
Luc De Raedt,et al.
From non-deterministic to probabilistic planning with the help of statistical relational learning
,
2009
.