Performance Modelling of Planners from Homogeneous Problem Sets

Empirical performance models play an important role in the development of planning portfolios that make a per-domain or per-problem configuration of its search components. Even though such portfolios have shown their power when compared to other systems in current benchmarks, there is no clear evidence that they are capable to differentiate problems (instances) having similar input properties (in terms of objects, goals, etc.) but fairly different runtime for a given planner. In this paper we present a study of empirical performance models that are trained using problems having the same configuration, with the objective of guiding the models to recognize the underlying differences existing among homogeneous problems. In addition we propose a set of new features that boost the prediction capabilities under such scenarios. The results show that the learned models clearly performed over random classifiers, which reinforces the hypothesis that the selection of planners can be done on a per-instance basis when configuring a portfolio.

[1]  Adele E. Howe,et al.  Learning from planner performance , 2009, Artif. Intell..

[2]  Carmel Domshlak,et al.  Red-black planning: A new systematic approach to partial delete relaxation , 2015, Artif. Intell..

[3]  Jörg Hoffmann Analyzing Search Topology Without Running Any Search: On the Connection Between Causal Graphs and h+ , 2011, J. Artif. Intell. Res..

[4]  Malte Helmert,et al.  The Fast Downward Planning System , 2006, J. Artif. Intell. Res..

[5]  Malte Helmert,et al.  Lama 2008 and 2011 , 2011 .

[6]  Isabel Cenamor,et al.  Mining IPC-2011 Results , 2011 .

[7]  Fernando Fernández,et al.  The IBaCoP Planning System: Instance-Based Configured Portfolios , 2016, J. Artif. Intell. Res..

[8]  Marie desJardins,et al.  What Makes Planners Predictable? , 2008, ICAPS.

[9]  Kevin Leyton-Brown,et al.  Improved Features for Runtime Prediction of Domain-Independent Planners , 2014, ICAPS.

[10]  Remco R. Bouckaert,et al.  Efficient AUC Learning Curve Calculation , 2006, Australian Conference on Artificial Intelligence.

[11]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[12]  Vincent Vidal,et al.  A Lookahead Strategy for Heuristic Search Planning , 2004, ICAPS.

[13]  R. Givan,et al.  Landmark Extraction via Planning Graph Propagation , 2003 .

[14]  Hector Geffner,et al.  Searching for Plans with Carefully Designed Probes , 2011, ICAPS.

[15]  Bernhard Nebel,et al.  The FF Planning System: Fast Plan Generation Through Heuristic Search , 2011, J. Artif. Intell. Res..

[16]  Malte Helmert,et al.  Landmarks Revisited , 2008, AAAI.

[17]  Fernando Fernández,et al.  Learning Predictive Models to Configure Planning Portfolios , 2013 .