Where Are We Now? State of the Art and Future Trends of Solvers for Hard Argumentation Problems

We evaluate the state of the art of solvers for hard argumentation problems—the enumeration of preferred and stable extensions—to envisage future trends based on evidence collected as part of an extensive empirical evaluation. In the last international competition on computational models of argumentation a general impression was that reduction-based systems (either SAT-based or ASP-based) are the most efficient. Our investigation shows that this impression is not true in full generality and suggests the areas where the relatively under-developed non reduction-based systems should focus more to improve their performance. Moreover, it also highlights that the state-of-the-art solvers are very complementary and can be successfully combined in portfolios: our best per-instance portfolio is 51% (resp. 53%) faster than the best single solver for enumerating preferred (resp. stable) extensions.

[1]  Massimiliano Giacomin,et al.  Algorithm Selection for Preferred Extensions Enumeration , 2014, COMMA.

[2]  Pietro Baroni,et al.  Automata for infinite argumentation structures , 2013, Artif. Intell..

[3]  Thomas Linsbichler,et al.  Abstract Solvers for Dung's Argumentation Frameworks , 2015, TAFA.

[4]  Phan Minh Dung,et al.  On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games , 1995, Artif. Intell..

[5]  Jendrik Seipp,et al.  Learning Portfolios of Automatically Tuned Planners , 2012, ICAPS.

[6]  Hannes Strass,et al.  A Benchmark Framework for a Computational Argumentation Competition , 2014, COMMA.

[7]  Lukás Chrpa,et al.  The 2014 International Planning Competition: Progress and Trends , 2015, AI Mag..

[8]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[9]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[10]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[11]  Marius Thomas Lindauer,et al.  claspfolio 2: Advances in Algorithm Selection for Answer Set Programming , 2014, Theory and Practice of Logic Programming.

[12]  Serena Villata,et al.  System Descriptions of the First International Competition on Computational Models of Argumentation (ICCMA'15) , 2015, ArXiv.

[13]  Lukás Chrpa,et al.  Portfolio-based planning: State of the art, common practice and open challenges , 2015, AI Commun..

[14]  Kevin Leyton-Brown,et al.  Algorithm runtime prediction: Methods & evaluation , 2012, Artif. Intell..

[15]  Paul Erdös,et al.  On random graphs, I , 1959 .

[16]  Hannes Strass,et al.  Summary Report of The First International Competition on Computational Models of Argumentation , 2016, AI Mag..

[17]  Stefano Bistarelli,et al.  Benchmarking Hard Problems in Random Abstract AFs: The Stable Semantics , 2014, COMMA.

[18]  John R. Rice,et al.  The Algorithm Selection Problem , 1976, Adv. Comput..

[19]  Kevin Leyton-Brown,et al.  SATzilla: Portfolio-based Algorithm Selection for SAT , 2008, J. Artif. Intell. Res..

[20]  Pietro Baroni,et al.  An introduction to argumentation semantics , 2011, The Knowledge Engineering Review.

[21]  Massimiliano Giacomin,et al.  Generating Challenging Benchmark AFs , 2014, COMMA.