Empirical Cognitive Study on Abstract Argumentation Semantics

In abstract argumentation theory, multiple argumentation semantics have been proposed that allow to select sets of jointly acceptable arguments from a given set of arguments based on the attack relation between arguments. The existence of multiple argumentation semantics raises the question which of these semantics predicts best how humans evaluate arguments, possibly depending on the thematic context of the arguments. In this study we report on an empirical cognitive study in which we tested how humans evaluate sets of arguments depending on the abstract structure of the attack relation between them. Two pilot studies were performed to validate the intended link between argumentation frameworks and sets of natural language arguments. The main experiment involved a group deliberation phase and made use of three different thematic contexts of the argument sets involved. The data strongly suggest that independently of the thematic contexts that we have considered, strong acceptance and strong rejection according to the CF2 and preferred semantics are a better predictor for human argument acceptance than the grounded semantics (which is identical to strong acceptance/rejection with respect to complete semantics). Furthermore, the data suggest that CF2 semantics predicts human argument acceptance better than preferred semantics, but the data for this comparison is limited to a single thematic context.

[1]  Phan Minh Dung,et al.  On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games , 1995, Artif. Intell..

[2]  Sociological Studies , 1934, Nature.

[3]  David Moshman Molly Geil,et al.  Collaborative Reasoning: Evidence for Collective Rationality , 1998 .

[4]  Pietro Baroni,et al.  An introduction to argumentation semantics , 2011, The Knowledge Engineering Review.

[5]  Anthony Hunter,et al.  Empirical evaluation of abstract argumentation: Supporting the need for bipolar and probabilistic approaches , 2017, Int. J. Approx. Reason..

[6]  Claudette Cayrol,et al.  Bipolarity in argumentation graphs: Towards a better understanding , 2013, Int. J. Approx. Reason..

[7]  Marcos Cramer,et al.  Directionality of Attacks in Natural Language Argumentation , 2018, Bridging@IJCAI/ECAI.

[8]  Leon van der Torre,et al.  The Principle-Based Approach to Abstract Argumentation Semantics , 2017 .

[9]  Anne Anastasi,et al.  Differential Psychology: Individual and Group Differences in Behavior , 1958 .

[10]  L. Cronbach The two disciplines of scientific psychology. , 1957 .

[11]  Nava Tintarev,et al.  Formal Arguments, Preferences, and Natural Language Interfaces to Humans: an Empirical Evaluation , 2014, ECAI.

[12]  B. Weiner Theories of motivation : from mechanism to cognition , 1972 .

[13]  Henry Prakken,et al.  The ASPIC+ framework for structured argumentation: a tutorial , 2014, Argument Comput..

[14]  Pietro Baroni,et al.  SCC-recursiveness: a general schema for argumentation semantics , 2005, Artif. Intell..

[15]  Sarit Kraus,et al.  Providing Arguments in Discussions on the Basis of the Prediction of Human Argumentative Behavior , 2016, ACM Trans. Interact. Intell. Syst..

[16]  Sanjay Modgil,et al.  Preferences and Unrestricted Rebut , 2014, COMMA.

[17]  Iyad Rahwan,et al.  Behavioral Experiments for Assessing the Abstract Argumentation Semantics of Reinstatement , 2010, Cogn. Sci..

[18]  Wolfgang Dvorák,et al.  Stage semantics and the SCC-recursive schema for argumentation semantics , 2016, J. Log. Comput..

[19]  Maria Augustinova Falsification cueing in collective reasoning: Example of the Wason selection task , 2008 .

[20]  Pietro Baroni,et al.  Abstract Argumentation Frameworks and Their Semantics , 2018 .

[21]  Henry Prakken,et al.  An abstract framework for argumentation with structured arguments , 2010, Argument Comput..

[22]  Henry Prakken,et al.  Argument-Based Extended Logic Programming with Defeasible Priorities , 1997, J. Appl. Non Class. Logics.

[23]  Mikolaj Podlaszewski,et al.  A Labelling-Based Justification Status of Arguments , 2010, NMR 2010.