Providing Arguments in Discussions Based on the Prediction of Human Argumentative Behavior

Argumentative discussion is a highly demanding task. In order to help people in such situations, this paper provides an innovative methodology for developing an agent that can support people in argumentative discussions by proposing possible arguments to them. By analyzing more than 130 human discussions and 140 questionnaires, answered by people, we show that the well-established Argumentation Theory is not a good predictor of people's choice of arguments. Then, we present a model that has 76% accuracy when predicting peoples top three argument choices given a partial deliberation. We present the Predictive and Relevance based Heuristic agent (PRH), which uses this model with a heuristic that estimates the relevance of possible arguments to the last argument given in order to propose possible arguments. Through extensive human studies with over 200 human subjects, we show that peoples satisfaction from the PRH agent is significantly higher than from other agents that propose arguments based on Argumentation Theory, predict arguments without the heuristics or only the heuristics. People also use the PRH agent's proposed arguments significantly more often than those proposed by the other agents.

[1]  L. Amgoud,et al.  On bipolarity in argumentation frameworks , 2008 .

[2]  Marsha M. Linehan,et al.  Validation and psychotherapy. , 1997 .

[3]  Douglas Walton,et al.  Argumentation methods for artificial intelligence in law , 2005 .

[4]  Avi Rosenfeld,et al.  NegoChat: a chat-based negotiation agent , 2014, AAMAS.

[5]  Trevor J. M. Bench-Capon,et al.  ARGUMENTATION IN THE FRAMEWORK OF DELIBERATION DIALOGUE , 2010 .

[6]  D. Edwards Discourse and cognition , 1996 .

[7]  Yoshimichi Sato Rational choice theory , 2013 .

[8]  R. Selten,et al.  Bounded rationality: The adaptive toolbox , 2000 .

[9]  Mark Klein,et al.  The Dynamics of Collaborative Design: Insights from Complex Systems and Negotiation Research , 2003, Concurr. Eng. Res. Appl..

[10]  P. Pasquier,et al.  Reasoning about Goal Revelation in Human Negotiation , 2013, IEEE Intelligent Systems.

[11]  Huaxin Huang,et al.  Partial semantics of argumentation: basic properties and empirical , 2013, J. Log. Comput..

[12]  Douglas Walton,et al.  Argumentation Theory: A Very Short Introduction , 2009, Argumentation in Artificial Intelligence.

[13]  Amos Azaria,et al.  Combining psychological models with machine learning to better predict people’s decisions , 2012, Synthese.

[14]  Claudette Cayrol,et al.  Graduality in Argumentation , 2011, J. Artif. Intell. Res..

[15]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[17]  Didier Dubois,et al.  Qualitative Heuristics For Balancing the Pros and Cons , 2008 .

[18]  Michael Wooldridge,et al.  Weighted argument systems: Basic definitions, algorithms, and complexity results , 2011, Artif. Intell..

[19]  Philipp Koehn,et al.  Cognitive Psychology , 1992, Ageing and Society.

[20]  J. Cleary,et al.  \self-organized Language Modeling for Speech Recognition". In , 1997 .

[21]  Phan Minh Dung,et al.  On the Acceptability of Arguments and its Fundamental Role in Nonmonotonic Reasoning, Logic Programming and n-Person Games , 1995, Artif. Intell..

[22]  M. Klein How to Harvest Collective Wisdom on Complex Problems: An Introduction to the MIT Deliberatorium , 2012 .

[23]  Nava Tintarev,et al.  Formal Arguments, Preferences, and Natural Language Interfaces to Humans: an Empirical Evaluation , 2014, ECAI.

[24]  Xiaoqing Liu,et al.  Analyzing credibility of arguments in a web-based intelligent argumentation system for collective decision support based on K-means clustering algorithm , 2012 .

[25]  R. Nickerson Confirmation Bias: A Ubiquitous Phenomenon in Many Guises , 1998 .

[26]  Trevor J. M. Bench-Capon Persuasion in Practical Argument Using Value-based Argumentation Frameworks , 2003, J. Log. Comput..

[27]  C. Cayrol,et al.  On the Acceptability of Arguments in Bipolar Argumentation Frameworks , 2005, ECSQARU.

[28]  Iyad Rahwan,et al.  Behavioral Experiments for Assessing the Abstract Argumentation Semantics of Reinstatement , 2010, Cogn. Sci..

[29]  Nick Craswell Mean Reciprocal Rank , 2009, Encyclopedia of Database Systems.

[30]  ปิยดา สมบัติวัฒนา Behavioral Game Theory: Experiments in Strategic Interaction , 2013 .

[31]  L. Festinger A Theory of Cognitive Dissonance , 1957 .

[32]  E. Sklar,et al.  An Argumentation Engine : ArgTrust , 2012 .