A Conversational Agent for the Improvement of Human Reasoning Skills

Human reasoning is the ability to make sound and goal-oriented decisions and is therefore highly relevant in daily life. However, its importance has not yet been addressed explicitly in education. In this paper, we propose to develop a computer-based conversational agent named Liza for improving human reasoning skills. Liza is able to hold conversations with humans to help them solve a small selection of well-studied reasoning problems. Such a conversational agent allows a much more scalable and inexpensive approach for teaching at least basic reasoning principles. The evaluation study shows that the conversational agent Liza improved the reasoning skills of the participants, who had conversations with the agent to solve reasoning problems and that the group using Liza achieved much better learning effects than a group studying with a non-interactive online course that was implemented as a control condition.

[1]  Juan C. Burguillo,et al.  TQ-Bot: An AIML-based Tutor and Evaluator Bot , 2009, J. Univers. Comput. Sci..

[2]  Jonathan Evans,et al.  Science Perspectives on Psychological , 2022 .

[3]  Amruth N. Kumar.  Providing the Option to Skip Feedback in a Worked Example Tutor , 2016, ITS.

[4]  Agneta Gulz,et al.  Social enrichment by virtual characters - differential benefits , 2005, J. Comput. Assist. Learn..

[5]  Arthur C. Graesser,et al.  AutoTutor: an intelligent tutoring system with mixed-initiative dialogue , 2005, IEEE Transactions on Education.

[6]  Punya Mishra,et al.  RUNNING HEAD: PEDAGOGICAL SOFTWARE AGENTS All or Nothing: Levels of Sociability of a Pedagogical Software Agent and its Impact on Student Perceptions and Learning , 2005 .

[7]  Haizhou Li,et al.  IRIS: a Chat-oriented Dialogue System based on the Vector Space Model , 2012, ACL.

[8]  Amy B. Adcock,et al.  Teaching Effective Helping Skills at a Distance: The Development of Project CATHIE. , 2006 .

[9]  James C. Lester,et al.  The persona effect: affective impact of animated pedagogical agents , 1997, CHI.

[10]  Timothy W. Bickmore,et al.  Engagement vs. Deceit: Virtual Humans with Human Autobiographies , 2009, IVA.

[11]  P. Pollard,et al.  On the conflict between logic and belief in syllogistic reasoning , 1983, Memory & cognition.

[12]  H. Fineberg,et al.  When doctors meet numbers. , 1981, The American journal of medicine.

[13]  S. Frederick.  Journal of Economic Perspectives—Volume 19, Number 4—Fall 2005—Pages 25–42 Cognitive Reflection and Decision Making , 2022 .

[14]  Carey K. Morewedge,et al.  Debiasing Decisions , 2015 .

[15]  Andrew Ortony,et al.  On making believable emotional agents believable , 1988 .

[16]  Problems and Useful Techniques: My Experiences in Teaching Courses in Argumentation, Informal Logic and Critical Thinking , 2000 .

[17]  D. Kahneman.  A perspective on judgment and choice: mapping bounded rationality. , 2003, The American psychologist.

[18]  P C Wason,et al.  Reasoning about a Rule , 1968, The Quarterly journal of experimental psychology.

[19]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[20]  Keith E. Stanovich,et al.  Rational and Irrational Thought: The Thinking That IQ Tests Miss , 2009 .

[21]  Julita Vassileva,et al.  Affective pedagogical agents and user persuasion , 2001, HCI.

[22]  P. Klaczynski.  Analytic and heuristic processing influences on adolescent reasoning and decision-making. , 2001, Child development.

[23]  D. R. Lehman,et al.  Teaching reasoning. , 1987, Science.

[24]  Rosalind W. Picard.  Affective computing: challenges , 2003, Int. J. Hum. Comput. Stud..

[25]  W. Lewis Johnson,et al.  Pedagogical agents on the Web , 1999, AGENTS '99.

[26]  D. Krantz,et al.  The effects of statistical training on thinking about everyday problems , 1986, Cognitive Psychology.

[27]  G. Gigerenzer,et al.  Teaching Bayesian reasoning in less than two hours. , 2001, Journal of experimental psychology. General.

[28]  Eliseo Reategui,et al.  A Pedagogical Agent with Embedded Data Mining Functions to Support Collaborative Writing , 2014, HT.

[29]  Carolyn Penstein Rosé,et al.  Supporting students working together on math with social dialogue , 2007, SLaTE.

[30]  Jonathan Evans,et al.  Rationality and reasoning , 1996 .

[31]  J. Sweller.  COGNITIVE LOAD THEORY, LEARNING DIFFICULTY, AND INSTRUCTIONAL DESIGN , 1994 .

[32]  Tim van Gelder.  How To Improve Critical Thinking Using Educational Technology. , 2001 .

[33]  B. J. Fogg,et al.  Silicon sycophants: the effects of computers that flatter , 1997, Int. J. Hum. Comput. Stud..

[34]  B. McLaren,et al.  Educational Technologies for Teaching Argumentation Skills , 2012 .

[35]  Ian J. Deary,et al.  What Intelligence Tests Miss: The Psychology of Rational Thought , 2010 .

[36]  Lana M Trick,et al.  Grouping and gambling: a Gestalt approach to understanding the gambler's fallacy. , 2003, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[37]  K. Holyoak,et al.  Pragmatic versus syntactic approaches to training deductive reasoning , 1986, Cognitive Psychology.

[38]  R. Thaler.  Toward a positive theory of consumer choice , 1980 .

[39]  M. Coltheart,et al.  The quarterly journal of experimental psychology , 1985 .

[40]  Peter Sedlmeier,et al.  Improving Statistical Reasoning: Theoretical Models and Practical Implications , 1999 .

[41]  Huay Lit Woo,et al.  Designing multimedia learning environments using animated pedagogical agents: factors and issues , 2009, J. Comput. Assist. Learn..

[42]  D. Halpern.  Thought and Knowledge: An Introduction to Critical Thinking , 1995 .

[43]  Thomas Rist,et al.  Integrating reactive and scripted behaviors in a life-like presentation agent , 1998, AGENTS '98.

[44]  George Veletsianos,et al.  Pedagogical Agents , 2013 .

[45]  Tomoki Toda,et al.  Developing Non-goal Dialog System Based on Examples of Drama Television , 2012, Natural Interaction with Robots, Knowbots and Smartphones, Putting Spoken Dialog Systems into Practice.

[46]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[47]  Elisabeth André,et al.  The Persona Effect: How Substantial Is It? , 1998, BCS HCI.

[48]  B. Huberman,et al.  Searching for the sunk cost fallacy , 2007 .

[49]  Rosalind W. Picard.  What does it mean for a computer to “ have ” emotions ? , 2001 .

[50]  G Gigerenzer,et al.  Using natural frequencies to improve diagnostic inferences , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[51]  D. Krantz,et al.  The use of statistical heuristics in everyday inductive reasoning , 1983 .

[52]  K. Stanovich,et al.  Heuristics and Biases: Individual Differences in Reasoning: Implications for the Rationality Debate? , 2002 .

[53]  A. Elliot,et al.  The Self-Serving Bias , 1998 .

[54]  Yanghee Kim,et al.  Pedagogical Agents as Social Models to Influence Learner Attitudes , 2007 .

[55]  Daniel L. Schwartz,et al.  Teachable Agents and the Protégé Effect: Increasing the Effort Towards Learning , 2009 .

[56]  H. Markovits,et al.  The belief-bias effect in the production and evaluation of logical conclusions , 1989, Memory & cognition.

[57]  Linda Lohr,et al.  Psychology of learning for instruction , 2005 .

[58]  Nicole C. Krämer,et al.  Training disaster communication by means of serious games in virtual environments , 2011, Entertain. Comput..

[59]  H. Chad Lane,et al.  The Effects of a Pedagogical Agent for Informal Science Education on Learner Behaviors and Self-efficacy , 2013, AIED.

[60]  Nick Chater,et al.  Reasoning and decision making , 2012 .

[61]  Arthur C. Graesser,et al.  Agent Technologies Designed to Facilitate Interactive Knowledge Construction , 2008 .

[62]  H. Arkes,et al.  The Psychology of Sunk Cost , 1985 .

[63]  James C. Lester,et al.  The Case for Social Agency in Computer-Based Teaching: Do Students Learn More Deeply When They Interact With Animated Pedagogical Agents? , 2001 .

[64]  Amy L. Baylor,et al.  Beyond Butlers: Intelligent Agents as Mentors , 2000 .

[65]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[66]  J. Keller,et al.  The effects of agent emotional support and cognitive motivational messages on math anxiety, learning, and motivation , 2009 .

[67]  T. Gelder,et al.  Learning to Reason: A Reason!-Able Approach. , 2000 .

[68]  Barbara Hammer,et al.  Learning Feedback in Intelligent Tutoring Systems , 2015, KI - Künstliche Intelligenz.

[69]  David DeVault,et al.  Toward Natural Turn-Taking in a Virtual Human Negotiation Agent , 2015, AAAI Spring Symposia.

[70]  Clifford Nass,et al.  Computers are social actors , 1994, CHI '94.

[71]  K. Stanovich.  On the distinction between rationality and intelligence: Implications for understanding individual differences in reasoning. , 2012 .

[72]  Matthew Inglis,et al.  MATHEMATICIANS AND THE SELECTION TASK , 2004 .

[73]  Yanghee Kim,et al.  Simulating Instructional Roles through Pedagogical Agents , 2005, Int. J. Artif. Intell. Educ..

[74]  Jonathan Evans.  Heuristic and analytic processes in reasoning , 1984 .

[75]  Richard P. Larrick,et al.  Teaching the Use of Cost-Benefit Reasoning in Everyday Life , 1990 .

[76]  Douglas B. Millar,et al.  Building a Case for Agent-Assisted Learning as a Catalyst for Curriculum Reform in Medical Education , 2000 .