"Can you say more about the location?" The Development of a Pedagogical Reference Resolution Agent

In an increasingly globalized world, geographic literacy is crucial. In this paper, we present a collaborative two-player game to improve people's ability to locate countries on the world map. We discuss two implementations of the game: First, we created a web-based version which can be played with the remote-controlled agent Nellie. With the knowledge we gained from a large online data collection, we re-implemented the game so it can be played face-to-face with the Furhat robot Neil. Our analysis shows that participants found the game not just engaging to play, they also believe they gained lasting knowledge about the world map.

[1]  G. T. Jackson,et al.  Intelligent Tutoring and Games (ITaG) , 2010 .

[2]  Susanne P. Lajoie,et al.  Sherlock: A Coached Practice Environment for an Electronics Troubleshooting Job. , 1988 .

[3]  Arthur C. Graesser,et al.  Conversations with AutoTutor Help Students Learn , 2016, International Journal of Artificial Intelligence in Education.

[4]  Kenneth R. Koedinger,et al.  Using Data-Driven Discovery of Better Student Models to Improve Student Learning , 2013, AIED.

[5]  Stacy Marsella,et al.  Serious Games for Language Learning: How Much Game, How Much AI? , 2005, AIED.

[6]  Arthur C. Graesser,et al.  Intelligent Tutoring Systems with Conversational Dialogue , 2001, AI Mag..

[7]  Daniel F. McCaffrey,et al.  Effectiveness of Cognitive Tutor Algebra I at Scale , 2014 .

[8]  Vincent Aleven,et al.  Intelligent Tutoring Goes To School in the Big City , 1997 .

[9]  David DeVault,et al.  Reducing the Cost of Dialogue System Training and Evaluation with Online, Crowd-Sourced Dialogue Data Collection , 2015 .

[10]  Reva Freedman.  Atlas: A Plan Manager for Mixed-Initiative, Multimodal Dialogue , 1999 .

[11]  Ryan Shaun Joazeiro de Baker,et al.  Stupid Tutoring Systems, Intelligent Humans , 2016, International Journal of Artificial Intelligence in Education.

[12]  Hugo Larochelle,et al.  GuessWhat?! Visual Object Discovery through Multi-modal Dialogue , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Gabriel Skantze,et al.  Furhat: A Back-Projected Human-Like Robot Head for Multiparty Human-Machine Interaction , 2011, COST 2102 Training School.

[14]  Arthur C. Graesser,et al.  The impact of a technology-based mathematics after-school program using ALEKS on student's knowledge and behaviors , 2013, Comput. Educ..

[15]  Piotr Mitros,et al.  Creating Educational Resources at Scale , 2014, 2014 IEEE 14th International Conference on Advanced Learning Technologies.

[16]  David R. Michael,et al.  Serious Games: Games That Educate, Train, and Inform , 2005 .

[17]  Darren Edge,et al.  RoboCOP: A Robotic Coach for Oral Presentations , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[18]  David DeVault,et al.  Real-Time Understanding of Complex Discriminative Scene Descriptions , 2016, SIGDIAL Conference.

[19]  Antonija Mitrovic,et al.  Evaluation of a Constraint-Based Tutor for a Database Language , 1999 .

[20]  David DeVault,et al.  PentoRef: A Corpus of Spoken References in Task-oriented Dialogues , 2016, LREC.

[21]  Danielle S McNamara,et al.  iSTART: Interactive strategy training for active reading and thinking , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[22]  David DeVault,et al.  Pair Me Up: A Web Framework for Crowd-Sourced Spoken Dialogue Collection , 2015, Natural Language Dialog Systems and Intelligent Assistants.

[23]  David DeVault,et al.  “So, which one is it?” The effect of alternative incremental architectures in a high-performance game-playing agent , 2015, SIGDIAL Conference.

[24]  Kurt VanLehn,et al.  Andes: A Coached Problem Solving Environment for Physics , 2000, Intelligent Tutoring Systems.

[25]  Diane J. Litman,et al.  ITSPOKE: An Intelligent Tutoring Spoken Dialogue System , 2004, NAACL.

[26]  David DeVault,et al.  A Multimodal Corpus of Rapid Dialogue Games , 2014, LREC.

[27]  Heather H. Mitchell,et al.  AutoTutor: A tutor with dialogue in natural language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.