How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus

Intelligent agents that are confronted with novel concepts in situated environments will need to ask their human teammates questions to learn about the physical world. To better understand this problem, we need data about asking questions in situated task-based interactions. To this end, we present the Human-Robot Dialogue Learning (HuRDL) Corpus - a novel dialogue corpus collected in an online interactive virtual environment in which human participants play the role of a robot performing a collaborative tool-organization task. We describe the corpus data and a corresponding annotation scheme to offer insight into the form and content of questions that humans ask to facilitate learning in a situated environment. We provide the corpus as an empirically-grounded resource for improving question generation in situated intelligent agents.

[1]  Matthew Purver,et al.  CLARIE: Handling Clarification Requests in a Dialogue System , 2006 .

[2]  Paul Reed,et al.  Situated Interaction , 1974 .

[3]  Andrea Lockerd Thomaz,et al.  Towards Intelligent Arbitration of Diverse Active Learning Queries , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Laurent Prévot,et al.  Filtering conversations through dialogue acts labels for improving corpus-based convergence studies , 2020, SIGDIAL.

[5]  Maya Cakmak,et al.  Designing robot learners that ask good questions , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  Andrea Lockerd Thomaz,et al.  Robot Learning from Human Teachers , 2014, Robot Learning from Human Teachers.

[7]  Kepa Joseba Rodríguez,et al.  Form, Intonation and Function of Clarification Requests in German Task-Oriented Spoken Dialogues , 2004 .

[8]  Tim Paek,et al.  Toward a Taxonomy of Communication Errors , 2003 .

[9]  Jesse Thomason,et al.  Vision-and-Dialog Navigation , 2019, CoRL.

[10]  付伶俐.  打磨Using Language,倡导新理念 , 2014 .

[11]  Alex Lascarides,et al.  Indirect Speech Acts , 2001, Synthese.

[12]  David Schlangen,et al.  Causes and Strategies for Requesting Clarification in Dialogue , 2004, SIGDIAL Workshop.

[13]  Jonathan Ginzburg,et al.  Characterizing the Response Space of Questions: a Corpus Study for English and Polish , 2019, SIGdial.

[14]  Bing Liu,et al.  Human-Human Health Coaching via Text Messages: Corpus, Annotation, and Analysis , 2020, SIGDIAL.

[15]  Matthew Purver,et al.  CLARIE : the Clarification Engine , 2022 .

[16]  Martin Heckmann,et al.  From Explainability to Explanation: Using a Dialogue Setting to Elicit Annotations with Justifications , 2019, SIGdial.

[17]  Antonio Roque,et al.  Let’s do that first! A Comparative Analysis of Instruction-Giving in Human-Human and Human-Robot Situated Dialogue , 2020 .

[18]  Maxine Eskénazi,et al.  Investigating Evaluation of Open-Domain Dialogue Systems With Human Generated Multiple References , 2019, SIGdial.

[19]  Johan Boye,et al.  SpaceRefNet: a neural approach to spatial reference resolution in a real city environment , 2019, SIGdial.

[20]  Felix Gervits,et al.  It’s About Time: Turn-Entry Timing For Situated Human-Robot Dialogue , 2020, SIGDIAL.

[21]  Dorothea Kolossa,et al.  Speaker-adapted neural-network-based fusion for multimodal reference resolution , 2019, SIGdial.

[22]  Terrence Fong,et al.  Astrobee: Developing a Free Flying Robot for the International Space Station , 2015 .

[23]  Johanna D. Moore,et al.  Implications for Generating Clarification Requests in Task-Oriented Dialogues , 2005, ACL.

[24]  Jonathan Ginzburg,et al.  On the Means for Clarification in Dialogue , 2001, SIGDIAL Workshop.

[25]  E. Schegloff,et al.  The preference for self-correction in the organization of repair in conversation , 1977 .

[26]  Alexander I. Rudnicky,et al.  Miscommunication Recovery in Physically Situated Dialogue , 2015, SIGDIAL Conference.

[27]  Minoru Asada,et al.  Initiative in robot assistance during collaborative task execution , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[28]  Matthias Scheutz,et al.  Team Communication as a Collaborative Process , 2016, Front. Robot. AI.