How robots' questions affect the accuracy of the human responses

Asking questions is an inevitable part of collaborative interactions between humans and robots. However, robotics novices may have difficulty answering the robots' questions if they do not understand what the robot is asking. We are particularly interested in whether robots can supplement their questions with information about their state in a manner that increases the accuracy of human responses. In this work, we design and carefully analyze a human-robot collaborative task experiment to measure humans' responses and accuracies to different amounts of supplemental information. We vary the content of the questions along four dimensions of the robot state, namely uncertainty, context, predictions, and feature selection. Based on our results, we contribute guidelines on the effective combination of the four dimensions, under the assumption that the robot has no limitations on generating question context. Finally, we validate our guidelines against educated recommendations from the HRI community.

[1]  Herbert H. Clark Talking as if , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Mark C. Torrance,et al.  Natural communication with robots , 1994 .

[3]  Robin Jeffries,et al.  User interface evaluation in the real world: a comparison of four techniques , 1991, CHI.

[4]  Mica R. Endsley,et al.  Being Certain About Uncertainty: How the Representation of System Reliability Affects Pilot Decision Making , 1998 .

[5]  Thomas G. Dietterich,et al.  Toward harnessing user feedback for machine learning , 2007, IUI '07.

[6]  L. Steels Evolving grounded communication for robots , 2003, Trends in Cognitive Sciences.

[7]  Elizabeth Martin,et al.  METHODS FOR TESTING AND EVALUATING SURVEY QUESTIONS , 2004 .

[8]  Satoru Hayamizu,et al.  Socially Embedded Learning of the Office-Conversant Mobil Robot Jijo-2 , 1997, IJCAI.

[9]  M. Couper,et al.  METHODS FOR TESTING AND EVALUATING SURVEY QUESTIONS , 2004 .

[10]  Brad A. Myers,et al.  Successful User Interfaces for RADAR , 2008 .

[11]  Thomas G. Dietterich,et al.  Predicting User Tasks : I Know What You ’ re Doing ! , 2005 .

[12]  Bernt Schiele,et al.  Evaluating the Effects of Displaying Uncertainty in Context-Aware Applications , 2004, UbiComp.

[13]  Weng-Keen Wong,et al.  Integrating rich user feedback into intelligent user interfaces , 2008, IUI '08.

[14]  H. H. Clark,et al.  Referring as a collaborative process , 1986, Cognition.

[15]  Cynthia Breazeal,et al.  Working with robots and objects: revisiting deictic reference for achieving spatial common ground , 2006, HRI '06.

[16]  Henrik I. Christensen,et al.  Bringing Together Human and Robotic Environment Representations - A Pilot Study , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Charles E. Thorpe,et al.  Collaborative control: a robot-centric model for vehicle teleoperation , 2001 .

[18]  Alois Knoll,et al.  Human-Robot dialogue for joint construction tasks , 2006, ICMI '06.

[19]  Takayuki Kanda,et al.  A semi-autonomous communication robot — A field trial at a train station , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).