When a robot orients visitors to an exhibit. Referential practices and interactional dynamics in real world HRI

A basic task for robots interacting with humans consists in guiding their focus of attention. Existing guidelines for a robot's multimodal deixis are primarily focused on the speaker (talk-gesture-coordination, handshape). Conducting a field trial with a museum guide robot, we tested these individualistic referential strategies in the dynamic conditions of real-world HRI and found that their success ranges between 27% and 95%. Qualitative video-based micro-analysis revealed that the users experienced problems when they were not facing the robot at the moment of the deictic gesture. Also the importance of the robot's head orientation became evident. Implications are drawn as design guidelines for an interactional account of modeling referential strategies for HRI.

[1]  F. Kaplan,et al.  The challenges of joint attention , 2006 .

[2]  Thies Pfeiffer,et al.  Understanding multimodal deixis with gaze and gesture in conversational interfaces , 2011 .

[3]  Allison Sauppé,et al.  Robot Deictics: How Gesture and Context Shape Referential Communication , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  Takayuki Kanda,et al.  Pointing to space: modeling of deictic interaction referring to regions , 2010, HRI 2010.

[5]  Charles Goodwin,et al.  Pointing as Situated Practice , 1998 .

[6]  Emiel Krahmer,et al.  Generating Referring Expressions in a Multimodal Context An empirically oriented approach , 2000, CLIN.

[7]  Sebastian Wrede,et al.  Addressing Multiple Participants: A Museum Robot's Gaze Shapes Visitor Participation , 2013 .

[8]  E. Schegloff.  Structures of Social Action: On some gestures' relation to talk , 1985 .

[9]  P. Piwek,et al.  'Proximal' and 'distal' in language and cognition : Evidence from deictic demonstratives in Dutch , 2008 .

[10]  Stefan Kopp,et al.  Generation and Evaluation of Communicative Robot Gesture , 2012, Int. J. Soc. Robotics.

[11]  Jan Peter de Ruiter,et al.  The Interplay Between Gesture and Speech in the Production of Referring Expressions: Investigating the Tradeoff Hypothesis , 2012, Top. Cogn. Sci..

[12]  Cynthia Breazeal,et al.  Working with robots and objects: revisiting deictic reference for achieving spatial common ground , 2006, HRI '06.

[13]  C. Goodwin.  Action and embodiment within situated human interaction , 2000 .

[14]  Hideaki Kuzuoka,et al.  “The first five seconds”: Contingent stepwise entry into an interaction as a means to secure sustained engagement in HRI , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[15]  Bilge Mutlu,et al.  Modeling and Evaluating Narrative Gestures for Humanlike Robots , 2013, Robotics: Science and Systems.

[16]  Takayuki Kanda,et al.  Providing route directions: Design of robot's utterance, gesture, and timing , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[17]  Takayuki Kanda,et al.  Natural deictic communication with humanoid robots , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Sebastian Wrede,et al.  A middleware for collaborative research in experimental robotics , 2011, 2011 IEEE/SICE International Symposium on System Integration (SII).

[19]  Jack Sidnell,et al.  The handbook on conversation analysis , 2013 .

[20]  Maja J. Mataric,et al.  Investigating the effects of visual saliency on deictic gesture production by a humanoid robot , 2011, 2011 RO-MAN.