Referential practices. Effects of a museum guide robot suggesting a deictic ‘repair’ action to visitors attempting to orient to an exhibit

An autonomous robot system was equipped with basic means to monitor the users' success/failure in following a robot's verbal-gestural deictic reference to an object and - in case of problems - to provide additional help, i.e. to suggest a `repair' action. A real-world field trial with the robot acting as museum guide constitutes the basis for analysis of the users' reactions to the first reference and the subsequent `repair' action in two structurally different conditions. Results indicate that deictic `repair' actions are mostly successful helping users to correctly orient, but they may also lead to confusion for initially correctly oriented visitors in situations of small groups of users. A recurring user practice is revealed which consists of displaying to co-visitors their understanding of the reference by pointing to the location and thus providing additional orientational help.

[1]  Sebastian Wrede,et al.  A middleware for collaborative research in experimental robotics , 2011, 2011 IEEE/SICE International Symposium on System Integration (SII).

[2]  Sebastian Wrede,et al.  Trouble-based group dynamics in real-world HRI — Reactions on unexpected next moves of a museum guide robot , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[3]  Kees van Deemter,et al.  Generating Easy References: the Case of Document Deixis , 2002, INLG.

[4]  Takayuki Kanda,et al.  Providing route directions: Design of robot's utterance, gesture, and timing , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Britta Wrede,et al.  Pamini: A framework for assembling mixed-initiative human-robot interaction from generic interaction patterns , 2010, SIGDIAL Conference.

[6]  Sebastian Wrede,et al.  When a robot orients visitors to an exhibit. Referential practices and interactional dynamics in real world HRI , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[7]  Maja J. Mataric,et al.  Investigating the effects of visual saliency on deictic gesture production by a humanoid robot , 2011, 2011 RO-MAN.

[8]  Thies Pfeiffer,et al.  Pointing and reference reconsidered , 2015 .

[9]  Allison Sauppé,et al.  Robot Deictics: How Gesture and Context Shape Referential Communication , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[10]  Jean-Marc Odobez,et al.  Recognizing Visual Focus of Attention From Head Pose in Natural Meetings , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Charles Goodwin,et al.  Pointing as Situated Practice , 1998 .

[12]  Karola Pitsch.  Limits and opportunities for mathematizing communicational conduct for social robotics in the real world? Toward enabling a robot to make use of the human’s competences , 2015, AI & SOCIETY.

[13]  Yoshinori Kobayashi,et al.  Revealing Gauguin: engaging visitors in robot guide's explanation in an art museum , 2009, CHI.