Communicating Robot Motion Intent with Augmented Reality

Humans coordinate teamwork by conveying intent through social cues, such as gestures and gaze behaviors. However, these methods may not be possible for appearance-constrained robots that lack anthropomorphic or zoomorphic features, such as aerial robots. We explore a new design space for communicating robot motion intent by investigating how augmented reality (AR) might mediate human-robot interactions. We develop a series of explicit and implicit designs for visually signaling robot motion intent using AR, which we evaluate in a user study. We found that several of our AR designs significantly improved objective task efficiency over a baseline in which users only received physically-embodied orientation cues. In addition, our designs offer several trade-offs in terms of intent clarity and user perceptions of the robot as a teammate.

[1]  J. Rekimoto,et al.  Flying head: a head motion synchronization mechanism for unmanned aerial vehicle control , 2013, CHI Extended Abstracts.

[2]  Ana Paiva,et al.  Automatic analysis of affective postures and body motion to detect engagement with a game companion , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  Thomas B. Moeslund,et al.  Projecting robot intentions into human environments , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[4]  Judith A. Hall,et al.  KNOWLEDGE OF NONVERBAL CUES, GENDER, AND NONVERBAL DECODING ACCURACY , 2004 .

[5]  Daniel Szafir,et al.  Human Interaction with Assistive Free-Flying Robots , 2015 .

[6]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Ravi Teja Chadalavada,et al.  That's on my mind! robot to human intention communication through on-board projection on shared floor space , 2015, 2015 European Conference on Mobile Robots (ECMR).

[8]  Adam W. Ruch,et al.  Videogame interface: artefacts and tropes , 2010 .

[9]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[10]  Paul J. Feltovich,et al.  Common Ground and Coordination in Joint Activity , 2005 .

[11]  Jonathan P. How,et al.  MAR-CPS: Measurable Augmented Reality for Prototyping Cyber-Physical Systems , 2015 .

[12]  M. Baldassare.  Human Spatial Behavior , 1978 .

[13]  Andrea Lockerd Thomaz,et al.  Generating anticipation in robot motion , 2011, 2011 RO-MAN.

[14]  Steven K. Feiner,et al.  Windows on the world: 2D windows for 3D augmented reality , 1993, UIST '93.

[15]  J. Geoffrey Chase,et al.  Evaluating the Augmented Reality Human-Robot Collaboration System , 2008, 2008 15th International Conference on Mechatronics and Machine Vision in Practice.

[16]  Bilge Mutlu,et al.  Using gaze patterns to predict task intent in collaboration , 2015, Front. Psychol..

[17]  Ralph Kohler,et al.  Beyond line-of-sight information dissemination for Force Protection , 2012, MILCOM 2012 - 2012 IEEE Military Communications Conference.

[18]  Hua Li,et al.  Review and analysis of avionic helmet-mounted displays , 2013 .

[19]  Shumin Zhai,et al.  Applications of augmented reality for human-robot communication , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[20]  Bilge Mutlu,et al.  Designing planning and control interfaces to support user collaboration with flying robots , 2017, Int. J. Robotics Res..

[21]  Henrik I. Christensen,et al.  Human-robot embodied interaction in hallway settings: a pilot user study , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[22]  Stephanie Rosenthal,et al.  Enhancing human understanding of a mobile robot's state and actions using expressive lights , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[23]  Jill L. Drury,et al.  A video game-based framework for analyzing human-robot interaction: characterizing interface design in real-time interactive multimedia applications , 2006, HRI '06.

[24]  Bilge Mutlu,et al.  Communication of Intent in Assistive Free Flyers , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[25]  Anthony D. Andre,et al.  Situation Awareness in an Augmented Reality Cockpit: Design, Viewpoints and Cognitive Glue , 2005 .

[26]  Ehud Sharlin,et al.  Exploring the affect of abstract motion in social human-robot interaction , 2011, 2011 RO-MAN.

[27]  A.,et al.  Cognitive Engineering , 2008, Encyclopedia of GIS.

[28]  Emanuele Ruffaldi,et al.  Third Point of View Augmented Reality for Robot Intentions Visualization , 2016, AVR.

[29]  John Travis Butler,et al.  Psychological Effects of Behavior Patterns of a Mobile Personal Robot , 2001, Auton. Robots.

[30]  Keith Duncan,et al.  Cognitive Engineering , 2017, Encyclopedia of GIS.

[31]  David W. Payton,et al.  World embedded interfaces for human-robot interaction , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[32]  Siddhartha S. Srinivasa,et al.  Legibility and predictability of robot motion , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[33]  Bilge Mutlu,et al.  Pay attention!: designing adaptive agents that monitor and improve user engagement , 2012, CHI.

[34]  Kentaro Ishii,et al.  Designing Laser Gesture Interface for Robot Control , 2009, INTERACT.

[35]  Ross A. Knepper,et al.  Asking for Help Using Inverse Semantics , 2014, Robotics: Science and Systems.

[36]  Shin Sato,et al.  A human-robot interface using an interactive hand pointer that projects a mark in the real work space , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[37]  J. Geoffrey Chase,et al.  Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design , 2008 .

[38]  Michael A. Goodrich,et al.  Ecological Interfaces for Improving Mobile Robot Teleoperation , 2007, IEEE Transactions on Robotics.

[39]  Atsushi Watanabe,et al.  Communicating robotic navigational intentions , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[40]  Alexandru Dancu,et al.  The Ultimate Display , 2014 .

[41]  Tamim Asfour,et al.  Human-like motion of a humanoid robot arm based on a closed-form solution of the inverse kinematics problem , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[42]  Bilge Mutlu,et al.  Communicating Directionality in Flying Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[43]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[44]  Nicholas R. Gans,et al.  A Multi-view camera-projector system for object detection and robot-human feedback , 2013, 2013 IEEE International Conference on Robotics and Automation.

[45]  Keita Higuchi,et al.  Flying head: A head-synchronization mechanism for flying telepresence , 2013, 2013 23rd International Conference on Artificial Reality and Telexistence (ICAT).

[46]  Rachid Alami,et al.  A methodological approach relating the classification of gesture to identification of human intent in the context of human-robot interaction , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[47]  Wendy Ju,et al.  Expressing thought: Improving robot readability with animation principles , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[48]  Danielle Albers Szafir,et al.  Designing for Depth Perceptions in Augmented Reality , 2017, 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[49]  M. Horowitz.  HUMAN SPATIAL BEHAVIOR. , 1965, American journal of psychotherapy.

[50]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..