By Land, Air, or Sea: Multi-Domain Robot Communication Via Motion

In this paper, we explore the use of motion for robot-to-human communication on three robotic platforms: the 5 degrees-of-freedom (DOF) Aqua autonomous underwater vehicle (AUV), a 3-DOF camera gimbal mounted on a Matrice 100 drone, and a 3-DOF Turtlebot2 terrestrial robot. While we previously explored the use of body language-like motion (called kinemes) versus other methods of communication for the Aqua AUV, we now extend those concepts to robots in two new and different domains. We evaluate all three platforms using a small interaction study where participants use gestures to communicate with the robot, receive information from the robot via kinemes, and then take actions based on the information. To compare the three domains we consider the accuracy of these interactions, the time it takes to complete them, and how confident users feel in the success of their interactions. The kineme systems perform with reasonable accuracy for all robots and experience gained in this study is used to form a set of prescriptions for further development of kineme systems.

[1]  B. S. Wood.  Children and communication : verbal and nonverbal language development , 1976 .

[2]  James A. Landay,et al.  Emotion encoding in Human-Drone Interaction , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[3]  Rodolphe Gelin,et al.  A Mass-Produced Sociable Humanoid Robot: Pepper: The First Machine of Its Kind , 2018, IEEE Robotics & Automation Magazine.

[4]  Ronald C. Arkin,et al.  Human perspective on affective robotic behavior: a longitudinal study , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Gregory Dudek,et al.  A Visual Language for Robot Control and Programming: A Human-Interface Study , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  Jekaterina Novikova,et al.  A design model of emotional body expressions in non-humanoid robots , 2014, HAI.

[7]  Robin R. Murphy,et al.  Survey of Non-facial/Non-verbal Affective Expressions for Appearance-Constrained Robots , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  W. Nöth.  Handbook of Semiotics , 2001 .

[9]  D. L. Gorlée.  Handbook of Semiotics , 1997, English and American Studies in German.

[10]  James J. Little,et al.  Ensuring safety in human-robot dialog — A cost-directed approach , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Sebastian G. Elbaum,et al.  Investigation of Communicative Flight Paths for Small Unmanned Aerial Systems * This work was supported by NSF NRI 1638099 , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Reid Simmons,et al.  Expressive motion with x, y and theta: Laban Effort Features for mobile robots , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[13]  Sebastian G. Elbaum,et al.  UAS-Rx interface for mission planning, fire tracking, fire ignition, and real-time updating , 2017, 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR).

[14]  Greg Mori,et al.  HRI in the sky: Creating and commanding teams of UAVs with a vision-mediated gestural interface , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Michael R. M. Jenkin,et al.  Swimming with robots: Human robot communication at depth , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Junaed Sattar,et al.  Robot Communication Via Motion: Closing the Underwater Human-Robot Interaction Loop , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[18]  Ronald C. Arkin,et al.  Behavioral overlays for non-verbal communication expression on a humanoid robot , 2007, Auton. Robots.

[19]  I. Scott MacKenzie,et al.  The use of gaze to control drones , 2014, ETRA.

[20]  Ayanna M. Howard,et al.  Underwater human-robot communication: A case study with human divers , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[21]  Cesar Lucho,et al.  Daedalus: A sUAV for Human-Robot Interaction , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  Luca Maria Gambardella,et al.  Human Control of UAVs using Face Pose Estimates and Hand Gestures , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[23]  Manuela M. Veloso,et al.  Mobile Service Robot State Revealing Through Expressive Lights: Formalism, Design, and Evaluation , 2018, Int. J. Soc. Robotics.

[24]  Gregory Dudek,et al.  Enabling autonomous capabilities in underwater robotics , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Md Jahidul Islam,et al.  Dynamic Reconfiguration of Mission Parameters in Underwater Human-Robot Collaboration , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Tobias Doernbach,et al.  Robust Gesture-Based Communication for Underwater Human-Robot Interaction in the context of Search and Rescue Diver Missions , 2018, ArXiv.

[27]  Nils J. Nilsson,et al.  Shakey the Robot , 1984 .

[28]  Tetsuo Sawaragi,et al.  Acquiring communicative motor acts of social robot using interactive evolutionary computation , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[29]  Ehud Sharlin,et al.  Collocated interaction with flying robots , 2011, 2011 RO-MAN.

[30]  Maja J. Mataric,et al.  The role of physical embodiment in human-robot interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[31]  Nikolaos Mavridis,et al.  A review of verbal and non-verbal human-robot interactive communication , 2014, Robotics Auton. Syst..

[32]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[33]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[34]  Cindy L. Bethel,et al.  Robots without faces: non-verbal social human-robot interaction , 2009 .