A Study of Initiative Decision-Making in Distributed Human-Robot Teams

Dull, dirty, and dangerous emergency response tasks (e.g., Fukushima nuclear disaster) typically call for human-robot teams such that the robots are teleoperated by one or more operators at a remote location. However, this distance creates a disconnect between human and robot that hinders effective teamwork. Mixed-initiative interaction has the potential to bridge the disconnect by enabling the human and robot to opportunistically interleave their complementary capabilities. However, allowing robots to intervene and take over from the human could be ill-fated if the intervention is illtimed. Hence, in this article, we examine the question of when should a robot intervene and seize control from a human operator, through a human subject study where the human-robot team is tasked to search for disaster victims in an unknown environment. Keywords—mixed-initiative interaction; human-robot team; computational model

[1]  Robin R. Murphy,et al.  Moonlight in Miami : A Field Study of Human-Robot Interaction in the Context of an Urban Search and Rescue Disaster Response Training Exercise , 2003 .

[2]  Eric Horvitz,et al.  Principles of mixed-initiative user interfaces , 1999, CHI '99.

[3]  Kian Hsiang Low,et al.  Interactive POMDP Lite: Towards Practical Planning to Predict and Exploit Intentions for Interacting with Self-Interested Agents , 2013, IJCAI.

[4]  Holly A. Yanco,et al.  Blending human and robot inputs for sliding scale autonomy , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[5]  Donald D. Dudenhoeffer,et al.  Dynamic-Autonomy for Urban Search and Rescue , 2002, AAAI Mobile Robot Competition.

[6]  A. Goldman,et al.  Mirror neurons and the simulation theory of mind-reading , 1998, Trends in Cognitive Sciences.

[7]  Terrence Fong,et al.  Collaboration, Dialogue, Human-Robot Interaction , 2001, ISRR.

[8]  K. Suzanne Barber,et al.  Dynamic adaptive autonomy in multi-agent systems , 2000, J. Exp. Theor. Artif. Intell..

[9]  José Orlando Gomes,et al.  Handoff strategies in settings with high consequences for failure: lessons for health care operations. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[10]  Jenay M. Beer,et al.  Toward a framework for levels of robot autonomy in human-robot interaction , 2014, Journal of human-robot interaction.

[11]  Julie A. Shah,et al.  Decision-making authority, team efficiency and human worker satisfaction in mixed human–robot teams , 2015, Auton. Robots.

[12]  Julie Shah,et al.  Human-Robot Teaming using Shared Mental Models , 2012 .

[13]  Stefanos Nikolaidis,et al.  Human-robot cross-training: Computational formulation, modeling and evaluation of a human team training strategy , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[14]  Ronald C. Arkin,et al.  Mixed-Initiative Human-Robot Interaction: Definition, Taxonomy, and Survey , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[15]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[16]  Cynthia Breazeal,et al.  Action parsing and goal inference using self as simulator , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[17]  Bilge Mutlu,et al.  Coordination Mechanisms in Human-Robot Collaboration , 2013 .

[18]  J. Mathieu,et al.  The influence of shared mental models on team process and performance. , 2000, The Journal of applied psychology.

[19]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[20]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[21]  Katsushi Ikeuchi,et al.  Flexible cooperation between human and robot by interpreting human intention from gaze information , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[22]  Michael A. Goodrich,et al.  Experiments in adjustable autonomy , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[23]  Mica R. Endsley,et al.  The Application of Human Factors to the Development of Expert Systems for Advanced Cockpits , 1987 .

[24]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[25]  Toshiyuki Inagaki,et al.  Adaptive Automation: Sharing and Trading of Control , 2001 .

[26]  Jonathan L. Odom,et al.  Toward Initiative Decision-Making for Distributed Human-Robot Teams , 2018, HAI.

[27]  Robin R. Murphy,et al.  Moonlight in Miami: a field study of human-robot interaction in the context of an urban search and rescue disaster response training exercise , 2004 .

[28]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[29]  Glenn F. Wilson,et al.  Human-Automation Interaction Research , 2013 .

[30]  Minoru Asada,et al.  Efficient human-robot collaboration: When should a robot take initiative? , 2017, Int. J. Robotics Res..

[31]  Holly A. Yanco,et al.  Autonomy mode suggestions for improving human-robot interaction , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[32]  Cynthia Breazeal,et al.  Collaboration in Human-Robot Teams , 2004, AIAA 1st Intelligent Systems Technical Conference.

[33]  Debra Schreckenghost,et al.  Adjustable Autonomy for Human-Centered Autonomous Systems , 1999 .

[34]  Thomas B. Sheridan,et al.  Adaptive Automation, Level of Automation, Allocation Authority, Supervisory Control, and Adaptive Control: Distinctions and Modes of Adaptation , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[35]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[36]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[37]  Sanjiv Singh,et al.  User Modelling for Principled Sliding Autonomy in Human-Robot Teams , 2005 .

[38]  Curry Guinn,et al.  Mixed-initiative interaction , 1999 .

[39]  A. McEwan,et al.  Patient handover from surgery to intensive care: using Formula 1 pit‐stop and aviation models to improve safety and quality , 2007, Paediatric anaesthesia.

[40]  Robert L. Goldstone,et al.  Human foraging behavior in a virtual environment , 2004, Psychonomic bulletin & review.

[41]  P. J. Gmytrasiewicz,et al.  A Framework for Sequential Planning in Multi-Agent Settings , 2005, AI&M.

[42]  Gheorghe Tecuci,et al.  Seven Aspects of Mixed-Initiative Reasoning: An Introduction to this Special Issue on Mixed-Initiative Assistants , 2007, AI Mag..

[43]  Alyssa Tanaka,et al.  Video game experience and basic robotic skills , 2016, 2016 IEEE International Conference on Serious Games and Applications for Health (SeGAH).

[44]  H. Bekkering,et al.  Joint action: bodies and minds moving together , 2006, Trends in Cognitive Sciences.

[45]  Reid G. Simmons,et al.  Coordinated Multiagent Teams and Sliding Autonomy for Large-Scale Assembly , 2006, Proceedings of the IEEE.

[46]  Paul E. Spector,et al.  The Impact of Cross-Training on Team Functioning: An Empirical Investigation , 1996, Hum. Factors.