Human Interaction With Multiple Remote Robots

In this chapter, I review research involving remote human supervision of multiple unmanned vehicles (UVs) using command complexity as an organizing construct. Multi-UV tasks range from foraging, requiring little coordination among UVs, to formation following, in which UVs must function as a cohesive unit. Command complexity, the degree to which operator effort increases with the number of supervised UVs, is used to categorize human interaction with multiple UVs. For systems in which each UV requires the same form of attention (O(n)), effort increases linearly with the number of UVs. For systems in which the control of one UV is dependent upon another (O(>n)), additional UVs impose greater than linear increases due to the expense of coordination. For other systems, an operator interacts with an autonomously coordinating group, and effort is unaffected by group size (O(1)). Studies of human/multi-UV interaction can be roughly grouped into O(n) supervision, involving one-to-one control of individual UVs, or ...

[1]  Holly A. Yanco,et al.  Multi-user multi-touch multi-robot command and control of multiple simulated robots , 2012, HRI '12.

[2]  David S Alberts,et al.  Network Centric Warfare: Developing and Leveraging Information Superiority , 1999 .

[3]  Wu,et al.  A Playbook Approach to Variable Autonomy Control: Application for Control of Multiple, Heterogeneous Unmanned Air Vehicles , 2004 .

[4]  Jonathan P. How,et al.  Increasing autonomy of UAVs , 2009, IEEE Robotics & Automation Magazine.

[5]  Douglas J. Gillan,et al.  Cognitive Analysis Methods for Control of Multiple Robots: Robotics on $5 a Day , 2004 .

[6]  Jessie Y. C. Chen,et al.  Effectiveness of RoboLeader for Dynamic Re-Tasking in an Urban Environment , 2011 .

[7]  Heath A. Ruff,et al.  “Picture-in-Picture” Augmentation of UAV Workstation Video Display , 2007 .

[8]  Lynne E. Parker,et al.  ALLIANCE: an architecture for fault tolerant multirobot cooperation , 1998, IEEE Trans. Robotics Autom..

[9]  J. Gregory Trafton,et al.  Adaptive automation and cue invocation: the effect of cue timing on operator error , 2013, CHI.

[10]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[11]  Ronald C. Arkin,et al.  Integrated Mission Specification and Task Allocation for Robot Teams - Design and Implementation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  David D. Woods,et al.  Envisioning human-robot coordination in future operations , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Dan R. Olsen,et al.  Fan-out: measuring human control of multiple robots , 2004, CHI.

[14]  Shahin Sirouspour,et al.  Modeling and control of cooperative teleoperation systems , 2005, IEEE Transactions on Robotics.

[15]  R Parasuraman,et al.  Effects of automation and task load on task switching during human supervision of multiple semi-autonomous robots in a dynamic environment , 2010, Ergonomics.

[16]  Katia P. Sycara,et al.  A game theoretic queueing approach to self-assessment in human-robot interaction systems , 2011, 2011 IEEE International Conference on Robotics and Automation.

[17]  Jessie Y C Chen,et al.  UAV-guided navigation for ground robot tele-operation in a military reconnaissance environment , 2010, Ergonomics.

[18]  David D. Woods,et al.  Visual Momentum: A Concept to Improve the Cognitive Coupling of Person and Computer , 1984, Int. J. Man Mach. Stud..

[19]  Michael A. Goodrich,et al.  Toward human interaction with bio-inspired robot teams , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[20]  Julie A. Adams,et al.  Enhancing RoboFlag Users' Situational Awareness , 2004 .

[21]  Jacob W. Crandall,et al.  The Impact of Heterogeneity on Operator Performance in Future Unmanned Vehicle Systems , 2008 .

[22]  Stefano Carpin,et al.  Validating USARsim for use in HRI Research , 2005 .

[23]  Birsen Donmez,et al.  Auditory Decision Aiding in Supervisory Control of Multiple Unmanned Aerial Vehicles , 2009, Hum. Factors.

[24]  Emilie Roth,et al.  Designing Human System Interfaces for Supervising Multiple UAV Teams , 2004 .

[25]  Paul Scerri,et al.  User evaluation of a GUI for controlling an autonomous persistent surveillance team , 2010, Defense + Commercial Sensing.

[26]  Heath A. Ruff,et al.  Automated Aid Evaluation for Transitioning UAS Camera Views , 2010 .

[27]  James A. Hendler,et al.  HTN Planning: Complexity and Expressivity , 1994, AAAI.

[28]  Holly A. Yanco,et al.  Classifying human-robot interaction: an updated taxonomy , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[29]  Steven Skiena,et al.  Attention and Communication: Decision Scenarios for Teleoperating Robots , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[30]  Laura E. Barnes,et al.  Effective robot team control methodologies for battlefield applications , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Michael A. Goodrich,et al.  Abstraction and Persistence: Macro-Level Guarantees of Collective Bio-Inspired Teams under Human Supervision , 2012, Infotech@Aerospace.

[32]  Emilie Roth,et al.  Human in the Loop Evaluation of a Mixed-Initiative System for Planning and Control of Multiple UAV Teams , 2004 .

[33]  Michael Lewis,et al.  Human control for cooperating robot teams , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[34]  Heath A. Ruff,et al.  Automation-Level Transference Effects in Simulated Multiple Unmanned Aerial Vehicle Control , 2011 .

[35]  Katia P. Sycara,et al.  Service level differentiation in multi-robots control , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Andrea M Philipp,et al.  The role of inhibition in task switching: A review , 2010, Psychonomic bulletin & review.

[37]  Christopher D. Wickens,et al.  Management of Multiple Uavs with Imperfect Automation , 2006 .

[38]  Raja Parasuraman,et al.  Adaptive Automation for Human Supervision of Multiple Uninhabited Vehicles: Effects on Change Detection, Situation Awareness, and Mental Workload , 2009 .

[39]  Birsen Donmez,et al.  Modeling Workload Impact in Multiple Unmanned Vehicle Supervisory Control , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[40]  David E. Kieras,et al.  A Guide to GOMS Model Usability Evaluation using NGOMSL , 1997 .

[41]  Daniel Gartenberg,et al.  Situation Awareness Reacquisition in a Supervisory Control Task , 2011 .

[42]  Emilio Frazzoli,et al.  A Dynamical Queue Approach to Intelligent Task Management for Human Operators , 2012, Proceedings of the IEEE.

[43]  Michael A. Goodrich,et al.  Characterizing efficiency of human robot interaction: a case study of shared-control teleoperation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Julie A. Adams,et al.  Human Management of a Hierarchical System for the Control of Multiple Mobile Robots ( Dissertation Proposal ) MS-CIS-95-17 GRASP Lab 392 , 1994 .

[45]  Raja Parasuraman,et al.  Adaptive Aiding of Human-Robot Teaming , 2011 .

[46]  Michael A. Goodrich,et al.  Task Switching and Multi-Robot Teams , 2005 .

[47]  Mary L. Cummings,et al.  Automated Scheduling Decision Support for Supervisory Control of Multiple UAVs , 2006, J. Aerosp. Comput. Inf. Commun..

[48]  Michael Lewis,et al.  Measuring Coordination Demand in Multirobot Teams , 2009 .

[49]  Michael R. M. Jenkin,et al.  A taxonomy for swarm robots , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[50]  Takayuki Kanda,et al.  Teleoperation of Multiple Social Robots , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[51]  Andrea M Philipp,et al.  Control and interference in task switching--a review. , 2010, Psychological bulletin.

[52]  B. Trouvain,et al.  Evaluation of multi-robot control and monitoring performance , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[53]  Michael A. Goodrich,et al.  Validating human-robot interaction schemes in multitasking environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[54]  Christopher A. Miller,et al.  Adaptable Operator-Automation Interface for Future Unmanned Aerial Systems Control: Development of a Highly Flexible Delegation Concept Demonstration , 2012, Infotech@Aerospace.

[55]  Daniel Goldberg,et al.  Adaptive Levels of Autonomy (ALOA) for UAV Supervisory Control , 2005 .

[56]  Michael A. Goodrich,et al.  Towards using Unmanned Aerial Vehicles (UAVs) in Wilderness Search and Rescue: Lessons from field trials , 2009 .

[57]  Katia Sycara,et al.  Human-swarm interaction , 2013, HRI 2013.

[58]  Michael Jenkin,et al.  A Taxonomy of Multirobot Systems , 2003 .

[59]  Mark H. Overmars,et al.  Indicative routes for path planning and crowd simulation , 2009, FDG.

[60]  John M. Dolan,et al.  Scheduling for humans in multirobot supervisory control , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[61]  Heath A. Ruff,et al.  EXPLORING AUTOMATION ISSUES IN SUPERVISORY CONTROL OF MULTIPLE UAVS , 2004 .

[62]  Alberto Valero-Gomez,et al.  Impact of Two Adjustable-Autonomy Models on the Scalability of Single-Human/Multiple-Robot Teams for Exploration Missions , 2011, Hum. Factors.

[63]  Shafiq Abedin,et al.  Scalable target detection for large robot teams , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[64]  Americo De Jesus Caves Human-Automation Collaborative RRT for UAV Mission Path Planning , 2010 .

[65]  Joseph R. Keebler,et al.  Effects of Sharing Control of Unmanned Vehicles on Backup Behavior and Workload in Distributed Operator Teams , 2009 .

[66]  Prasanna Velagapudi,et al.  Process and Performance in Human-Robot Teams , 2011 .

[67]  Bruce P. Hunn 13. Video Imagery's Role in Network Centric, Multiple Unmanned Aerial Vehicle (UAV) Operations , 2006 .

[68]  Jessie Y.C. Chen,et al.  Effects of imperfect automation and individual differences on concurrent performance of military and robotics tasks in a simulated multitasking environment , 2009, Ergonomics.

[69]  Shafiq Abedin,et al.  SUAVE: Integrating UAV video using a 3D model , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[70]  Yehuda Elmaliach,et al.  Experiments with an ecological interface for monitoring tightly-coordinated robot teams , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[71]  Mary L. Cummings,et al.  The Role of Human-Automation Consensus in Multiple Unmanned Vehicle Scheduling , 2010, Hum. Factors.

[72]  Nicholas Roy,et al.  Human-automated path planning optimization and decision support , 2012, Int. J. Hum. Comput. Stud..

[73]  Paul Scerri,et al.  Asynchronous Control with ATR for Large Robot Teams , 2011 .

[74]  Raja Parasuraman,et al.  Human control of multiple robots in the RoboFlag simulation environment , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[75]  Marc Spraragen,et al.  An intelligent assistant for interactive workflow composition , 2004, IUI '04.

[76]  Michael Lewis,et al.  Human vs. Algorithmic Path Planning for Search and Rescue by Robot Teams , 2010 .

[77]  Andrew S Clare,et al.  Dynamic human-computer collaboration in real-time unmanned vehicle scheduling , 2010 .

[78]  James McLurkin,et al.  Speaking Swarmish: Human-Robot Interface Design for Large Swarms of Autonomous Mobile Robots , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[79]  David B. Kaber,et al.  Out‐of‐the‐loop performance problems and the use of intermediate levels of automation for improved control system functioning and safety , 1997 .

[80]  Lynne E. Parker,et al.  Robot Teams: From Diversity to Polymorphism , 2002 .

[81]  James McLurkin,et al.  Protoswarm: a language for programming multi-robot systems using the amorphous medium abstraction , 2008, AAMAS.

[82]  Jeffrey D. Anderson,et al.  Managing autonomy in robot teams: Observations from four experiments , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[83]  Milind Tambe,et al.  Towards Adjustable Autonomy for the Real World , 2002, J. Artif. Intell. Res..

[84]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[85]  Roger A. Chadwick Operating Multiple Semi-Autonomous Robots: Monitoring, Responding, Detecting , 2006 .

[86]  Jacob W. Crandall,et al.  Developing performance metrics for the supervisory control of multiple robots , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[87]  Bruce P. Hunn The Human Challenges of Command and Control with Multiple Unmanned Aerial Vehicles , 2005 .

[88]  Heath A. Ruff,et al.  Advanced Display Concepts for Uav Sensor Operations: Landmark Cues and Picture-in-Picture , 2006 .

[89]  J. Gregory Trafton,et al.  Time Pressure, Memory, and Task Knowledge Facilitate the Opportunism Heuristic in Dynamic Tasks , 2012 .

[90]  Ronald C. Arkin,et al.  Multiagent telerobotics: matching systems to tasks , 1999 .

[91]  Katia Sycara,et al.  Effects of Alarms on Control of Robot Teams , 2011 .

[92]  Jean-Yves Fourquet,et al.  On the collaboration of an automatic path-planner and a human user for path-finding in virtual industrial scenes , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[93]  Ronald C. Arkin,et al.  Usability evaluation of high-level user assistance for robot mission specification , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[94]  Zhihua Qu,et al.  RoboLeader: an agent for supervisory control of multiple robots , 2010, HRI 2010.

[95]  Hiroshi Furukawa,et al.  A flexible delegation-type interface enhances system performance in human supervision of multiple robots: empirical studies with RoboFlag , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[96]  Raja Parasuraman,et al.  Beyond Levels of Automation: An Architecture for More Flexible Human-Automation Collaboration , 2003 .

[97]  Prasanna Velagapudi,et al.  Scaling effects for streaming video vs. static panorama in multirobot search , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[98]  Katia P. Sycara,et al.  Scheduling operator attention for Multi-Robot Control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[99]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[100]  Robert P. Goldman,et al.  A high-level “tasking” interface for uninhabited combat air vehicles , 1998, IUI '99.

[101]  R. D'Andrea,et al.  The RoboFlag testbed , 2003, Proceedings of the 2003 American Control Conference, 2003..

[102]  M. L. Cummings,et al.  Decision Support Design for Workload Mitigation in Human Supervisory Control of Multiple Unmanned Aerial Vehicles , 2006 .

[103]  Michael A. Goodrich,et al.  Towards combining UAV and sensor operator roles in UAV-enabled visual search , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[104]  Jacob W. Crandall,et al.  Predicting Operator Capacity for Supervisory Control of Multiple UAVs , 2007, Innovations in Intelligent Machines.

[105]  John P. Lewis,et al.  The Future of Disaster Response: Humans Working with Multiagent Teams using DEFACTO , 2005, AAAI Spring Symposium: AI Technologies for Homeland Security.

[106]  Julie A. Adams,et al.  Assessing the scalability of a multiple robot interface , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[107]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[108]  Catherine M Arrington,et al.  Voluntary task switching: chasing the elusive homunculus. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[109]  Mary L. Cummings,et al.  Predicting the Impact of Heterogeneity on Unmanned-Vehicle Team Performance , 2008 .

[110]  Prasanna Velagapudi,et al.  Choosing Autonomy Modes for Multirobot Search , 2010, Hum. Factors.

[111]  Jonathan P. How,et al.  Operator Object Function Guidance for a Real-Time Unmanned Vehicle Scheduling Algorithm , 2012, J. Aerosp. Comput. Inf. Commun..

[112]  Heath A. Ruff,et al.  Effect of Level of Automation on Unmanned Aerial Vehicle Routing Task , 2009 .

[113]  Marc McConley,et al.  Hierarchical Planning for Large Numbers of Unmanned Vehicles , 2004 .

[114]  Heath A. Ruff,et al.  Levels of Automation in Multi-UAV Control Allocation and Router Tasks , 2009 .

[115]  Thomas Fincannon,et al.  Indexing Spatial Ability Across Team Size , 2011 .

[116]  Jessie Y. C. Chen,et al.  Supervisory Control of Multiple Robots , 2012, Hum. Factors.

[117]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[118]  Cameron H. Engh,et al.  Towards Using UAVs in Wilderness Search and Rescue: Lessons from Field Trials , 2009 .

[119]  Tal Oron-Gilad,et al.  'Castling rays' a decision support tool for UAV-switching tasks , 2010, CHI Extended Abstracts.

[120]  Reid G. Simmons,et al.  Coordinated Multiagent Teams and Sliding Autonomy for Large-Scale Assembly , 2006, Proceedings of the IEEE.

[121]  Michael A. Goodrich,et al.  Comparing Situation Awareness for Two Unmanned Aerial Vehicle Human Interface Approaches , 2006 .

[122]  Christopher D. Wickens,et al.  Comparing Quantitative Model Predictions to Experimental Data in Multiple-UAV Flight Control , 2003 .

[123]  Alberto Valero-Gomez,et al.  Exploratory Analysis of Operator: Robot Ratio in Search and Rescue Missions , 2010, TA.

[124]  Alexander C. Kahn,et al.  Experimental evaluation of human-machine collaborative algorithms in planning for multiple UAVs , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[125]  Jean Scholtz,et al.  Theory and evaluation of human robot interactions , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[126]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[127]  J. A. Adams Multiple robot / single human interaction: effects on perceived workload , 2009, Behav. Inf. Technol..

[128]  Zsolt Kira,et al.  Exerting human control over decentralized robot swarms , 2000, 2009 4th International Conference on Autonomous Robots and Agents.

[129]  J. Gregory Trafton,et al.  Human control of multiple unmanned vehicles: effects of interface type on execution and task switching times , 2006, HRI '06.

[130]  Mark H. Draper,et al.  Synthetic vision system for improving unmanned aerial vehicle operator situation awareness , 2005, SPIE Defense + Commercial Sensing.

[131]  Christopher A. Miller,et al.  Future Unmanned Aerial Systems Control: Feedback on Highly Flexible Operator-Automation Delegation Interface Concept , 2012, Infotech@Aerospace.

[132]  Nadine Sarter,et al.  Supporting Dynamic Re-Planning In Multiple Uav Control: A Comparison of 3 Levels of Automation , 2012 .

[133]  Julie A. Adams,et al.  Visualization of Multiple Robots during Team Activities , 2006 .

[134]  Jonathan P. How,et al.  The Impact of Human–Automation Collaboration in Decentralized Multiple Unmanned Vehicle Control , 2012, Proceedings of the IEEE.

[135]  Tal Oron-Gilad,et al.  Tools and Techniques for MOMU (Multiple Operator Multiple UAV) Environments; an Operational Perspective , 2011 .

[136]  Alan R. Wagner,et al.  Multi-robot User Interface Modeling , 2006, DARS.

[137]  Kuanhao Zheng,et al.  Designing and Implementing a Human–Robot Team for Social Interactions , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[138]  Daniele Nardi,et al.  Multirobot systems: a classification focused on coordination , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[139]  Mary L. Cummings,et al.  Modeling multiple human operators in the supervisory control of heterogeneous unmanned vehicles , 2009, PerMIS.

[140]  L Gugerty,et al.  Seeing where you are heading: integrating environmental and egocentric reference frames in cardinal direction judgments. , 2001, Journal of experimental psychology. Applied.

[141]  Paul Scerri,et al.  Using Immersive 3D Terrain Models For Fusion Of UAV Surveillance Imagery , 2009 .

[142]  Yang Xu,et al.  An integrated token-based algorithm for scalable coordination , 2005, AAMAS '05.

[143]  Yehuda Elmaliach,et al.  Single Operator, Multiple Robots: Call-Request Handling in Tight-Coordination Tasks , 2006, DARS.

[144]  Nilanjan Chakraborty,et al.  Input Efficiency for Influencing Swarm , 2012 .

[145]  Jessie Y. C. Chen,et al.  Human-agent teaming for robot management in multitasking environments , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[146]  Chris Hanson,et al.  Amorphous computing , 2000, Commun. ACM.

[147]  Mary L. Cummings,et al.  Teamwork in controlling multiple robots , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[148]  Raja Parasuraman,et al.  18. Delegation Interfaces for Human Supervision of Multiple Unmanned Vehicles: Theory, Experiments, and Practical Applications , 2006 .

[149]  Michael Lewis,et al.  Assessing coordination overhead in control of robot teams , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[150]  Ronald A. Rensink,et al.  Change blindness: past, present, and future , 2005, Trends in Cognitive Sciences.

[151]  David V. Pynadath,et al.  Adjustable Autonomy for the Real World , 2003 .

[152]  Mary L. Cummings,et al.  Managing Multiple UAVs through a Timeline Display , 2005 .

[153]  Jessie Y. C. Chen,et al.  Supervisory Control of Multiple Robots: Human-Performance Issues and User-Interface Design , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[154]  Ronald C. Arkin,et al.  Evaluating the Usability of Robot Programming Toolsets , 1998, Int. J. Robotics Res..

[155]  Brian A. Weiss,et al.  Test arenas and performance metrics for urban search and rescue robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[156]  Arnoud Visser,et al.  Towards heterogeneous robot teams for disaster mitigation: Results and performance metrics from RoboCup rescue , 2007, J. Field Robotics.

[157]  Heath A. Ruff,et al.  Human-Integrated Supervisory Control of Uninhabited Combat Aerial Vehicles , 2000, J. Robotics Mechatronics.

[158]  Joseph R. Keebler,et al.  Some Good and Bad with Spatial Ability in Three Person Teams That Operate Multiple Unmanned Vehicles , 2010 .

[159]  Jessie Y. C. Chen,et al.  The Mixed Initiative Experimental (MIX) Testbed for Human Robot Interactions With Varied Levels of Automation , 2008 .

[160]  Paul Scerri,et al.  17. Scaling-up Human Control for Large UAV Teams , 2006 .

[161]  Michael A. Goodrich,et al.  Experiments in adjustable autonomy , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[162]  Lynne E. Parker,et al.  Multi-Robot Systems: From Swarms to Intelligent Automata , 2002, Springer Netherlands.

[163]  Christopher D. Wickens,et al.  Mission Control of Multiple Unmanned Aerial Vehicles: A Workload Analysis , 2005, Hum. Factors.

[164]  Carl Nehme,et al.  Modeling human supervisory control in heterogeneous unmanned vehicle systems , 2009 .

[165]  A. T. Tai,et al.  A human factors testbed for command and control of unmanned air vehicles , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[166]  Harvey S. Smallman,et al.  Recovery from Interruptions to a Dynamic Monitoring Task: The Beguiling Utility of Instant Replay , 2005 .

[167]  Michael A. Goodrich,et al.  Seven principles of efficient human robot interaction , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[168]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[169]  Stacey D. Scott,et al.  Assisting Interruption Recovery in Supervisory Control of Multiple Uavs , 2006 .

[170]  Christopher M. Schlick,et al.  Comparison of a map- vs. camera-based user interface in a multi-robot navigation task , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[171]  Mary L. Cummings,et al.  Operator Choice Modeling for Collaborative UAV Visual Search Tasks , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[172]  Edwin Olson,et al.  Progress toward multi‐robot reconnaissance and the MAGIC 2010 competition , 2012, J. Field Robotics.

[173]  Michel Taïx,et al.  Human Interaction with Motion Planning Algorithm , 2012, J. Intell. Robotic Syst..

[174]  Stefano Carpin,et al.  Quantitative Assessments of USARSim Accuracy , 2006 .

[175]  Jacob W. Crandall,et al.  Computing the Effects of Operator Attention Allocation in Human Control of Multiple Robots , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[176]  Michael Lewis,et al.  USARSim: Simulation for the Study of Human-Robot Interaction , 2007 .

[177]  Mary L. Cummings,et al.  Assessing operator strategies for real-time replanning of multiple unmanned vehicles , 2012 .

[178]  Michael R. M. Jenkin,et al.  A taxonomy for multi-agent robotics , 1996, Auton. Robots.

[179]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[180]  Michael A. Goodrich,et al.  Beyond robot fan-out: Towards multi-operator supervisory control , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[181]  Nathan D. Powel,et al.  Multiserver queueing for supervisory control of autonomous vehicles , 2012, 2012 American Control Conference (ACC).