Human Factors in the Scalability of Multirobot Operation: A Review and Simulation

Scalable systems can increase or decrease their size with costs that are proportionate to the resulting change in performance. These costs can be monetary or related to other factors such as integration effort, operator training, or infrastructure upgrades. The options to increase in size to meet growing demand and decrease in size to minimize costs while servicing low demand make scalable systems attractive for completing tasks under uncertainty. Multirobot systems are used in many tasks characterized by uncertainty, such as search and rescue, mapping, and perimeter defense. When human operators interact with multirobot systems, the scalability can be limited by the human’s cognitive abilities, decision making speed, and performance under stress. Human problem solving and creativity can also be beneficial to the system to overcome potential scaling challenges. This paper summarizes the literature on humans’ effects on scalability of multirobot systems and presents an illustrative simulation of the challenges of scaling a multioperator, multirobot surveillance system.

[1]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[2]  Katia Sycara,et al.  Human control strategies for multi-robot teams , 2012 .

[3]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[4]  Christopher C. Pagano,et al.  Spatial Perception and Robot Operation , 2011 .

[5]  Scott M. Galster,et al.  Managing Multiple Uavs: Are we Asking the Right Questions? , 2006 .

[6]  Marco Dorigo,et al.  Investigating the effect of increasing robot group sizes on the human psychophysiological state in the context of human–swarm interaction , 2016, Swarm Intelligence.

[7]  Prasanna Velagapudi,et al.  Scaling effects for streaming video vs. static panorama in multirobot search , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Thomas Fincannon,et al.  Best Practices in Human Operation of Robotic/Unmanned Vehicles , 2013 .

[9]  Hiroshi Furukawa,et al.  A flexible delegation-type interface enhances system performance in human supervision of multiple robots: empirical studies with RoboFlag , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[10]  Azad M. Madni,et al.  Scalability in Self-Organizing Systems: An Experimental Case Study on Foraging Systems , 2018 .

[11]  Frederic Burgaud,et al.  A Methodology to Evaluate Tradeoffs between Individual Architecture Development and Numerality to Achieve Group Performance in Robotics Swarms , 2016 .

[12]  Rajesh Elara Mohan,et al.  Extended neglect tolerance model & human robot teams , 2011, 2011 8th International Conference on Information, Communications & Signal Processing.

[13]  Michael A. Goodrich,et al.  Scalable Human Interaction with Robotic Swarms , 2013 .

[14]  Prasanna Velagapudi,et al.  How search and its subtasks scale in N robots , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Radhika Nagpal,et al.  Programmable Self-disassembly for Shape Formation in Large-Scale Robot Collectives , 2016, DARS.

[16]  Michael A. Goodrich,et al.  Task Switching and Multi-Robot Teams , 2005 .

[17]  Azad M. Madni,et al.  Human-Systems Integration Challenges in Resilient Multi-UAV Operation , 2017 .

[18]  Michael A. Goodrich,et al.  Validating human-robot interaction schemes in multitasking environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[19]  Mary L. Cummings,et al.  Automation Architecture for Single Operator, Multiple UAV Command and Control, , 2007 .

[20]  Katia Sycara,et al.  Human-swarm interaction , 2013, HRI 2013.

[21]  Stefano Carpin,et al.  USARSim: a robot simulator for research and education , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[22]  J. A. Adams Multiple robot / single human interaction: effects on perceived workload , 2009, Behav. Inf. Technol..

[23]  Michael E. Miller,et al.  Predictive mental workload modeling for semiautonomous system design: Implications for systems of systems , 2012, Syst. Eng..

[24]  David R. Meyer,et al.  The Role of Simulation in Designing Human-Automation Systems , 2016, HCI.

[25]  Maarten Sierhuis,et al.  Adjustable Autonomy and Human-Agent Teamwork in Practice: An Interim Report on Space Applications , 2003 .

[26]  Prasanna Velagapudi,et al.  Choosing Autonomy Modes for Multirobot Search , 2010, Hum. Factors.

[27]  Jacob W. Crandall,et al.  Identifying Predictive Metrics for Supervisory Control of Multiple Robots , 2007, IEEE Transactions on Robotics.

[28]  Andre B. Bondi,et al.  Characteristics of scalability and their impact on performance , 2000, WOSP '00.

[29]  Grant S. Taylor,et al.  Individual differences in response to automation: the five factor model of personality. , 2011, Journal of experimental psychology. Applied.

[30]  Mary L. Cummings,et al.  Predicting Controller Capacity in Supervisory Control of Multiple UAVs , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Peter Svenmarck,et al.  Operating Multiple Semi-autonomous UGVs: Navigation, Strategies, and Instantaneous Performance , 2007, HCI.

[32]  Roger A. Chadwick Operating Multiple Semi-Autonomous Robots: Monitoring, Responding, Detecting , 2006 .

[33]  Radhika Nagpal,et al.  Kilobot: A low cost scalable robot system for collective behaviors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[34]  Kan Zhang,et al.  The Impairing Effect of Mental Fatigue on Visual Sustained Attention under Monotonous Multi-Object Visual Attention Task in Long Durations: An Event-Related Potential Based Study , 2016, PloS one.

[35]  Miguel P. Eckstein,et al.  Human Supervisory Control of Robotic Teams: Integrating Cognitive Modeling with Engineering Design , 2015, IEEE Control Systems.

[36]  B. Trouvain,et al.  Design and Evaluation of a Multi-Robot Control Interface , 2003 .

[37]  Wolfram Burgard,et al.  Coordination for Multi-Robot Exploration and Mapping , 2000, AAAI/IAAI.

[38]  Gregory J. Funke,et al.  Human Span-Of-Control in Cyber Operations: An Experimental Evaluation of Fan-Out , 2015 .

[39]  Jacob W. Crandall,et al.  Predictive Model for Human-Unmanned Vehicle Systems , 2009, J. Aerosp. Comput. Inf. Commun..

[40]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[41]  Rahul Rai,et al.  Modeling Multi Operator-Multi-UAV (MOMU) Operator Attention Allocation Problem , 2013 .

[42]  Nikolaos G. Tsagarakis,et al.  Robot adaptation to human physical fatigue in human–robot co-manipulation , 2018, Auton. Robots.

[43]  Linda R. Elliott,et al.  Managing workload in human-robot interaction: A review of empirical studies , 2010, Comput. Hum. Behav..

[44]  Aaron T. Becker,et al.  Steering a Swarm of Particles Using Global Inputs and Swarm Statistics , 2018, IEEE Transactions on Robotics.

[45]  Dan R. Olsen,et al.  Fan-out: measuring human control of multiple robots , 2004, CHI.

[46]  Mary L. Cummings,et al.  Developing Operator Capacity Estimates for Supervisory Control of Autonomous Vehicles , 2007, Hum. Factors.

[47]  Paul Scerri,et al.  17. Scaling-up Human Control for Large UAV Teams , 2006 .

[48]  Jessie Y. C. Chen,et al.  Human–Agent Teaming for Multirobot Control: A Review of Human Factors Issues , 2014, IEEE Transactions on Human-Machine Systems.

[49]  Benoit Gaudou,et al.  GAMA 1.6: Advancing the Art of Complex Agent-Based Modeling and Simulation , 2013, PRIMA.

[50]  Alberto Valero-Gomez,et al.  Exploratory Analysis of Operator: Robot Ratio in Search and Rescue Missions , 2010, TA.

[51]  Alberto Valero-Gomez,et al.  Impact of Two Adjustable-Autonomy Models on the Scalability of Single-Human/Multiple-Robot Teams for Exploration Missions , 2011, Hum. Factors.

[52]  Prasanna Velagapudi,et al.  Scaling effects in multi-robot control , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  Gaurav S. Sukhatme,et al.  Emergent bucket brigading: a simple mechanisms for improving performance in multi-robot constrained-space foraging tasks , 2001, AGENTS '01.

[54]  Birsen Donmez,et al.  Modeling Workload Impact in Multiple Unmanned Vehicle Supervisory Control , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[55]  James Humann,et al.  Modeling and simulation of multi-UAV, multi-operator surveillance systems , 2018, 2018 Annual IEEE International Systems Conference (SysCon).