Multi-robot Scheduling and Path-Planning for Non-overlapping Operator Attention

There is a growing need for robots to perform complex tasks autonomously. However, there remain certain tasks that cannot - or should not - be completely automated. While these tasks may require one or several operators, we can oftentimes schedule when an operator should assist. We build on our previous work to present a methodology for allocating operator attention across multiple robots while attempting to minimize the execution time of the robots involved. In this paper, we: 1) Analyze of the complexity of this problem, 2) Provide a scalable methodology for designing robot policies so that few operators can oversee many robots, 3) Describe a methodology for designing both policies and robot trajectories to permit operators to assist many robots, and 4) Present simulation and hardware experiments demonstrating our methodologies.

[1]  Mary L. Cummings,et al.  Operator scheduling strategies in supervisory control of multiple UAVs , 2007 .

[2]  Steven M. LaValle,et al.  Optimal motion planning for multiple robots having independent goals , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[3]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[4]  Emilio Frazzoli,et al.  Incremental Sampling-based Algorithms for Optimal Motion Planning , 2010, Robotics: Science and Systems.

[5]  Lynne E. Parker,et al.  Multiple Mobile Robot Systems , 2008, Springer Handbook of Robotics.

[6]  Siddhartha S. Srinivasa,et al.  Effects of Robot Motion on Human-Robot Collaboration , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Andreas Krause,et al.  Robot navigation in dense human crowds: Statistical models and experimental studies of human–robot cooperation , 2015, Int. J. Robotics Res..

[8]  Alborz Geramifard,et al.  Cooperative Mission Planning for Multi-UAV Teams , 2015 .

[9]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[10]  Holly A. Yanco,et al.  Analysis of Human‐robot Interaction at the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[11]  M. Hagele,et al.  rob@work: Robot assistant in industrial environments , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[12]  Cynthia Breazeal,et al.  Improved human-robot team performance using Chaski, A human-inspired plan execution system , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[13]  Leonardo Bobadilla,et al.  Multi-robot Planning for Non-overlapping Operator Attention Allocation , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[14]  Thomas C. Hughes.  Human-Automation Coordination in Multi-UAV Control , 2008 .

[15]  Robin R. Murphy,et al.  Human-robot interaction in rescue robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[17]  J. Beardwood,et al.  The shortest path through many points , 1959, Mathematical Proceedings of the Cambridge Philosophical Society.

[18]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[19]  Yunfeng Zhang,et al.  Mission planning for heterogeneous tasks with heterogeneous UAVs , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[20]  Dmitry Berenson,et al.  No falls, no resets: Reliable humanoid behavior in the DARPA robotics challenge , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[21]  Jacob W. Crandall,et al.  Computing the Effects of Operator Attention Allocation in Human Control of Multiple Robots , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  Nicholas Roy,et al.  Assisted Teleoperation Strategies for Aggressively Controlling a Robot Arm with 2D Input , 2012 .

[23]  Sarvapali D. Ramchurn,et al.  A Study of Human-Agent Collaboration for Multi-UAV Task Allocation in Dynamic Environments , 2015, IJCAI.

[24]  Christopher G. Atkeson,et al.  Human‐in‐the‐loop Control of a Humanoid Robot for Disaster Response: A Report from the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[25]  Kris K. Hauser,et al.  Minimum Constraint Displacement Motion Planning , 2013, Robotics: Science and Systems.

[26]  Stefanos Nikolaidis,et al.  Optimization of Temporal Dynamics for Adaptive Human-Robot Interaction in Assembly Manufacturing , 2012, Robotics: Science and Systems.

[27]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..