A Blended Human-Robot Shared Control Framework to Handle Drift and Latency

Maximizing the utility of human-robot teams in disaster response and search and rescue (SAR) missions remains to be a challenging problem. This is mainly due to the dynamic, uncertain nature of the environment and the variability in cognitive performance of the human operators. By having an autonomous agent share control with the operator, we can achieve near-optimal performance by augmenting the operator's input and compensate for the factors resulting in degraded performance. What this solution does not consider though is the latency in human input and errors caused by potential hardware failures that can occur during task completion with safety, security and rescue robots. In this paper, we propose the use of blended shared control (BSC) architecture to address these issues and investigate the architecture's performance in constrained, dynamic environments with a differential drive robot that has input latency and drift caused by erroneous odometry feedback. We conduct a validation study (n=12) for our control architecture and then a user study (n=14) in 2 different environments that are unknown to both the human operator and the autonomous agent. The results demonstrate that the BSC architecture prevents collisions and enhance team performance without the need of a complete transfer of control between the human operator and autonomous agent.

[1]  Dmitry Berenson,et al.  Team WPI-CMU: Achieving Reliable Humanoid Behavior in the DARPA Robotics Challenge , 2017, J. Field Robotics.

[2]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[3]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[4]  Samad Hayati,et al.  Design and implementation of a robot control system with traded and shared control capability , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[5]  Gerard Lacey,et al.  Context-Aware Shared Control of a Robot Mobility Aid for the Elderly Blind , 2000, Int. J. Robotics Res..

[6]  Adam Acar,et al.  Twitter for crisis communication: lessons learned from Japan's tsunami disaster , 2011, Int. J. Web Based Communities.

[7]  Goldie Nejat,et al.  A hierarchical reinforcement learning based control architecture for semi-autonomous rescue robots in cluttered environments , 2010, 2010 IEEE International Conference on Automation Science and Engineering.

[8]  Todd D. Murphey,et al.  Learning Models for Shared Control of Human-Machine Systems with Unknown Dynamics , 2017, Robotics: Science and Systems.

[9]  Taskin Padir,et al.  A comparative study of teleoperated and autonomous task completion for sample return rover missions , 2014, 2014 IEEE Aerospace Conference.

[10]  Holly A. Yanco,et al.  "Where am I?" Acquiring situation awareness using a remote robot platform , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[11]  Holly A. Yanco,et al.  LASSOing HRI: Analyzing situation awareness in map-centric and video-centric interfaces , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[12]  Wayne Book,et al.  Blended Shared Control of Zermelo's navigation problem , 2010, Proceedings of the 2010 American Control Conference.

[13]  S. P. Levine,et al.  Adaptive shared control of a smart wheelchair operated by voice control , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[14]  Wolfram Burgard,et al.  The dynamic window approach to collision avoidance , 1997, IEEE Robotics Autom. Mag..

[15]  Anca D. Dragan,et al.  Shared Autonomy via Deep Reinforcement Learning , 2018, Robotics: Science and Systems.

[16]  Pradip Sheth,et al.  User intent in a shared control framework for pedestrian mobility aids , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[17]  Yael Edan,et al.  A Human-Robot Collaborative Reinforcement Learning Algorithm , 2010, J. Intell. Robotic Syst..

[18]  Matthew Derry,et al.  Using machine learning to blend human and robot controls for assisted wheelchair navigation , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[19]  Michael A. Goodrich,et al.  Characterizing efficiency of human robot interaction: a case study of shared-control teleoperation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  B. Argall,et al.  Human-in-the-Loop Optimization of Shared Autonomy in Assistive Robotics , 2017, IEEE Robotics and Automation Letters.

[21]  Taskin Padir,et al.  A shared control architecture for human-in-the-loop robotics applications , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[22]  Goldie Nejat,et al.  The search for survivors: Cooperative human-robot interaction in search and rescue environments using semi-autonomous robots , 2010, 2010 IEEE International Conference on Robotics and Automation.

[23]  Vijay Kumar,et al.  Robot and sensor networks for first responders , 2004, IEEE Pervasive Computing.

[24]  Holly A. Yanco,et al.  Analysis of Human‐robot Interaction at the DARPA Robotics Challenge Trials , 2015, J. Field Robotics.

[25]  Axel Krieger,et al.  A Confidence-Based Shared Control Strategy for the Smart Tissue Autonomous Robot (STAR) , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[26]  Robert J. Anderson,et al.  Autonomous, teleoperated, and shared control of robot systems , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[27]  Steven Dubowsky,et al.  An Adaptive Shared Control System for an Intelligent Mobility Aid for the Elderly , 2003, Auton. Robots.

[28]  Chunshi Guo,et al.  Predictive shared steering control for driver override in automated driving: A simulator study , 2018, Transportation Research Part F: Traffic Psychology and Behaviour.