Comparing Alternate Modes of Teleoperation for Constrained Tasks

Teleoperation of heavy machinery in industry often requires operators to be in close proximity to the plant and issue commands on a per-actuator level using multiple joystick input devices. However, this is non-intuitive and makes achieving desired job properties a challenging task requiring operators to complete costly and extensive training. Despite this, operator fatigue is common with implications for personal safety, project timeliness, cost, and job quality. While full automation is not yet achievable due to unpredictability and the dynamic nature of the environment and task, shared control paradigms allow operators to issue high-level commands in an intuitive, task-informed control space while having the robot optimize for achieving desired job properties.In this paper, we compare a number of modes of teleoperation, exploring both the number of dimensions of the control input as well as the most intuitive control spaces. Our experimental evaluations of the performance metrics were based on quantifying the difficulty of tasks based on the well known Fitts’ law as well as a measure of how well constraints affecting the task performance were met. Our experiments show that higher performance is achieved when humans submit commands in low-dimensional task spaces as opposed to joint space manipulations.

[1]  Leila Takayama,et al.  Strategies for human-in-the-loop robotic grasping , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[2]  Paolo Robuffo Giordano,et al.  A visual-based shared control architecture for remote telemanipulation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Yiming Yang,et al.  Robust shared autonomy for mobile manipulation with continuous scene monitoring , 2017, 2017 13th IEEE Conference on Automation Science and Engineering (CASE).

[4]  E. R. Crossman,et al.  Feedback Control of Hand-Movement and Fitts' Law , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[5]  G. Sung,et al.  Robotic laparoscopic surgery: a comparison of the DA Vinci and Zeus systems. , 2001, Urology.

[6]  Oussama Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Autonomous Robot Vehicles.

[7]  Pierre-Brice Wieber,et al.  Hierarchical quadratic programming: Fast online humanoid-robot motion generation , 2014, Int. J. Robotics Res..

[8]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[9]  Toshiyuki Inagaki,et al.  Adaptive Automation: Sharing and Trading of Control , 2001 .

[10]  Marcel Honegger,et al.  Redundancy resolution of a Cartesian space operated heavy industrial manipulator , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[11]  Yifan Chen,et al.  Automated robot trajectory planning for spray painting of free-form surfaces in automotive manufacturing , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[12]  Leopoldo Armesto,et al.  Constraint-aware learning of policies by demonstration , 2018, Int. J. Robotics Res..

[13]  G. Girmscheid,et al.  Fully Automated Shotcrete Robot for Rock Support , 2001 .

[14]  Louis B. Rosenberg,et al.  Virtual fixtures: Perceptual tools for telerobotic manipulation , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[15]  Claude E. Shannon,et al.  The Mathematical Theory of Communication , 1950 .

[16]  Gerd Hirzinger,et al.  Toward understanding the effects of visual- and force-feedback on robotic hand grasping performance for space teleoperation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Siddhartha S. Srinivasa,et al.  Formalizing Assistive Teleoperation , 2012, Robotics: Science and Systems.

[18]  Máximo A. Roa,et al.  Flexible, semi-autonomous grasping for assistive robotics , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Abigail Sellen,et al.  A comparison of input devices in element pointing and dragging tasks , 1991, CHI.

[20]  Sarah A. Douglas,et al.  Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard , 1999, CHI '99.

[21]  Gerhard Neumann,et al.  A learning-based shared control architecture for interactive task execution , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Zhao Wang,et al.  How Autonomy Impacts Performance and Satisfaction: Results From a Study With Spinal Cord Injured Subjects Using an Assistive Robot , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Kris K. Hauser,et al.  Assisted Teleoperation Strategies for Aggressively Controlling a Robot Arm with 2D Input , 2011, Robotics: Science and Systems.

[24]  Michael A. Goodrich,et al.  Characterizing efficiency of human robot interaction: a case study of shared-control teleoperation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[26]  Howard Jay Chizeck,et al.  Forbidden-region virtual fixtures from streaming point clouds: Remotely touching and protecting a beating heart , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Yiming Yang,et al.  EXOTica: An Extensible Optimization Toolset for Prototyping and Benchmarking Motion Planning and Control , 2018, Studies in Computational Intelligence.

[28]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[29]  Mikel Sagardia,et al.  A platform for bimanual virtual assembly training with haptic feedback in large multi-object environments , 2016, VRST.

[30]  Siddhartha S. Srinivasa,et al.  CHOMP: Covariant Hamiltonian optimization for motion planning , 2013, Int. J. Robotics Res..

[31]  Blake Hannaford,et al.  Forbidden region virtual fixtures from streaming point clouds , 2014, Adv. Robotics.

[32]  Siddhartha S. Srinivasa,et al.  A policy-blending formalism for shared control , 2013, Int. J. Robotics Res..

[33]  Robin R. Murphy,et al.  Use of remotely operated marine vehicles at Minamisanriku and Rikuzentakata Japan for disaster recovery , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.