Assisted Telemanipulation: A Stack-Of-Tasks Approach to Remote Manipulator Control

This article presents an approach for assisted teleoperation of a robot arm, formulated within a real-time stack-of-tasks (SoT)whole-body motion control framework. The approach leverages the hierarchical nature of the SoT framework to integrate operator commands with assistive tasks, such as joint limit and obstacle avoidance or automatic gripper alignment. Thereby some aspects of the teleoperation problem are delegated to the controller and carried out autonomously. The key contributions of this work are two-fold: the first is a method for unobtrusive integration of autonomy in a telemanip-ulation system; and the second is a user study evaluation of the proposed system in the context of teleoperated pick-and-place tasks. The proposed approach of assistive control was found to result in higher grasp success rates and shorter trajectories than achieved through manual control, without incurring additional cognitive load to the operator.

[1]  Sven Behnke,et al.  Intuitive bimanual telemanipulation under communication restrictions by immersive 3D visualization and motion tracking , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[2]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[3]  Darius Burschka,et al.  A pilot study in vision-based augmented telemanipulation for remote assembly over high-latency networks , 2013, 2013 IEEE International Conference on Robotics and Automation.

[4]  Pierre-Brice Wieber,et al.  Hierarchical quadratic programming: Fast online humanoid-robot motion generation , 2014, Int. J. Robotics Res..

[5]  Todor Stoyanov,et al.  Grasp envelopes: Extracting constraints on gripper postures from online reconstructed 3D models , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[7]  Frank L. Lewis,et al.  Robot Manipulator Control: Theory and Practice , 2003 .

[8]  Bernhard Weber,et al.  Assistance for telepresence using online grasp planning , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[9]  Pierre-Brice Wieber,et al.  Kinematic Control of Redundant Manipulators: Generalizing the Task-Priority Framework to Inequality Task , 2011, IEEE Transactions on Robotics.

[10]  Daniela Rus,et al.  Baxter's Homunculus: Virtual Reality Spaces for Teleoperation in Manufacturing , 2017, IEEE Robotics and Automation Letters.

[11]  Vinicio Tincani,et al.  The Next Step in Robot Commissioning: Autonomous Picking and Palletizing , 2016, IEEE Robotics and Automation Letters.

[12]  Martial Hebert,et al.  Autonomy Infused Teleoperation with Application to BCI Manipulation , 2015, Robotics: Science and Systems.

[13]  Siddhartha S. Srinivasa,et al.  Benchmarking in Manipulation Research: Using the Yale-CMU-Berkeley Object and Model Set , 2015, IEEE Robotics & Automation Magazine.

[14]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[15]  Long Cheng,et al.  Shared control for teleoperation enhanced by autonomous obstacle avoidance of robot manipulator , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).