Motion Mappings for Continuous Bilateral Teleoperation

Mapping operator motions to a robot is a key problem in teleoperation. Due to differences between workspaces, such as object locations, it is particularly challenging to derive smooth motion mappings that fulfill different goals (e.g. picking objects with different poses on the two sides or passing through key points). Indeed, most state-of-the-art methods rely on mode switches, leading to a discontinuous, low-transparency experience. In this paper, we propose a unified formulation for position, orientation and velocity mappings based on the poses of objects of interest in the operator and robot workspaces. We apply it in the context of bilateral teleoperation. Two possible implementations to achieve the proposed mappings are studied: an iterative approach based on locally-weighted translations and rotations, and a neural network approach. Evaluations are conducted both in simulation and using two torque-controlled Franka Emika Panda robots. Our results show that, despite longer training times, the neural network approach provides faster mapping evaluations and lower interaction forces for the operator, which are crucial for continuous, real-time teleoperation.

[1]  Ming Zhu,et al.  Transparent Bilateral Teleoperation under Position and Rate Control , 2000, Int. J. Robotics Res..

[2]  Yan Wang,et al.  Haptic based teleoperation with master-slave motion mapping and haptic rendering for space exploration , 2019, Chinese Journal of Aeronautics.

[3]  Frans C. T. van der Helm,et al.  A Task-Specific Analysis of the Benefit of Haptic Shared Control During Telemanipulation , 2013, IEEE Transactions on Haptics.

[4]  野間 春生,et al.  Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 参加報告 , 1997 .

[5]  Jan Peters,et al.  Reinforcement Learning of Trajectory Distributions: Applications in Assisted Teleoperation and Motion Planning , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Ivan Kobyzev,et al.  Normalizing Flows: An Introduction and Review of Current Methods , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Gerd Hirzinger,et al.  Toward understanding the effects of visual- and force-feedback on robotic hand grasping performance for space teleoperation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[9]  Yuru Zhang,et al.  A modified motion mapping method for haptic device based space teleoperation , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Ahmed A. Ramadan,et al.  Evaluation of a Proposed Workspace Spanning Technique for Small Haptic Device Based Manipulator Teleoperation , 2012, ICIRA.

[11]  Sylvain Calinon,et al.  Programming by Demonstration for Shared Control With an Application in Teleoperation , 2018, IEEE Robotics and Automation Letters.

[12]  Darwin G. Caldwell,et al.  An Approach for Imitation Learning on Riemannian Manifolds , 2017, IEEE Robotics and Automation Letters.

[13]  Han Ding,et al.  A Data-Driven Motion Mapping Method for Space Teleoperation of Kinematically Dissimilar Master/Slave Robots , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[14]  Allison M. Okamura,et al.  Haptic Virtual Fixtures for Robot-Assisted Manipulation , 2005, ISRR.

[15]  Hisato Kobayashi,et al.  A scaled teleoperation , 1992, [1992] Proceedings IEEE International Workshop on Robot and Human Communication.

[16]  Freek Stulp,et al.  Co-manipulation with multiple probabilistic virtual guides , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Jong Hyeon Park,et al.  Stable bilateral teleoperation under a time delay using a robust impedance control , 2005 .

[18]  Samy Bengio,et al.  Density estimation using Real NVP , 2016, ICLR.

[19]  Robin R. Murphy,et al.  Use of remotely operated marine vehicles at Minamisanriku and Rikuzentakata Japan for disaster recovery , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[20]  Nicolas Perrin,et al.  Fast diffeomorphic matching to learn globally asymptotically stable nonlinear dynamical systems , 2016, Syst. Control. Lett..

[21]  Oussama Khatib,et al.  Spanning large workspaces using small haptic devices , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.