Haptic-Guided Teleoperation of a 7-DoF Collaborative Robot Arm With an Identical Twin Master

In this article, we describe two techniques to enable haptic-guided teleoperation using 7-DoF cobot arms as master and slave devices. A shortcoming of using cobots as master-slave systems is the lack of force feedback at the master side. However, recent developments in cobot technologies have brought in affordable, flexible, and safe torque-controlled robot arms, which can be programmed to generate force feedback to mimic the operation of a haptic device. In this article, we use two Franka Emika Panda robot arms as a twin master-slave system to enable haptic-guided teleoperation. We propose a two layer mechanism to implement force feedback due to 1) object interactions in the slave workspace, and 2) virtual forces, e.g. those that can repel from static obstacles in the remote environment or provide task-related guidance forces. We present two different approaches for force rendering and conduct an experimental study to evaluate the performance and usability of these approaches in comparison to teleoperation without haptic guidance. Our results indicate that the proposed joint torque coupling method for rendering task forces improves energy requirements during haptic guided telemanipulation, providing realistic force feedback by accurately matching the slave torque readings at the master side.

[1]  Paola Reissig,et al.  Motor planning and execution in left- and right-handed individuals during a bimanual grasping and placing task. , 2011, Acta psychologica.

[2]  Richard A. Schmidt,et al.  Frequent Augmented Feedback Can Degrade Learning: Evidence and Interpretations , 1991 .

[3]  Seungmoon Choi,et al.  Effects of haptic guidance and disturbance on motor learning: Potential advantage of haptic disturbance , 2010, 2010 IEEE Haptics Symposium.

[4]  Claudio Pacchierotti,et al.  A Haptic Shared-Control Architecture for Guided Multi-Target Robotic Grasping , 2020, IEEE Transactions on Haptics.

[5]  Mark Mulder,et al.  A Topology of Shared Control Systems—Finding Common Ground in Diversity , 2018, IEEE Transactions on Human-Machine Systems.

[6]  Abhishek Gupta,et al.  Shared Control in Haptic Systems for Performance Enhancement and Training , 2006 .

[7]  Siddhartha S. Srinivasa,et al.  A policy-blending formalism for shared control , 2013, Int. J. Robotics Res..

[8]  Louis B. Rosenberg,et al.  Virtual fixtures: Perceptual tools for telerobotic manipulation , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[9]  Mark Mulder,et al.  Haptic shared control: smoothly shifting control authority? , 2012, Cognition, Technology & Work.

[10]  Blake Hannaford,et al.  Stable haptic interaction with virtual environments , 1999, IEEE Trans. Robotics Autom..

[11]  Matteo Bianchi,et al.  Spatially Separating Haptic Guidance From Task Dynamics Through Wearable Devices , 2019, IEEE Transactions on Haptics.

[12]  Marcia Kilchenman O'Malley,et al.  Progressive haptic and visual guidance for training in a virtual dynamic task , 2010, 2010 IEEE Haptics Symposium.

[13]  Keng Peng Tee,et al.  Continuous Role Adaptation for Human–Robot Shared Control , 2015, IEEE Transactions on Robotics.

[14]  D.J. Reinkensmeyer,et al.  Effect of robotic guidance on motor learning of a timing task , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[15]  Cagatay Basdogan,et al.  Improving Human-Computer Cooperation Through Haptic Role Exchange and Negotiation , 2012, Immersive Multimodal Interactive Presence.

[16]  Gregory D. Hager,et al.  Spatial motion constraints: theory and demonstrations for robot guidance using virtual fixtures , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[17]  Edoardo Battaglia,et al.  A Review of Intent Detection, Arbitration, and Communication Aspects of Shared Control for Physical Human-Robot Interaction , 2018 .

[18]  Christian Ott,et al.  Humanoid Teleoperation Using Task-Relevant Haptic Feedback , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Darwin G. Caldwell,et al.  Enhancing bilateral teleoperation using camera-based online virtual fixtures generation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  Tsuneo Yoshikawa,et al.  Bilateral control of master-slave manipulators for ideal kinesthetic coupling-formulation and experiment , 1994, IEEE Trans. Robotics Autom..

[21]  Dongjun Lee,et al.  Improving transparency of virtual coupling for haptic interaction with human force observer , 2017, Robotica.

[22]  Karon E. MacLean,et al.  Predictive haptic guidance: intelligent user assistance for the control of dynamic tasks , 2006, IEEE Transactions on Visualization and Computer Graphics.

[23]  Paolo Robuffo Giordano,et al.  Human-in-the-loop optimisation: Mixed initiative grasping for optimally facilitating post-grasp manipulative actions , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[25]  Blake Hannaford,et al.  Experimental Internet Haptic Collaboration using Virtual Coupling Schemes , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[26]  Cagatay Basdogan,et al.  The role of roles: Physical cooperation between humans and robots , 2012, Int. J. Robotics Res..

[27]  Derek W. Seward,et al.  The use of robotics and automation in nuclear decommissioning. , 2005 .

[28]  Claudio Pacchierotti,et al.  Haptic-Based Shared-Control Methods for a Dual-Arm System , 2018, IEEE Robotics and Automation Letters.

[29]  Cagatay Basdogan,et al.  Intention Recognition for Dynamic Role Exchange in Haptic Collaboration , 2013, IEEE Transactions on Haptics.

[30]  Bin Zheng,et al.  Assembling virtual fixtures for guidance in training environments , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[31]  Claudio Pacchierotti,et al.  Haptic Shared-Control Methods for Robotic Cutting under Nonholonomic Constraints , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[32]  Cagatay Basdogan,et al.  Haptic negotiation and role exchange for collaboration in virtual environments , 2010, 2010 IEEE Haptics Symposium.

[33]  Marcia Kilchenman O'Malley,et al.  Efficacy of shared-control guidance paradigms for robot-mediated training , 2011, 2011 IEEE World Haptics Conference.

[34]  Michael Panzirsch,et al.  Cartesian task allocation for cooperative, multilateral teleoperation under time delay , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Yiannis Demiris,et al.  Learning Shared Control by Demonstration for Personalized Wheelchair Assistance , 2018, IEEE Transactions on Haptics.