Perceived mental workload and operator performance of dexterous manipulators under time delay with master-slave interfaces

Robotic manipulators that use joystick interfaces for telemanipulation take time and effort to master and lack an intuitive basis for human robot interaction. These factors can hamper operator performance, increase cognitive workload, and limit overall user effectiveness on highly dexterous tasks. Master-slave interfaces (MSIs) used in the fields of animatronics, telesurgery, and hazardous materials handling are intuitive and improve operator performance, but are limited because they typically operate in a controlled environment and lack robustness. When Master Slave (MS) controllers use forcefeedback errors can accumulate and create instabilities due to the synchronous bilateral communication between the remote and local systems. Instability can be mitigated and errors reduced in these systems by separating the bilateral communication into a dual-unilateral (DU) asynchronous communication. This research focused on comparing and analyzing current MSI controllers with a new DU control method that reduces or eliminates MSI issues such as latency, error, and information loss while providing the user with accurate forcefeedback capability and transparency during operation. It used a simulation-based approach to determine which selected MSI controllers provide users with robust control of dexterous manipulators under time delay. Users performed a variety of dexterous force-feedback tasks with different controllers and the study measured objective task performance and completion time success along with cognitive workload related to user perceived task interaction and mental demands through subjective ratings on the NASA (National Aeronautics and Space Administration) Task Load Index (TLX). The research findings will help to develop MSI controllers designed to provide operators robust and intuitive interfaces for low-level control of dexterous manipulators.

[1]  Linda R. Elliott,et al.  Research-Based Display Design Guidelines for Vehicle Crewman and Ground Warrior Interfaces, Which Enhance Situational Understanding and Decision Cycle Performance , 2007 .

[2]  Jean-Jacques E. Slotine,et al.  Using wave variables for system analysis and robot control , 1997, Proceedings of International Conference on Robotics and Automation.

[3]  Alexander Stoytchev,et al.  An Effective and Intuitive Control Interface for Remote Robot Teleoperation with Complete Haptic Feedback , 2008 .

[4]  Aishanou Osha Rait Teleoperation with Haptics , 2012 .

[5]  G. Niemeyer,et al.  High-frequency acceleration feedback in wave variable telerobotics , 2006, IEEE/ASME Transactions on Mechatronics.

[6]  Ying Zhang,et al.  Evaluation of Auditory and Visual Feedback on Task Performance in a Virtual Assembly Environment , 2006, PRESENCE: Teleoperators and Virtual Environments.

[7]  Tamas Haidegger,et al.  Surgical robotic support for long duration space missions , 2008 .

[8]  Günter Dieter Niemeyer,et al.  Using wave variables in time delayed force reflecting teleoperation , 1996 .

[9]  S Stefan Lichiardopol,et al.  A Survey on Teleoperation , 2007 .

[10]  Mahdi Tavakoli,et al.  Performance Analysis of a Haptic Telemanipulation Task under Time Delay , 2011, Adv. Robotics.

[11]  Matthew T. Mason,et al.  Robot Motion: Planning and Control , 1983 .

[12]  Tzyh Jong Tarn,et al.  Internet-based teleoperation , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Wayne J. Book,et al.  Control Techniques and Programming Issues for Time Delayed Internet Based Teleoperation , 2003 .

[14]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[15]  Mark W. Spong,et al.  Asymptotic Stability for Force Reflecting Teleoperators with Time Delay , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[16]  S. Hirche,et al.  Bilateral teleoperation over the internet: the time varying delay problem , 2003, Proceedings of the 2003 American Control Conference, 2003..

[17]  Susan J. Lederman,et al.  Virtual peg-in-hole performance using a 6-DOF magnetic levitation haptic device: comparison with real forces and with visual guidance alone , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[18]  Daniel J. Cannon An Evaluation and Analysis of Master Slave Controllers for Dexterous Manipulators under Time Delay and the Effects on Perceived Mental Workload and Task Performance , 2014 .

[19]  Mark W. Spong,et al.  Asymptotic Stability for Force Reflecting Teleoperators with Time Delay , 1992 .

[20]  David R. Scribner,et al.  The Effect of Stereoscopic and Wide Field of View Conditions on Teleoperator Performance , 1998 .