A novel testbed for investigating the impact of teleoperator dynamics on perceived environment dynamics

Human-in-the-loop telerobotic systems (HiLTS) are robotic tools designed to extend and in some circumstances improve the dexterous capabilities of the human operator in virtual and remote environments. Dexterous manipulation, however, depends on how well the telerobot is incorporated into the operator’s sensorimotor control scheme. Empirical evidence suggests that haptic feedback can lead to improved dexterity. Unfortunately, haptic feedback can also introduce dynamics between the leader and follower of the telerobot that affect both stability and device performance. While concerted research effort has focused on masking these device dynamics or bypassing them altogether, it is not well understood how human operators incorporate these dynamics into their control scheme. We believe that to advance dexterous telerobotic manipulation, it is crucial to understand the process by which human operators incorporate teleoperator dynamics and distinguish them from the dynamics of the environment. Key to this knowledge is an understanding of how advanced telerobotic architectures compare to the gold standard, the rigid mechanical teleoperators first introduced in the 1950’s. In this manuscript, we present a teleoperator testbed that has reconfigurable transmissions between the leader and follower to change its dynamic behavior. The intent of this testbed is to investigate the effect of the teleoperator’s dynamics on perception of and task performance in the remote/virtual environment. We describe the hardware and software components of the testbed and then demonstrate how the different teleoperator transmissions can lead to differences, sometimes significant, in the dynamics that would be felt by the operator when exploring the same environment.

[1]  Claudio Pacchierotti,et al.  Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery , 2016, IEEE Transactions on Biomedical Engineering.

[2]  Dario Farina,et al.  The clinical relevance of advanced artificial feedback in the control of a multi-functional myoelectric prosthesis , 2018, Journal of NeuroEngineering and Rehabilitation.

[3]  Allison M. Okamura,et al.  Closed-loop stiffness and damping accuracy of impedance-type haptic displays , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[4]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[5]  Blake Hannaford,et al.  Stable haptic interaction with virtual environments , 1999, IEEE Trans. Robotics Autom..

[6]  I. Hunter,et al.  A perceptual analysis of stiffness , 2004, Experimental Brain Research.

[7]  A. Maravita,et al.  Tools for the body (schema) , 2004, Trends in Cognitive Sciences.

[8]  Jonathon W. Sensinger,et al.  A Review of Sensory Feedback in Upper-Limb Prostheses From the Perspective of Human Motor Control , 2020, Frontiers in Neuroscience.

[9]  A. Okamura,et al.  Effects of robotic manipulators on movements of novices and surgeons , 2014, Surgical Endoscopy.

[10]  R. Brent Gillespie,et al.  Non-Colocated Kinesthetic Display Limits Compliance Discrimination in the Absence of Terminal Force Cues , 2016, IEEE Transactions on Haptics.

[11]  Neville Hogan,et al.  Controlling impedance at the man/machine interface , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[12]  A Farnè,et al.  Dynamic size‐change of hand peripersonal space following tool use , 2000, Neuroreport.

[13]  Septimiu E. Salcudean,et al.  Analysis of Control Architectures for Teleoperation Systems with Impedance/Admittance Master and Slave Manipulators , 2001, Int. J. Robotics Res..

[14]  Allison M. Okamura,et al.  Effects of position quantization and sampling rate on virtual-wall passivity , 2005, IEEE Transactions on Robotics.

[15]  Katherine J. Kuchenbecker,et al.  A wrist-squeezing force-feedback system for robotic surgery training , 2017, 2017 IEEE World Haptics Conference (WHC).

[16]  Ming Zhu,et al.  Transparent Bilateral Teleoperation under Position and Rate Control , 2000, Int. J. Robotics Res..

[17]  R. C. Goertz,et al.  MECHANICAL MASTER-SLAVE MANIPULATOR , 1954 .

[18]  Thierry Keller,et al.  Short- and Long-Term Learning of Feedforward Control of a Myoelectric Prosthesis with Sensory Feedback by Amputees , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Allison M. Okamura,et al.  Uncontrolled Manifold Analysis of Arm Joint Angle Variability During Robotic Teleoperation and Freehand Movement of Surgeons and Novices , 2014, IEEE Transactions on Biomedical Engineering.

[20]  M. Tanaka,et al.  Coding of modified body schema during tool use by macaque postcentral neurones. , 1996, Neuroreport.

[21]  Claudio Pacchierotti,et al.  Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems , 2015, Int. J. Robotics Res..

[22]  Allison M. Okamura,et al.  Rendered and Characterized Closed-Loop Accuracy of Impedance-Type Haptic Displays , 2015, IEEE Transactions on Haptics.

[23]  Jeremy D. Brown,et al.  Comparison of vibrotactile and joint-torque feedback in a myoelectric upper-limb prosthesis , 2019 .

[24]  Jeremy D. Brown,et al.  Prefatory study of the effects of exploration dynamics on stiffness perception* , 2020, 2020 IEEE Haptics Symposium (HAPTICS).