Analysis of Joint and Hand Impedance During Teleoperation and Free-Hand Task Execution

Teleoperated robotic surgery allows filtering and scaling the hand motion to achieve high precision during the surgical interventions. Teleoperation represents a very complex sensory-motor task, mainly due to the kinematic and kinetic redundancies that characterize the human motor control. It requires an intensive training phase to acquire sufficient familiarity with the master–slave architecture. We estimated the hand stiffness modulation during the execution of a simulated suturing task in teleoperation, with two different master devices, and in free hand. Kinematic data of eight right-handed users were acquired, using electromagnetic and optical tracking systems, and analyzed using a musculoskeletal model. Through inverse dynamics, muscular activation was computed and used to obtain the joint torque and stiffness, leading to end-point stiffness estimation. The maximal stiffness value and its angular displacement with respect to the trajectory tangent were computed. The results show that there is a difference in how the main stiffness axis was modulated by using the two master devices with respect to free hand, with higher values and variability for the serial link manipulator. Moreover, a directional modulation of the hand stiffness through the trajectory was found, showing that the users were aligning the direction of the main stiffness axis perpendicularly to the trajectory.

[1]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .

[2]  Mitsuo Kawato,et al.  Human arm stiffness and equilibrium-point trajectory during multi-joint movement , 1997, Biological Cybernetics.

[3]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[4]  Nima Enayati,et al.  A dynamic non-energy-storing guidance constraint with motion redirection for robot-assisted surgery , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[6]  Paul L Gribble,et al.  Role of cocontraction in arm movement accuracy. , 2003, Journal of neurophysiology.

[7]  Mani Menon,et al.  Learning curve using robotic surgery , 2006, Current urology reports.

[8]  Tobias Ortmaier,et al.  Robot Assisted Force Feedback Surgery , 2007, Advances in Telerobotics.

[9]  E. Bizzi,et al.  The control of stable postures in the multijoint arm , 1996, Experimental Brain Research.

[10]  Anca Velisar,et al.  Benchmarking of dynamic simulation predictions in two software platforms using an upper limb musculoskeletal model , 2015, Computer methods in biomechanics and biomedical engineering.

[11]  Allison M. Okamura,et al.  The effect of a robot-assisted surgical system on the kinematics of user movements , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  E Burdet,et al.  A method for measuring endpoint stiffness during multi-joint arm movements. , 2000, Journal of biomechanics.

[13]  Garth H Ballantyne,et al.  The da Vinci telerobotic surgical system: the virtual operative field and telepresence surgery. , 2003, The Surgical clinics of North America.

[14]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[15]  D. Ostry,et al.  Learning to control arm stiffness under static conditions. , 2004, Journal of neurophysiology.

[16]  A. Okamura,et al.  Effects of robotic manipulators on movements of novices and surgeons , 2014, Surgical Endoscopy.

[17]  Giancarlo Ferrigno,et al.  Force feedback enhancement for soft tissue interaction tasks in cooperative robotic surgery , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[19]  G. Sjøgaard,et al.  Effect of speed and precision demands on human shoulder muscle electromyography during a repetitive task , 1998, European Journal of Applied Physiology and Occupational Physiology.

[20]  G Ferrigno,et al.  Enhanced torque‐based impedance control to assist brain targeting during open‐skull neurosurgery: a feasibility study , 2016, The international journal of medical robotics + computer assisted surgery : MRCAS.

[21]  S. Horgan,et al.  A prospective analysis of 211 robotic-assisted surgical procedures , 2003, Surgical Endoscopy And Other Interventional Techniques.

[22]  Nima Enayati,et al.  Haptics in Robot-Assisted Surgery: Challenges and Benefits , 2016, IEEE Reviews in Biomedical Engineering.

[23]  A. Lanfranco,et al.  Robotic Surgery: A Current Perspective , 2004, Annals of surgery.

[24]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[25]  Y. Koike,et al.  A myokinetic arm model for estimating joint torque and stiffness from EMG signals during maintained posture. , 2009, Journal of neurophysiology.

[26]  J. Lee,et al.  Baseline Laparoscopic Skill May Predict Baseline Robotic Skill and Early Robotic Surgery Learning Curve. , 2016, Journal of endourology.

[27]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  A. Darzi,et al.  Qualitative and quantitative analysis of the learning curve of a simulated surgical task on the da Vinci system , 2004, Surgical Endoscopy And Other Interventional Techniques.

[29]  Giancarlo Ferrigno,et al.  Adaptive Hands-On Control for Reaching and Targeting Tasks in Surgery , 2015 .

[30]  Fadi Dornaika,et al.  Hand-Eye Calibration , 1995, Int. J. Robotics Res..

[31]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.