Task Dynamics of Prior Training Influence Visual Force Estimation Ability During Teleoperation

The lack of haptic feedback in teleoperation is a potential barrier to safe handling of soft materials, yet in Robot-assisted Minimally Invasive Surgery (RMIS), haptic feedback is often unavailable. Due to its availability in open and laparoscopic surgery, surgeons with such experience potentially possess learned models of tissue stiffness that might promote good force estimation abilities during RMIS. To test if prior haptic experience leads to improved force estimation ability in teleoperation, 33 naive participants were assigned to one of three training conditions: manual manipulation, teleoperation with force feedback, or teleoperation without force feedback, and learned to tension a silicone sample to a set of forces. They were then asked to perform the tension task, and a previously unencountered palpation task, to a different set of forces under teleoperation without force feedback. Compared to the teleoperation groups, the manual group had higher force error in the tension task outside the range of forces they had trained on, but showed better speed-accuracy functions in the palpation task at low force levels. This suggests that the dynamics of the training modality affect force estimation ability during teleoperation, with the prior haptic experience accessible if formed under the same dynamics as the task.

[1]  Amr I. Al Abbas,et al.  Robotic biotissue curriculum for teaching the robotic pancreatoduodenectomy , 2018 .

[2]  I. Gill,et al.  Face, content and construct validity of a novel robotic surgery simulator. , 2011, The Journal of urology.

[3]  Ilana Nisky,et al.  Surgeon-Centered Analysis of Robot-Assisted Needle Driving Under Different Force Feedback Conditions , 2020, Frontiers in Neurorobotics.

[4]  Ilana Nisky,et al.  Perception of Stiffness in Laparoscopy - the Fulcrum Effect , 2012, MMVR.

[5]  Jan Christian Albiez,et al.  Human Force Discrimination during Active Arm Motion for Force Feedback Design , 2013, IEEE Transactions on Haptics.

[6]  Ilana Nisky,et al.  The effect of force feedback delay on stiffness perception and grip force modulation during tool-mediated interaction with elastic force fields. , 2015, Journal of neurophysiology.

[7]  C. Michaels,et al.  Higher order and lower order variables in the visual perception of relative pulling force. , 1998, Journal of experimental psychology. Human perception and performance.

[8]  Melissa E. Hogg,et al.  Proficiency-based training and credentialing can improve patient outcomes and decrease cost to a hospital system. , 2019, American journal of surgery.

[9]  A. Meraney,et al.  da Vinci Skills Simulator construct validation study: correlation of prior robotic experience with overall score and time score simulator performance. , 2012, Urology.

[10]  Prokar Dasgupta,et al.  An over-view of robot assisted surgery curricula and the status of their validation. , 2015, International journal of surgery.

[11]  Joaquin A. Anguera,et al.  A spatial explicit strategy reduces error but interferes with sensorimotor adaptation. , 2011, Journal of neurophysiology.

[12]  Allison M. Okamura,et al.  Training in divergent and convergent force fields during 6-DOF teleoperation with a robot-assisted surgical system , 2017, 2017 IEEE World Haptics Conference (WHC).

[13]  P. White,et al.  The experience of force: the role of haptic experience of forces in visual perception of object motion and interactions, mental simulation, and motion-related judgments. , 2012, Psychological bulletin.

[14]  Marc O. Ernst,et al.  A Bayesian view on multimodal cue integration , 2006 .

[15]  Melissa E. Hogg,et al.  Evolution of a Novel Robotic Training Curriculum in a Complex General Surgical Oncology Fellowship , 2018, Annals of Surgical Oncology.

[16]  Max Berniker,et al.  Bayesian approaches to sensory integration for motor control. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[17]  Martin Buss,et al.  Combination and Integration in the Perception of Visual-Haptic Compliance Information , 2010, IEEE Transactions on Haptics.

[18]  Albert Jin Chung,et al.  Perception of Body Ownership Is Driven by Bayesian Sensory Inference , 2015, PloS one.

[19]  Christina T Fuentes,et al.  Where is your arm? Variations in proprioception across space and tasks. , 2010, Journal of neurophysiology.

[20]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[21]  Ashwin Sridhar,et al.  Learning Curves for Robotic Surgery: a Review of the Recent Literature , 2017, Current Urology Reports.

[22]  Amer H Zureikat,et al.  Robotic Pancreatoduodenectomy Biotissue Curriculum has Validity and Improves Technical Performance for Surgical Oncology Fellows. , 2017, Journal of surgical education.

[23]  Daniel M Wolpert,et al.  Bayesian integration in force estimation. , 2004, Journal of neurophysiology.

[24]  Luca Gasperini,et al.  The stiffness of living tissues and its implications for tissue engineering , 2020, Nature Reviews Materials.

[25]  John van der Kamp,et al.  Does implicit motor learning lead to greater automatization of motor skills compared to explicit motor learning? A systematic review , 2018, PloS one.

[26]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[27]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[28]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[29]  Hiroyuki Egi,et al.  Impact of laparoscopic experience on the proficiency gain of urologic surgeons in robot-assisted surgery. , 2012, Journal of endourology.

[30]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[31]  Lukas Kaim,et al.  Visual and haptic integration in the estimation of softness of deformable objects , 2013, i-Perception.

[32]  Firas Mawase,et al.  Adaptation to sequence force perturbation during vertical and horizontal reaching movement—averaging the past or predicting the future? , 2012, Front. Syst. Neurosci..

[33]  C. Reboulet,et al.  [Study of sustained forces and the working space of endoscopic surgery instruments]. , 1999, Annales de chirurgie.

[34]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[35]  Michael A Liss,et al.  Validation, correlation, and comparison of the da Vinci trainer(™) and the daVinci surgical skills simulator(™) using the Mimic(™) software for urologic robotic surgical education. , 2012, Journal of endourology.

[36]  Bing Wu,et al.  A Recursive Bayesian Updating Model of Haptic Stiffness Perception , 2018, Journal of experimental psychology. Human perception and performance.

[37]  Christopher R. Wagner,et al.  The Benefit of Force Feedback in Surgery: Examination of Blunt Dissection , 2007, PRESENCE: Teleoperators and Virtual Environments.

[38]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[39]  Marc O. Ernst,et al.  Computational Aspects of Softness Perception , 2014, Multisensory Softness.

[40]  Firas Mawase,et al.  Evidence for predictive control in lifting series of virtual objects , 2010, Experimental Brain Research.

[41]  G. Wulf Attentional focus and motor learning: a review of 15 years , 2013 .

[42]  Thomas J. Fahey,et al.  General surgery training and robotics: Are residents improving their skills? , 2014, Surgical Endoscopy.

[43]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[44]  Catherine E. Lewis,et al.  Tactile Feedback Induces Reduced Grasping Force in Robot-Assisted Surgery , 2009, IEEE Transactions on Haptics.

[45]  Rajnikant V. Patel,et al.  The Role of Direct and Visual Force Feedback in Suturing Using a 7-DOF Dual-Arm Teleoperated System , 2017, IEEE Transactions on Haptics.

[46]  A. Goh,et al.  Global evaluative assessment of robotic skills: validation of a clinical assessment tool to measure robotic surgical skills. , 2012, The Journal of urology.

[47]  R Plamondon,et al.  Speed/accuracy trade-offs in target-directed movements , 1997, Behavioral and Brain Sciences.

[48]  R S W Masters,et al.  Implicit Motor Learning and Complex Decision Making in Time-Constrained Environments , 2008, Journal of motor behavior.

[49]  E. Lockrow,et al.  Survey of robotic surgery training in obstetrics and gynecology residency. , 2011, Journal of minimally invasive gynecology.

[50]  C. Shea,et al.  Enhancing motor learning through external-focus instructions and feedback , 1999 .

[51]  Leandro Totti Cavazzola,et al.  Does Previous Laparoscopic Experience Influence Basic Robotic Surgical Skills? , 2017, Journal of surgical education.

[52]  J. Krakauer,et al.  Explicit and Implicit Contributions to Learning in a Sensorimotor Adaptation Task , 2014, The Journal of Neuroscience.

[53]  Bing Wu,et al.  Visual-Haptic Compliance Perception , 2014, Multisensory Softness.

[54]  A. Okamura,et al.  Effects of robotic manipulators on movements of novices and surgeons , 2014, Surgical Endoscopy.

[55]  Laura Drudi,et al.  Validation of the da Vinci Surgical Skill Simulator across three surgical disciplines: A pilot study. , 2013, Canadian Urological Association journal = Journal de l'Association des urologues du Canada.

[56]  Jae Won Shin,et al.  Impact of laparoscopic experience on virtual robotic simulator dexterity , 2015, Journal of minimal access surgery.

[57]  J van der Kamp,et al.  External attentional focus enhances movement automatization: a comprehensive test of the constrained action hypothesis. , 2013, Human movement science.