Joint-level force sensing for indirect hybrid force/position control of continuum robots with friction

Continuum robots offer the dexterity and obstacle circumvention capabilities necessary to enable surgery in deep surgical sites. They also can enable joint-level ex situ force sensing (JEFS), which provides an estimate of end-effector wrenches given joint-level forces. Prior works on JEFS relied on a restrictive embodiment with minimal actuation line friction and captured model and frictional actuation transmission uncertainties using a configuration space formulation. In this work, we overcome these limitations. First, frictional losses are canceled using a feed-forward term based on support vector regression in joint space. Then, regression maps and their interpolation are used to account for actuation hysteresis. The residual joint-force error is then further minimized using a least-squares model parameter update. An indirect hybrid force/position controller using JEFS is presented with evaluation carried out on a realistic pre-clinically deployable insertable robotic effectors platform (IREP) for single-port access surgery. Automated mock force-controlled ablation, exploration, and knot tightening are evaluated. A user study involving the daVinci Research Kit surgeon console and the IREP as a surgical slave was carried out to compare the performance of users with and without force feedback based on JEFS for force-controlled ablation and knot tightening. Results in automated experiments and a user study of telemanipulated experiments suggest that intrinsic force-sensing can achieve levels of force uncertainty and force regulation errors of the order of 0.2 N. Using JEFS and automated task execution, repeatability, and force regulation accuracy is shown to be comparable to using a commercial force sensor for human-in-the-loop feedback.

[1]  B. Azzerboni,et al.  A simplified model for vector hysteresis computation , 2006, IEEE Transactions on Magnetics.

[2]  Claudio Pacchierotti,et al.  Cutaneous Feedback of Fingertip Deformation and Vibration for Palpation in Robotic Surgery , 2016, IEEE Transactions on Biomedical Engineering.

[3]  Long Wang,et al.  Using continuum robots for force-controlled semi autonomous organ exploration and registration , 2018, 2018 International Symposium on Medical Robotics (ISMR).

[4]  G.S. Fischer,et al.  Ischemia and Force Sensing Surgical Instruments for Augmenting Available Surgeon Information , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[5]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Kaspar Althoefer,et al.  Catheter contact force estimation from shape detection using a real-time Cosserat rod model , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Kai Xu,et al.  An Investigation of the Intrinsic Force Sensing Capabilities of Continuum Robots , 2008, IEEE Transactions on Robotics.

[8]  D. Caleb Rucker,et al.  Deflection-based force sensing for continuum robots: A probabilistic approach , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Rajnikant V. Patel,et al.  Estimating contact force for steerable ablation catheters based on shape analysis , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Sarthak Misra,et al.  Force sensing in continuum manipulators using fiber Bragg grating sensors , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Arif Kazi,et al.  Operator Performance in Surgical Telemanipulation , 2001, Presence: Teleoperators & Virtual Environments.

[12]  Pierre E. Dupont,et al.  Stiffness Control of Surgical Continuum Manipulators , 2011, IEEE Transactions on Robotics.

[13]  Farrokh Janabi-Sharifi,et al.  Model-Based Force Estimation for Intracardiac Catheters , 2016, IEEE/ASME Transactions on Mechatronics.

[14]  D. Yuh,et al.  Application of haptic feedback to robotic surgery. , 2004, Journal of laparoendoscopic & advanced surgical techniques. Part A.

[15]  Peter Kazanzides,et al.  Design and Integration of a Telerobotic System for Minimally Invasive Surgery of the Throat , 2009, Int. J. Robotics Res..

[16]  Robert D. Howe,et al.  Robotic catheter cardiac ablation combining ultrasound guidance and force control , 2014, Int. J. Robotics Res..

[17]  Jinwoo Jung,et al.  A modeling approach for continuum robotic manipulators: Effects of nonlinear internal device friction , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[19]  Mariangela Manti,et al.  Multiobjective Optimization for Stiffness and Position Control in a Soft Robot Arm Module , 2018, IEEE Robotics and Automation Letters.

[20]  Peter K. Allen,et al.  Design and Coordination Kinematics of an Insertable Robotic Effectors Platform for Single-Port Access Surgery , 2013, IEEE/ASME Transactions on Mechatronics.

[21]  Robert J. Webster,et al.  Design and Kinematic Modeling of Constant Curvature Continuum Robots: A Review , 2010, Int. J. Robotics Res..

[22]  Kaspar Althoefer,et al.  New kinematic multi-section model for catheter contact force estimation and steering , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Rajarshi Roy,et al.  Modeling and Estimation of Friction, Extension, and Coupling Effects in Multisegment Continuum Robots , 2017, IEEE/ASME Transactions on Mechatronics.

[24]  Andrew L. Orekhov,et al.  Snake-Like Robots for Minimally Invasive, Single Port, and Intraluminal Surgeries , 2018, The Encyclopedia of Medical Robotics.

[25]  Christopher R. Wagner,et al.  The role of force feedback in surgery: analysis of blunt dissection , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[26]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[27]  Kai Xu,et al.  Intrinsic Wrench Estimation and Its Performance Index for Multisegment Continuum Robots , 2010, IEEE Transactions on Robotics.

[28]  Rajarshi Roy,et al.  Investigation of effects of dynamics on intrinsic wrench sensing in continuum robots , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Blake Hannaford,et al.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills , 2001, IEEE Transactions on Biomedical Engineering.

[30]  Long Wang,et al.  Integration and preliminary evaluation of an Insertable Robotic Effectors Platform for Single Port Access Surgery , 2012, 2012 IEEE International Conference on Robotics and Automation.

[31]  F. Preisach Über die magnetische Nachwirkung , 1935 .

[32]  Oussama Khatib,et al.  A General Contact Model for Dynamically-Decoupled Force/Motion , 1997, ISER.

[33]  Kai Xu,et al.  Actuation compensation for flexible surgical snake-like robots with redundant remote actuation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[34]  Howie Choset,et al.  Continuum Robots for Medical Applications: A Survey , 2015, IEEE Transactions on Robotics.

[35]  Michael R. Zinn,et al.  Tackling friction - an analytical modeling approach to understanding friction in single tendon driven continuum manipulators , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Andrea Natale,et al.  Relationship Between Catheter Forces, Lesion Characteristics, “Popping,” and Char Formation: Experience with Robotic Navigation System , 2009, Journal of cardiovascular electrophysiology.

[37]  Nabil Simaan,et al.  Compliant Motion Control for Multisegment Continuum Robots With Actuation Force Sensing , 2014, IEEE Transactions on Robotics.

[38]  Russell H. Taylor,et al.  A dexterous system for laryngeal surgery , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[39]  Ana Luisa Trejos,et al.  Force sensing and its application in minimally invasive surgery and therapy: A survey , 2010 .

[40]  Rajnikant V. Patel,et al.  Modeling and Estimation of Tip Contact Force for Steerable Ablation Catheters , 2015, IEEE Transactions on Biomedical Engineering.

[41]  Rajiv V. Dubey,et al.  A weighted least-norm solution based scheme for avoiding joint limits for redundant joint manipulators , 1993, IEEE Trans. Robotics Autom..

[42]  Nabil Simaan,et al.  Hybrid motion/force control of multi-backbone continuum robots , 2016, Int. J. Robotics Res..

[43]  Allison M. Okamura,et al.  Analysis of Suture Manipulation Forces for Teleoperation with Force Feedback , 2002, MICCAI.

[44]  Nabil Simaan,et al.  Snake-Like Units Using Flexible Backbones and Actuation Redundancy for Enhanced Miniaturization , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[45]  Yoshihiko Nakamura,et al.  Inverse kinematic solutions with singularity robustness for robot manipulator control , 1986 .

[46]  D. Yuh,et al.  Effect of sensory substitution on suture-manipulation forces for robotic surgical systems. , 2005, The Journal of thoracic and cardiovascular surgery.

[47]  A. García-Ruiz,et al.  Manual vs robotically assisted laparoscopic surgery in the performance of basic manipulation and suturing tasks. , 1998, Archives of surgery.

[48]  Xiaobo Tan,et al.  Modeling and inverse compensation of hysteresis in vanadium dioxide using an extended generalized Prandtl-Ishlinskii model , 2014 .

[49]  Michael C. Yip,et al.  Three-dimensional hysteresis compensation enhances accuracy of robotic artificial muscles , 2018 .

[50]  Robert J. Webster,et al.  Mechanics of Precurved-Tube Continuum Robots , 2009, IEEE Transactions on Robotics.

[51]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Theodoros N. Arvanitis,et al.  Objective surgical performance evaluation based on haptic feedback. , 2002, Studies in health technology and informatics.

[53]  Nima Enayati,et al.  Haptics in Robot-Assisted Surgery: Challenges and Benefits , 2016, IEEE Reviews in Biomedical Engineering.

[54]  A. Okamura Haptic feedback in robot-assisted minimally invasive surgery , 2009, Current opinion in urology.

[55]  Pierre E. Dupont,et al.  Design and Control of Concentric-Tube Robots , 2010, IEEE Transactions on Robotics.

[56]  Chih-Jen Lin,et al.  Training v-Support Vector Regression: Theory and Algorithms , 2002, Neural Computation.

[57]  L.D. Seneviratne,et al.  State-of-the-Art in Force and Tactile Sensing for Minimally Invasive Surgery , 2008, IEEE Sensors Journal.