Compensating Uncertainties in Force Sensing for Robotic-Assisted Palpation

Force sensing in robotic-assisted minimally invasive surgery (RMIS) is crucial for performing dedicated surgical procedures, such as bilateral teleoperation and palpation. Due to the bio-compatibility and sterilization requirements, a specially designed surgical tool/shaft is normally attached to the sensor while contacting the organ targets. Through this design, the measured force from the sensor usually contains uncertainties, such as noise, inertial force etc., and thus cannot reflect the actual interaction force with the tissue environment. Motivated to provide the authentic contact force between a robotic tool and soft tissue, we proposed a data-driven force compensation scheme without intricate modeling to reduce the effects of force measurement uncertainties. In this paper, a neural-network-based approach is utilized to automatically model the inertial force subject to noise during the robotic palpation procedure, then the exact contact force can be obtained through the force compensation method which cancels the noise and inertial force. Following this approach, the genuine interaction force during the palpation task can be achieved furthermore to improve the appraisal of the tumor surrounded by the soft tissue. Experiments are conducted with robotic-assisted palpation tasks on a silicone-based soft tissue phantom and the results verify the effectiveness of the suggested method.

[1]  Allison M. Okamura,et al.  Force-Feedback Surgical Teleoperator: Controller Design and Palpation Experiments , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[2]  Thomas Timm Andersen.  Optimizing the Universal Robots ROS driver. , 2015 .

[3]  Mamoru Mitsuishi,et al.  Online Trajectory Planning and Force Control for Automation of Surgical Tasks , 2018, IEEE Transactions on Automation Science and Engineering.

[4]  M. Meng,et al.  ROBOTICS IN NATURAL ORIFICE TRANSLUMINAL ENDOSCOPIC SURGERY , 2013 .

[5]  Martin Buss,et al.  Dynamic contact force/torque observer: Sensor fusion for improved interaction control , 2013, Int. J. Robotics Res..

[6]  Ping-Lang Yen,et al.  Lateral exploration strategy for differentiating the stiffness ratio of an inclusion in soft tissue. , 2008, Medical engineering & physics.

[7]  Ken Masamune,et al.  Intraoperative magnetic resonance imaging–conditional robotic devices for therapy and diagnosis , 2014, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[8]  Allison M. Okamura,et al.  Autonomous robotic palpation: Machine learning techniques to identify hard inclusions in soft tissues , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  Rajnikant V. Patel,et al.  A multi-sensory mechatronic device for localizing tumors in minimally invasive interventions , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[11]  En-Jui Lee,et al.  The Contact Problem for Viscoelastic Bodies , 1960 .

[12]  M. T. Perri,et al.  Experimental evaluation of robot-assisted tactile sensing for minimally invasive surgery , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[13]  Kit Yan Chan,et al.  A study of neural-network-based classifiers for material classification , 2014, Neurocomputing.

[14]  Christos E. Constantinou,et al.  Development of a new instrument for examination of stiffness in the breast using haptic sensor technology , 2008 .

[15]  Maud Marchal,et al.  Physically realistic interactive simulation for biological soft tissues , 2005 .

[16]  Kaspar Althoefer,et al.  Finite-Element Modeling of Soft Tissue Rolling Indentation , 2011, IEEE Transactions on Biomedical Engineering.

[17]  Kaspar Althoefer,et al.  Tissue identification using inverse Finite Element analysis of rolling indentation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[18]  Octavian Postolache,et al.  Tactile Sensors for Robotic Applications , 2013 .

[19]  Hak-Keung Lam,et al.  Variable weight neural networks and their applications on material surface and epilepsy seizure phase classifications , 2015, Neurocomputing.

[20]  Alfred Cuschieri,et al.  Measurements and modelling of the compliance of human and porcine organs , 2001, Medical Image Anal..

[21]  Friedrich M. Wahl,et al.  Improving force control performance by computational elimination of non-contact forces/torques , 2008, 2008 IEEE International Conference on Robotics and Automation.

[22]  Peng Peng,et al.  Handheld Microtactile Sensor for Elasticity Measurement , 2011, IEEE Sensors Journal.

[23]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[24]  D. McKay,et al.  Optimum incision length for port insertion in laparoscopic surgery. , 2006, Annals of the Royal College of Surgeons of England.

[25]  Rajnikant V. Patel,et al.  Robot-assisted Tactile Sensing for Minimally Invasive Tumor Localization , 2009, Int. J. Robotics Res..

[26]  Friedrich M. Wahl,et al.  Scaling and eliminating non-contact forces and torques to improve bilateral teleoperation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Kaspar Althoefer,et al.  Palpation force modulation strategies to identify hard regions in soft tissue organs , 2017, PloS one.

[28]  Allison M. Okamura,et al.  A single-use haptic palpation probe for locating subcutaneous blood vessels in robot-assisted minimally invasive surgery , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[29]  Susan J. Lederman,et al.  Sensing and Displaying Spatially Distributed Fingertip Forces in Haptic Interfaces for Teleoperator and Virtual Environment Systems , 1999, Presence: Teleoperators & Virtual Environments.

[30]  Wei Liu,et al.  Computer-assisted transoral surgery with flexible robotics and navigation technologies: a review of recent progress and research challenges. , 2013, Critical reviews in biomedical engineering.

[31]  Kaspar Althoefer,et al.  Rolling Indentation Probe for Tissue Abnormality Identification During Minimally Invasive Surgery , 2011, IEEE Transactions on Robotics.

[32]  Kaspar Althoefer,et al.  Evaluation of stiffness feedback for hard nodule identification on a phantom silicone model , 2017, PloS one.

[33]  Saverio Farsoni,et al.  Compensation of Load Dynamics for Admittance Controlled Interactive Industrial Robots Using a Quaternion-Based Kalman Filter , 2017, IEEE Robotics and Automation Letters.

[34]  Robert J. Wood,et al.  A monolithic approach to fabricating low-cost, millimeter-scale multi-axis force sensors for minimally-invasive surgery , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[35]  C. Goodman.  Association for the Advancement of Medical Instrumentation , 1988 .

[36]  Jung Kim,et al.  Robotic palpation and mechanical property characterization for abnormal tissue localization , 2012, Medical & Biological Engineering & Computing.

[37]  Todd E. Zickler,et al.  Constitutive modeling of porcine liver in indentation using 3D ultrasound imaging. , 2009, Journal of the mechanical behavior of biomedical materials.

[38]  Joseph M. Romano,et al.  Methods for robotic tool-mediated haptic surface recognition , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[39]  Pietro Valdastri,et al.  Wireless Tissue Palpation for Intraoperative Detection of Lumps in the Soft Tissue , 2014, IEEE Transactions on Biomedical Engineering.

[40]  Nigel H. Lovell,et al.  A review of tactile sensing technologies with applications in biomedical engineering , 2012 .