Tumor localization using automated palpation with Gaussian Process Adaptive Sampling

In surgical tumor removal, inaccurate localization can lead to removal of excessive healthy tissue and failure to completely remove cancerous tissue. Automated palpation with a tactile sensor has the potential to precisely estimate the geometry of embedded tumors during robot-assisted minimally invasive surgery (RMIS). We formulate tumor boundary localization as a Bayesian optimization model along implicit curves over estimated tissue stiffness. We propose a Gaussian Process Adaptive Sampling algorithm called Implicit Level Set Upper Confidence Bound (ILS-UCB), that prioritizes sampling near a level set of the estimate. We compare the ILS-UCB algorithm to two alternative palpation algorithms: (1) Expected Variance Reduction (EVR), which emphasizes exploration by minimizing variance, and (2) Upper Confidence Bound (UCB), which balances exploration with exploitation using only the estimated mean. We compare these algorithms in simulated experiments varying the levels of measurement noise and bias. We find that ILS-UCB significantly outperforms the other two algorithms as measured by the symmetric difference between tumor boundary estimate and ground truth, reducing error by up to 10×. Physical experiments on a dVRK show that our approach can localize the tumor boundary with approximately the same accuracy as a dense raster scan while requiring at least 10× fewer measurements.

[1]  Pieter Abbeel,et al.  Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[2]  M. Hashizume,et al.  Robotic Surgery for Cancer , 2013, Cancer journal.

[3]  Alkis Gotovos,et al.  Fully autonomous focused exploration for robotic environmental monitoring , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Joel W. Burdick,et al.  The next best touch for model-based localization , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Alkis Gotovos,et al.  Active Learning for Level Set Estimation , 2022 .

[7]  Kenneth Y. Goldberg,et al.  Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[8]  R. Veldkamp,et al.  Laparoscopic surgery versus open surgery for colon cancer : short-term outcomes of a randomised trial , 2022 .

[9]  L. Xu,et al.  Magnetic resonance elastography of brain tumors: preliminary results , 2007, Acta radiologica.

[10]  Y. Zheng,et al.  Softness measurements for open-cell foam materials and human soft tissue , 2006 .

[11]  Gregory S. Fischer,et al.  Implementation of a Motion Planning Framework for the daVinci Surgical System Research Kit , 2014 .

[12]  Octavian Postolache,et al.  Tactile Sensors for Robotic Applications , 2013 .

[13]  T. Ortmaier,et al.  The touch and feel in minimally invasive surgery , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[14]  Nigel H. Lovell,et al.  A review of tactile sensing technologies with applications in biomedical engineering , 2012 .

[15]  Kirk A. Nichols,et al.  A Disposable Haptic Palpation Probe for Locating Subcutaneous Blood Vessels in Robot-Assisted Minimally Invasive Surgery , 2015 .

[16]  Nabil Simaan,et al.  Algorithms for autonomous exploration and estimation in compliant environments , 2012, Robotica.

[17]  Matei T. Ciocarlie,et al.  GP-GPIS-OPT: Grasp planning with shape uncertainty using Gaussian process implicit surfaces and Sequential Convex Programming , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Allison M. Okamura,et al.  Methods to Segment Hard Inclusions in Soft Tissue During Autonomous Robotic Palpation , 2015, IEEE Transactions on Robotics.

[19]  Marc Toussaint,et al.  Uncertainty aware grasping and tactile exploration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[20]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[21]  Howie Choset,et al.  Complementary model update: A method for simultaneous registration and stiffness mapping in flexible environments , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[22]  A. D'Amico,et al.  Radical retropubic prostatectomy and robotic-assisted laparoscopic prostatectomy: likelihood of positive surgical margin(s). , 2010, Urology.

[23]  Geoffrey A. Hollinger,et al.  Active planning for underwater inspection and the benefit of adaptivity , 2012, Int. J. Robotics Res..

[24]  Marc Toussaint,et al.  Gaussian process implicit surfaces for shape estimation and grasping , 2011, 2011 IEEE International Conference on Robotics and Automation.

[25]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[26]  Howie Choset,et al.  Using Bayesian optimization to guide probing of a flexible environment for simultaneous registration and stiffness mapping , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Kenneth Y. Goldberg,et al.  An interchangeable surgical instrument system with application to supervised automation of multilateral tumor resection , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[29]  Sir Ara W Darzi,et al.  The impact of minimally invasive surgical techniques. , 2004, Annual review of medicine.

[30]  L.D. Seneviratne,et al.  State-of-the-Art in Force and Tactile Sensing for Minimally Invasive Surgery , 2008, IEEE Sensors Journal.

[31]  Russell H. Taylor,et al.  Concurrent nonparametric estimation of organ geometry and tissue stiffness using continuous adaptive palpation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).