Trajectory-Optimized Sensing for Active Search of Tissue Abnormalities in Robotic Surgery

In this work, we develop an approach for guiding robots to automatically localize and find the shapes of tumors and other stiff inclusions present in the anatomy. Our approach uses Gaussian processes to model the stiffness distribution and active learning to direct the palpation path of the robot. The palpation paths are chosen such that they maximize an acquisition function provided by an active learning algorithm. Our approach provides the flexibility to avoid obstacles in the robot's path, incorporate uncertainties in robot position and sensor measurements, include prior information about location of stiff inclusions while respecting the robot-kinematics. To the best of our knowledge this is the first work in literature that considers all the above conditions while localizing tumors. The proposed framework is evaluated via simulation and experimentation on three different robot platforms: 6-DoF industrial arm, da Vinci Research Kit (dVRK), and the Insertable Robotic Effector Platform (IREP). Results show that our approach can accurately estimate the locations and boundaries of the stiff inclusions while reducing exploration time.

[1]  Allison M. Okamura,et al.  Methods to Segment Hard Inclusions in Soft Tissue During Autonomous Robotic Palpation , 2015, IEEE Transactions on Robotics.

[2]  Robert J. Wood,et al.  A monolithic approach to fabricating low-cost, millimeter-scale multi-axis force sensors for minimally-invasive surgery , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Howie Choset,et al.  Utility-Guided Palpation for Locating Tissue Abnormalities , 2017, IEEE Robotics and Automation Letters.

[4]  L.D. Seneviratne,et al.  State-of-the-Art in Force and Tactile Sensing for Minimally Invasive Surgery , 2008, IEEE Sensors Journal.

[5]  Robert D. Howe,et al.  Remote palpation technology , 1995 .

[6]  Agathe Girard,et al.  Learning a Gaussian Process Model with Uncertain Inputs , 2003 .

[7]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[8]  Long Wang,et al.  Integration and preliminary evaluation of an Insertable Robotic Effectors Platform for Single Port Access Surgery , 2012, 2012 IEEE International Conference on Robotics and Automation.

[9]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[10]  Alkis Gotovos,et al.  Active Learning for Level Set Estimation , 2022 .

[11]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[12]  Rajnikant V. Patel,et al.  Robot-assisted Tactile Sensing for Minimally Invasive Tumor Localization , 2009, Int. J. Robotics Res..

[13]  Kai Xu,et al.  An Investigation of the Intrinsic Force Sensing Capabilities of Continuum Robots , 2008, IEEE Transactions on Robotics.

[14]  Nabil Simaan,et al.  Algorithms for autonomous exploration and estimation in compliant environments , 2012, Robotica.

[15]  R. Murray,et al.  Differential Flatness of Mechanical Control Systems: A Catalog of Prototype Systems , 1995 .

[16]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[17]  A. A. Zhigli︠a︡vskiĭ,et al.  Stochastic Global Optimization , 2007 .

[18]  Pietro Valdastri,et al.  Wireless Tissue Palpation for Intraoperative Detection of Lumps in the Soft Tissue , 2014, IEEE Transactions on Biomedical Engineering.

[19]  Klaus Obermayer,et al.  Gaussian process regression: active data selection and test point rejection , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[20]  Chen Yang,et al.  Development of an inexpensive tri-axial force sensor for minimally invasive surgery , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Russell H. Taylor,et al.  Concurrent nonparametric estimation of organ geometry and tissue stiffness using continuous adaptive palpation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Howie Choset,et al.  Using Bayesian optimization to guide probing of a flexible environment for simultaneous registration and stiffness mapping , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Marin Kobilarov,et al.  Cross-entropy motion planning , 2012, Int. J. Robotics Res..

[25]  Lih-Yuan Deng,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning , 2006, Technometrics.

[26]  Allison M. Okamura,et al.  Tissue property estimation and graphical display for teleoperated robot-assisted surgery , 2009, 2009 IEEE International Conference on Robotics and Automation.

[27]  Howie Choset,et al.  Development of an Inexpensive Triaxial Force Sensor for Minimally Invasive Surgery , 2017 .

[28]  Allison M. Okamura,et al.  A single-use haptic palpation probe for locating subcutaneous blood vessels in robot-assisted minimally invasive surgery , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[29]  Roman Garnett,et al.  Active Area Search via Bayesian Quadrature , 2014, AISTATS.

[30]  Howie Choset,et al.  Complementary model update: A method for simultaneous registration and stiffness mapping in flexible environments , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[32]  Kenneth Y. Goldberg,et al.  Tumor localization using automated palpation with Gaussian Process Adaptive Sampling , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[33]  Peter Rossmanith,et al.  Simulated Annealing , 2008, Taschenbuch der Algorithmen.

[34]  Kaspar Althoefer,et al.  Rolling Mechanical Imaging for Tissue Abnormality Localization During Minimally Invasive Surgery , 2010, IEEE Transactions on Biomedical Engineering.