Dynamic Active Constraints for Surgical Robots Using Vector-Field Inequalities

Robotic assistance allows surgeons to perform dexterous and tremor-free procedures, but robotic aid is still underrepresented in procedures with constrained workspaces, such as deep brain neurosurgery and endonasal surgery. In these procedures, surgeons have restricted vision to areas near the surgical tooltips, which increases the risk of unexpected collisions between the shafts of the instruments and their surroundings. In this paper, our vector-field-inequalities method is extended to provide dynamic active-constraints to any number of robots and moving objects sharing the same workspace. The method is evaluated with experiments and simulations in which robot tools have to avoid collisions autonomously and in real-time, in a constrained endonasal surgical environment. Simulations show that with our method the combined trajectory error of two robotic systems is optimal. Experiments using a real robotic system show that the method can autonomously prevent collisions between the moving robots themselves and between the robots and the environment. Moreover, the framework is also successfully verified under teleoperation with tool–tissue interactions.

[1]  Mamoru Mitsuishi,et al.  Active Constraints Using Vector Field Inequalities for Surgical Robots , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Kostas E. Bekris,et al.  Visual and force-feedback guidance for robot-assisted interventions in the beating heart with real-time MRI , 2012, 2012 IEEE International Conference on Robotics and Automation.

[3]  Russell H. Taylor,et al.  A Steady-Hand Robotic System for Microsurgical Augmentation , 1999, Int. J. Robotics Res..

[4]  Pierre-Brice Wieber,et al.  Hierarchical quadratic programming: Fast online humanoid-robot motion generation , 2014, Int. J. Robotics Res..

[5]  Saurav Agarwal,et al.  Analytical Determination of the Proximity of Two Right-Circular Cylinders in Space , 2016 .

[6]  Bruno Vilhena Adorno Robot Kinematic Modeling and Control Based on Dual Quaternion Algebra --- Part I: Fundamentals. , 2017 .

[7]  Bodo Rosenhahn,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Combined Region-and Motion-based 3d Tracking of Rigid and Articulated Objects , 2022 .

[8]  Guang-Zhong Yang,et al.  Dynamic Active Constraints for Hyper-Redundant Flexible Robots , 2009, MICCAI.

[9]  Jing Ren,et al.  Dynamic 3-D Virtual Fixtures for Minimally Invasive Beating Heart Procedures , 2008, IEEE Transactions on Medical Imaging.

[10]  Atsushi Nakazawa,et al.  Toward Autonomous Collision Avoidance for Robotic Neurosurgery in Deep and Narrow Spaces in the Brain , 2017 .

[11]  Akio Morita,et al.  Master–slave robotic platform and its feasibility study for micro‐neurosurgery , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[12]  Pierre-Brice Wieber,et al.  Kinematic Control of Redundant Manipulators: Generalizing the Task-Priority Framework to Inequality Task , 2011, IEEE Transactions on Robotics.

[13]  Russell H. Taylor,et al.  Constrained Cartesian motion control for teleoperated surgical robots , 1996, IEEE Trans. Robotics Autom..

[14]  Guang-Zhong Yang,et al.  Control of Articulated Snake Robot under Dynamic Active Constraints , 2010, MICCAI.

[15]  Brian L. Davies,et al.  Active Constraints/Virtual Fixtures: A Survey , 2014, IEEE Transactions on Robotics.

[16]  Shuang Song,et al.  Safety-Enhanced Model-Free Visual Servoing for Continuum Tubular Robots Through Singularity Avoidance in Confined Environments , 2019, IEEE Access.

[17]  Guang-Zhong Yang,et al.  Dimensionality Reduction in Controlling Articulated Snake Robot for Endoscopy Under Dynamic Active Constraints , 2013, IEEE Transactions on Robotics.

[18]  Allison M. Okamura,et al.  Design considerations and human-machine performance of moving virtual fixtures , 2009, 2009 IEEE International Conference on Robotics and Automation.

[19]  Shahram Payandeh,et al.  On study of design and implementation of virtual fixtures , 2009, Virtual Reality.

[20]  Howard Jay Chizeck,et al.  Forbidden-region virtual fixtures from streaming point clouds: Remotely touching and protecting a beating heart , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  M. Mitsuishi,et al.  Microsurgical robotic system for the deep surgical field: development of a prototype and feasibility studies in animal and cadaveric models. , 2005, Journal of neurosurgery.

[22]  Peter Kazanzides,et al.  Virtual fixture assistance for needle passing and knot tying , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Rajeevlochana G. Chittawadigi,et al.  An analytical method to detect collision between cylinders using dual number algebra , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Mamoru Mitsuishi,et al.  Sequential surgical signatures in micro-suturing task , 2018, International Journal of Computer Assisted Radiology and Surgery.

[25]  Robert J. Webster,et al.  A Telerobotic System for Transnasal Surgery , 2014, IEEE/ASME Transactions on Mechatronics.

[26]  Russell H. Taylor,et al.  Spatial Motion Constraints Using Virtual Fixtures Generated by Anatomy , 2007, IEEE Transactions on Robotics.

[27]  Peter Kazanzides,et al.  An integrated system for planning, navigation and robotic assistance for skull base surgery , 2008, The international journal of medical robotics + computer assisted surgery : MRCAS.

[28]  Guillaume Morel,et al.  Applying Virtual Fixtures to the Distal End of a Minimally Invasive Surgery Instrument , 2017, IEEE Transactions on Robotics.

[29]  Bruno Vilhena Adorno,et al.  Whole-Body Kinematic Control of Nonholonomic Mobile Manipulators Using Linear Programming , 2018, J. Intell. Robotic Syst..

[30]  Surya P. N. Singh,et al.  V-REP: A versatile and scalable robot simulation framework , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Louis A. Lobes,et al.  Vision-Based Control of a Handheld Surgical Micromanipulator With Virtual Fixtures , 2013, IEEE Transactions on Robotics.

[32]  Bruno Vilhena Adorno,et al.  A dual quaternion linear-quadratic optimal controller for trajectory tracking , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[33]  Hongliang Ren,et al.  Development of a Multi-Channel Concentric Tube Robotic System With Active Vision for Transnasal Nasopharyngeal Carcinoma Procedures , 2016, IEEE Robotics and Automation Letters.

[34]  Bruno Vilhena Adorno Two-arm Manipulation: From Manipulators to Enhanced Human-Robot Collaboration , 2011 .

[35]  Russell H. Taylor,et al.  Constrained control for surgical assistant robots , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[36]  J. Michael McCarthy,et al.  Dual quaternion synthesis of constrained robotic systems , 2003 .

[37]  Philippe Fraisse,et al.  Dual position control strategies using the cooperative dual task-space framework , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  B. Faverjon,et al.  A local based approach for path planning of manipulators with a high number of degrees of freedom , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[39]  Stuart A. Bowyer,et al.  Mass and Friction Optimization for Natural Motion in Hands-On Robotic Surgery , 2016, IEEE Transactions on Robotics.

[40]  Shuang Song,et al.  Development of a compact continuum tubular robotic system for nasopharyngeal biopsy , 2017, Medical & Biological Engineering & Computing.

[41]  Mamoru Mitsuishi,et al.  Microsurgical robotic system for vitreoretinal surgery , 2011, International Journal of Computer Assisted Radiology and Surgery.

[42]  Jun Nakanishi,et al.  Conceptual design of a versatile robot for minimally invasive transnasal microsurgery , 2016, 2016 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[43]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[44]  Atsushi Nakazawa,et al.  Feedback methods for collision avoidance using virtual fixtures for robotic neurosurgery in deep and narrow spaces , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[45]  Z. Zador,et al.  Endoscopic transnasal approach to the pituitary – Operative technique and nuances , 2013, British journal of neurosurgery.