Vision-based intraoperative shape sensing of concentric tube robots

Concentric tube robots have shown promise for minimally invasive surgical (MIS) tasks that require navigation via tortuous anatomical paths. Despite extensive research on their kinematic and dynamic modelling, however, inaccuracies and deformations of their shape due to unknown loads and collisions with the anatomy make intraoperative shape sensing a requirement. This paper presents a vision-based shape-sensing algorithm for concentric tube robots. The proposed algorithm fuses information extracted from a standard imaging modality, monoplane X-ray fluoroscopy, with the kinematics model of the concentric tube robot, to achieve automatic, real-time, accurate and continuous robot-shape estimations despite kinematics' noise and unmodelled forces. Fusion is performed by a fast 2D/3D non-rigid registration, which combines kinematics and intraoperative tracking of the robot. Extensive simulations with a range of noise models and virtual loads acting on the robot, and experimental evaluation in air and in a skull phantom, demonstrate the clinical value of the proposed technique1.

[1]  Marco A. Zenati,et al.  Shape estimation for image-guided surgery with a highly articulated snake robot , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Pierre E. Dupont,et al.  Concentric Tube Robot Design and Optimization Based on Task and Anatomical Constraints , 2015, IEEE Transactions on Robotics.

[3]  Theo van Walsum,et al.  Guide wire reconstruction and visualization in 3DRA using monoplane fluoroscopic imaging , 2005, IEEE Transactions on Medical Imaging.

[4]  Pierre E. Dupont,et al.  Planning stable paths for concentric tube robots , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Edgar J. Lobaton,et al.  Continuous shape estimation of continuum robots using X-ray images , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Pierre E. Dupont,et al.  Design and Control of Concentric-Tube Robots , 2010, IEEE Transactions on Robotics.

[7]  John Kenneth Salisbury,et al.  Vision based 3-D shape sensing of flexible manipulators , 2008, 2008 IEEE International Conference on Robotics and Automation.

[8]  Robert J. Webster,et al.  Mechanics of Precurved-Tube Continuum Robots , 2009, IEEE Transactions on Robotics.

[9]  D. Caleb Rucker,et al.  A Geometrically Exact Model for Externally Loaded Concentric-Tube Continuum Robots , 2010, IEEE Transactions on Robotics.

[10]  Stefano Stramigioli,et al.  3D position estimation of flexible instruments: marker-less and marker-based methods , 2012, International Journal of Computer Assisted Radiology and Surgery.

[11]  Pierre E. Dupont,et al.  FBG-based shape sensing tubes for continuum robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Guang-Zhong Yang,et al.  Vision-based motion control of a flexible robot for surgical applications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Marie-Odile Berger,et al.  Model of a Vascular C-Arm for 3D Augmented Fluoroscopy in Interventional Radiology , 2005, MICCAI.

[14]  Robert J. Webster,et al.  Toward Fluoroscopic Shape Reconstruction for Control of Steerable Medical Devices , 2011 .

[15]  Max A. Viergever,et al.  Guide Wire Tracking During Endovascular Interventions , 2000, MICCAI.

[16]  D. Caleb Rucker,et al.  Visual sensing of continuum robot shape using self-organizing maps , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Ian D. Walker,et al.  Real-time shape estimation for continuum robots using vision , 2005, Robotica.

[18]  Wei Zhang,et al.  Robust guidewire tracking in fluoroscopy , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Ian D. Walker,et al.  Setpoint regulation of continuum robots using a fixed camera , 2007, Proceedings of the 2004 American Control Conference.

[20]  Ron Alterovitz,et al.  Interactive-rate motion planning for concentric tube robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Nabil Simaan,et al.  Kinematics-Based Detection and Localization of Contacts Along Multisegment Continuum Robots , 2012, IEEE Transactions on Robotics.

[22]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[23]  Hari Sundar,et al.  An Efficient Graph-Based Deformable 2D/3D Registration Algorithm with Applications for Abdominal Aortic Aneurysm Interventions , 2010, MIAR.

[24]  Russell H. Taylor,et al.  Piecewise-rigid 2D-3D registration for pose estimation of snake-like manipulator using an intraoperative x-ray projection , 2014, Medical Imaging.

[25]  Pierre E. Dupont,et al.  Quasistatic modeling of concentric tube robots with external loads , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Sander Janssen,et al.  On using an array of fiber Bragg grating sensors for closed-loop control of flexible minimally invasive surgical instruments , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Su-Lin Lee,et al.  3D Robotic Catheter Shape Reconstruction and Localisation Using Appearance Priors and Adaptive C-Arm Positioning , 2013, AE-CAI.