Fully Automatic and Real-Time Catheter Segmentation in X-Ray Fluoroscopy

Augmenting X-ray imaging with 3D roadmap to improve guidance is a common strategy. Such approaches benefit from automated analysis of the X-ray images, such as the automatic detection and tracking of instruments. In this paper, we propose a real-time method to segment the catheter and guidewire in 2D X-ray fluoroscopic sequences. The method is based on deep convolutional neural networks. The network takes as input the current image and the three previous ones, and segments the catheter and guidewire in the current image. Subsequently, a centerline model of the catheter is constructed from the segmented image. A small set of annotated data combined with data augmentation is used to train the network. We trained the method on images from 182 X-ray sequences from 23 different interventions. On a testing set with images of 55 X-ray sequences from 5 other interventions, a median centerline distance error of 0.2 mm and a median tip distance error of 0.9 mm was obtained. The segmentation of the instruments in 2D X-ray sequences is performed in a real-time fully-automatic manner.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Colin D. Bicknell,et al.  Robust Catheter and Guidewire Tracking Using B-Spline Tube Model and Pixel-Wise Posteriors , 2016, IEEE Robotics and Automation Letters.

[3]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[4]  Daniel Ruijters,et al.  Validation of 3D multimodality roadmapping in interventional neuroradiology , 2011, Physics in medicine and biology.

[5]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[6]  Charles A. Mistretta,et al.  Guidewire path tracking and segmentation in 2D fluoroscopic time series using device paths from previous frames , 2016, SPIE Medical Imaging.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[9]  Pierre Ambrosini,et al.  A Hidden Markov Model for 3D Catheter Tip Tracking With 2D X-ray Catheterization Sequence and 3D Rotational Angiography , 2017, IEEE Transactions on Medical Imaging.

[10]  Nassir Navab,et al.  Interventional Tool Tracking Using Discrete Optimization , 2013, IEEE Transactions on Medical Imaging.

[11]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[12]  Wei Zhang,et al.  Robust guidewire tracking in fluoroscopy , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Nassir Navab,et al.  CathNets: Detection and Single-View Depth Prediction of Catheter Electrodes , 2016, MIAR.

[14]  Tong Fang,et al.  Variational Guidewire Tracking Using Phase Congruency , 2007, MICCAI.

[15]  Alejandro F. Frangi,et al.  Guide Wire Tracking During Endovascular Interventions , 2000, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[16]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[17]  Ziyan Wu,et al.  Guidewire tracking using a novel sequential segment optimization method in interventional X-ray videos , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[18]  YingLiang Ma,et al.  Fast Catheter Segmentation From Echocardiographic Sequences Based on Segmentation From Corresponding X-Ray Fluoroscopy for Cardiac Catheterization Interventions , 2015, IEEE Transactions on Medical Imaging.