Catheter segmentation in three-dimensional ultrasound images by feature fusion and model fitting

Abstract. Ultrasound (US) has been increasingly used during interventions, such as cardiac catheterization. To accurately identify the catheter inside US images, extra training for physicians and sonographers is needed. As a consequence, automated segmentation of the catheter in US images and optimized presentation viewing to the physician can be beneficial to accelerate the efficiency and safety of interventions and improve their outcome. For cardiac catheterization, a three-dimensional (3-D) US image is potentially attractive because of no radiation modality and richer spatial information. However, due to a limited spatial resolution of 3-D cardiac US and complex anatomical structures inside the heart, image-based catheter segmentation is challenging. We propose a cardiac catheter segmentation method in 3-D US data through image processing techniques. Our method first applies a voxel-based classification through newly designed multiscale and multidefinition features, which provide a robust catheter voxel segmentation in 3-D US. Second, a modified catheter model fitting is applied to segment the curved catheter in 3-D US images. The proposed method is validated with extensive experiments, using different in-vitro, ex-vivo, and in-vivo datasets. The proposed method can segment the catheter within an average tip-point error that is smaller than the catheter diameter (1.9 mm) in the volumetric images. Based on automated catheter segmentation and combined with optimal viewing, physicians do not have to interpret US images and can focus on the procedure itself to improve the quality of cardiac intervention.

[1]  Marius George Linguraru,et al.  Statistical segmentation of surgical instruments in 3-D ultrasound images. , 2007, Ultrasound in medicine & biology.

[2]  Peter H. N. de With,et al.  Gabor-based needle detection and tracking in three-dimensional ultrasound data volumes , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[3]  Gabor Fichtinger,et al.  A new scheme for curved needle segmentation in three-dimensional ultrasound images , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[4]  Peter H. N. de With,et al.  Feature study on catheter detection in three-dimensional ultrasound , 2018, Medical Imaging.

[5]  Nico Karssemeijer,et al.  Computer-Aided Detection of Cancer in Automated 3-D Breast Ultrasound , 2013, IEEE Transactions on Medical Imaging.

[6]  Emad M. Boctor,et al.  Photoacoustic active ultrasound element for catheter tracking , 2014, Photonics West - Biomedical Optics.

[7]  Alexandre Krupa,et al.  Intensity-Based Visual Servoing for Instrument and Tissue Tracking in 3D Ultrasound Volumes , 2015, IEEE Transactions on Automation Science and Engineering.

[8]  Rich Caruana,et al.  An empirical comparison of supervised learning algorithms , 2006, ICML.

[9]  Peter H. N. de With,et al.  Multi-resolution Gabor wavelet feature extraction for needle detection in 3D ultrasound , 2015, International Conference on Machine Vision.

[10]  Peter H. N. de With,et al.  Medical Instrument Detection in 3-Dimensional Ultrasound Data Volumes , 2017, IEEE Transactions on Medical Imaging.

[11]  Christian Cachard,et al.  Line filtering for surgical tool localization in 3D ultrasound images , 2013, Comput. Biol. Medicine.

[12]  Theo van Walsum,et al.  Fully Automatic and Real-Time Catheter Segmentation in X-Ray Fluoroscopy , 2017, MICCAI.

[13]  J. Duhamel,et al.  Parallel integral projection transform for straight electrode localization in 3-D ultrasound images , 2008, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[14]  Christian Cachard,et al.  Model Fitting Using RANSAC for Surgical Tool Localization in 3-D Ultrasound Images , 2010, IEEE Transactions on Biomedical Engineering.

[15]  David M. Mills,et al.  Automated catheter detection in volumetric ultrasound , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[16]  Christian Cachard,et al.  Automatic Needle Detection and Tracking in 3D Ultrasound Using an ROI-Based RANSAC and Kalman Method , 2013, Ultrasonic imaging.

[17]  Gabor Fichtinger,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2008, 11th International Conference, New York, NY, USA, September 6-10, 2008, Proceedings, Part I , 2008, International Conference on Medical Image Computing and Computer-Assisted Intervention.

[18]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[19]  Nico Karssemeijer,et al.  Computer-aided detection of breast cancers using Haar-like features in automated 3D breast ultrasound. , 2015, Medical physics.

[20]  Peter H. N. de With,et al.  Sparse-plus-dense-RANSAC for estimation of multiple complex curvilinear models in 2D and 3D , 2013, Pattern Recognit..

[21]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[22]  Robert Rohling,et al.  Bone Segmentation and Fracture Detection in Ultrasound Using 3D Local Phase Features , 2008, MICCAI.