Spider U-Net: Incorporating Inter-Slice Connectivity Using LSTM for 3D Blood Vessel Segmentation

Blood vessel segmentation (BVS) of 3D medical imaging such as computed tomography and magnetic resonance angiography (MRA) is an essential task in the clinical field. Automation of 3D BVS using deep supervised learning is being researched, and U-Net-based approaches, which are considered as standard for medical image segmentation, are proposed a lot. However, the inherent characteristics of blood vessels, e.g., they are complex and narrow, as well as the resolution and sensitivity of the imaging modalities increases the difficulty of 3D BVS. We propose a novel U-Net-based model named Spider U-Net for 3D BVS that considers the connectivity of the blood vessels between the axial slices. To achieve this, long short-term memory (LSTM), which can capture the context of the consecutive data, is inserted into the baseline model. We also propose a data feeding strategy that augments data and makes Spider U-Net stable. Spider U-Net outperformed 2D U-Net, 3D U-Net, and the fully convolutional network-recurrent neural network (FCN-RNN) in dice coefficient score (DSC) by 0.048, 0.077, and 0.041, respectively, for our in-house brain MRA dataset and also achieved the highest DSC for two public datasets. The results imply that considering inter-slice connectivity with LSTM improves model performance in the 3D BVS task.

[1]  Yadong Wang,et al.  Accurate Vessel Segmentation With Constrained B-Snake , 2015, IEEE Transactions on Image Processing.

[2]  Ronald M. Summers,et al.  A large annotated medical image dataset for the development and evaluation of segmentation algorithms , 2019, ArXiv.

[3]  Tae-Seong Kim,et al.  Vessel enhancement filter using directional filter bank , 2009, Comput. Vis. Image Underst..

[4]  Pei Wang,et al.  Focal Dice Loss and Image Dilation for Brain Tumor Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[5]  Salah Bourennane,et al.  Retinal vessel segmentation using a probabilistic tracking method , 2012, Pattern Recognit..

[6]  Evangelos Dermatas,et al.  Multi-scale retinal vessel segmentation using line tracking , 2010, Comput. Medical Imaging Graph..

[7]  Lin Yang,et al.  Combining Fully Convolutional and Recurrent Neural Networks for 3D Biomedical Image Segmentation , 2016, NIPS.

[8]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[9]  John D. Kelleher,et al.  A U-Net Deep Learning Framework for High Performance Vessel Segmentation in Patients With Cerebrovascular Disease , 2019, Front. Neurosci..

[10]  Hanno Gottschalk,et al.  Controlled False Negative Reduction of Minority Classes in Semantic Segmentation , 2019, 2020 International Joint Conference on Neural Networks (IJCNN).

[11]  Benoît Naegel,et al.  Cerebrovascular Network Segmentation of MRA Images With Deep Learning , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[12]  Yuqing Hou,et al.  Segmentation of blood vessels using rule-based and machine-learning-based methods: a review , 2017, Multimedia Systems.

[13]  Jing Qiu,et al.  Coronary artery segmentation in angiographic videos utilizing spatial-temporal information , 2020, BMC Medical Imaging.

[14]  Hui Ding,et al.  Robust liver vessel extraction using 3D U-Net with variant dice loss function , 2018, Comput. Biol. Medicine.

[15]  Klaus H. Maier-Hein,et al.  Automatic Cardiac Disease Assessment on cine-MRI via Time-Series Segmentation and Domain Specific Features , 2017, STACOM@MICCAI.

[16]  Jenq-Neng Hwang,et al.  Quantification of morphometry and intensity features of intracranial arteries from 3D TOF MRA using the intracranial artery feature extraction (iCafe): A reproducibility study. , 2019, Magnetic Resonance Imaging.

[17]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[18]  Ivana Galinovic,et al.  BRAVE-NET: Fully Automated Arterial Brain Vessel Segmentation in Patients With Cerebrovascular Disease , 2020, Frontiers in Artificial Intelligence.

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[21]  Manuel G. Penedo,et al.  Retinal vessel tree segmentation using a deformable contour model , 2008, 2008 19th International Conference on Pattern Recognition.

[22]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[23]  Klaus H. Maier-Hein,et al.  nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation , 2018, Bildverarbeitung für die Medizin.

[24]  Yun Tian,et al.  Automated Segmentation of Coronary Arteries Based on Statistical Region Growing and Heuristic Decision Method , 2016, BioMed research international.

[25]  John K. Tsotsos,et al.  Efficient and generalizable statistical models of shape and appearance for analysis of cardiac MRI , 2008, Medical Image Anal..

[26]  Le Lu,et al.  Improving Deep Pancreas Segmentation in CT and MRI Images via Recurrent Neural Contextual Learning and Direct Loss Function , 2017, ArXiv.