IT-Block: Inverted Triangle Block embedded U-Net for Medical Image Segmentation

Convolutional neural network (CNN) such as U-Net has demonstrated excellent performance for medical image segmentation. However, there are some limitations of its scalability. Specifically, the memory would increase significantly when embedding other functional modules into U-Net. Moreover, the kernel size used in U-Net is unitary, which makes it difficult to obtain the multi-level information and extract the target completely. In this paper, we only use 12 convolutional layers of U-Net as a backbone and design a novel architecture named Inverted Triangle (IT) Block embedded into it to address these problems. The IT-Block consists of Dense Connection, Residual Connection, and Inception, aiming to help the network obtain multi-level features and reuse them comprehensively. Furthermore, we optimize the dice loss to alleviate the butterfly effect, making the training process more stable during the backpropagation. The experimental results state that our framework is superior to U-Net in running time and accuracy.

[1]  Dipti Prasad Mukherjee,et al.  Mitosis Detection for Invasive Breast Cancer Grading in Histopathological Images , 2015, IEEE Transactions on Image Processing.

[2]  Marleen de Bruijne,et al.  GP-Unet: Lesion Detection from Weak Labels with a 3D Regression Network , 2017, MICCAI.

[3]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[5]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[6]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[11]  Pascal Fua,et al.  Recurrent U-Net for Resource-Constrained Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[12]  Iasonas Kokkinos,et al.  Sub-cortical brain structure segmentation using F-CNN'S , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[13]  Jie Zhao,et al.  Automated Segmentation Of Pulmonary Lobes Using Coordination-Guided Deep Neural Networks , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[14]  Ender Konukoglu,et al.  A Partially Reversible U-Net for Memory-Efficient Volumetric Image Segmentation , 2019, MICCAI.

[15]  Minho Lee,et al.  Siamese U-Net with Healthy Template for Accurate Segmentation of Intracranial Hemorrhage , 2019, MICCAI.

[16]  Yu Qiao,et al.  Prostate Segmentation using 2D Bridged U-net , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[17]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[18]  Song Wang,et al.  Three-Dimensional CT Image Segmentation by Combining 2D Fully Convolutional Network with 3D Majority Voting , 2016, LABELS/DLMIA@MICCAI.

[19]  Mehdi Moradi,et al.  SegNAS3D: Network Architecture Search with Derivative-Free Global Optimization for 3D Image Segmentation , 2019, MICCAI.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[22]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[23]  Linda G. Shapiro,et al.  Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images , 2018, MICCAI.

[24]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[25]  Mert R. Sabuncu,et al.  Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[26]  Peter A. Calabresi,et al.  Fully Convolutional Boundary Regression for Retina OCT Segmentation , 2019, MICCAI.

[27]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[30]  Klaus H. Maier-Hein,et al.  A Probabilistic U-Net for Segmentation of Ambiguous Images , 2018, NeurIPS.

[31]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[32]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[34]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.