Shape-Aware Organ Segmentation by Predicting Signed Distance Maps

In this work, we propose to resolve the issue existing in current deep learning based organ segmentation systems that they often produce results that do not capture the overall shape of the target organ and often lack smoothness. Since there is a rigorous mapping between the Signed Distance Map (SDM) calculated from object boundary contours and the binary segmentation map, we exploit the feasibility of learning the SDM directly from medical scans. By converting the segmentation task into predicting an SDM, we show that our proposed method retains superior segmentation performance and has better smoothness and continuity in shape. To leverage the complementary information in traditional segmentation training, we introduce an approximated Heaviside function to train the model by predicting SDMs and segmentation maps simultaneously. We validate our proposed models by conducting extensive experiments on a hippocampus segmentation dataset and the public MICCAI 2015 Head and Neck Auto Segmentation Challenge dataset with multiple organs. While our carefully designed backbone 3D segmentation network improves the Dice coefficient by more than 5% compared to current state-of-the-arts, the proposed model with SDM learning produces smoother segmentation results with smaller Hausdorff distance and average surface distance, thus proving the effectiveness of our method.

[1]  Timo Kohlberger,et al.  Automatic Multi-organ Segmentation Using Learning-Based Segmentation and Level Set Optimization , 2011, MICCAI.

[2]  Paul M. Thompson,et al.  Hippocampal shape analysis in Alzheimer’s disease: A population-based study , 2007, NeuroImage.

[3]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[4]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[5]  P. Danielsson Euclidean distance mapping , 1980 .

[6]  Blake Hannaford,et al.  Evaluation of segmentation methods on head and neck CT: Auto‐segmentation challenge 2015 , 2017, Medical physics.

[7]  Ronald M. Summers,et al.  Automatic multi-resolution shape modeling of multi-organ structures , 2015, Medical Image Anal..

[8]  Hongkai Zhao,et al.  A fast sweeping method for Eikonal equations , 2004, Math. Comput..

[9]  Richard A. Newcombe,et al.  DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Kaiming He,et al.  Group Normalization , 2018, ECCV.

[11]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[12]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[13]  Jose Dolz,et al.  Boundary loss for highly unbalanced segmentation , 2018, MIDL.

[14]  Dean C. Barratt,et al.  Automatic Multi-Organ Segmentation on Abdominal CT With Dense V-Networks , 2018, IEEE Transactions on Medical Imaging.

[15]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[16]  Ben Glocker,et al.  Motion Segmentation of Truncated Signed Distance Function Based Volumetric Surfaces , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[17]  Tianwei Ni,et al.  Elastic Boundary Projection for 3D Medical Image Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[19]  Yuanyuan Chen,et al.  FocusNet: Imbalanced Large and Small Organ Segmentation with an End-to-End Deep Neural Network for Head and Neck CT Images , 2019, MICCAI.

[20]  Ronald M. Summers,et al.  DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation , 2015, MICCAI.

[21]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[22]  Alexandre Boulch,et al.  Distance transform regression for spatially-aware deep semantic segmentation , 2019, Comput. Vis. Image Underst..

[23]  D. Low,et al.  Experience-based quality control of clinical intensity-modulated radiotherapy planning. , 2011, International Journal of Radiation Oncology, Biology, Physics.

[24]  S. M. Masudur Rahman Al-Arif,et al.  SPNet: Shape Prediction Using a Fully Convolutional Neural Network , 2018, MICCAI.

[25]  Bjoern H Menze,et al.  Shape-Aware Complementary-Task Learning for Multi-Organ Segmentation , 2019, MLMI@MICCAI.

[26]  Tao Xu,et al.  SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation , 2017, Neuroinformatics.

[27]  Gang Wang,et al.  Deep Level Sets for Salient Object Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Ziv Yaniv,et al.  A Distance Map Regularized CNN for Cardiac Cine MR Image Segmentation , 2019, Medical physics.

[29]  Hongzhi Wang,et al.  Integrating Deformable Modeling with 3D Deep Neural Network Segmentation , 2018, DLMIA/ML-CDS@MICCAI.