TEDS-Net: Enforcing Diffeomorphisms in Spatial Transformers to Guarantee Topology Preservation in Segmentations

Accurate topology is key when performing meaningful anatomical segmentations, however, it is often overlooked in traditional deep learning methods. In this work we propose TEDS-Net: a novel segmentation method that guarantees accurate topology. Our method is built upon a continuous diffeomorphic framework, which enforces topology preservation. However, in practice, diffeomorphic fields are represented using a finite number of parameters and sampled using methods such as linear interpolation, violating the theoretical guarantees. We therefore introduce additional modifications to more strictly enforce it. Our network learns how to warp a binary prior, with the desired topological characteristics, to complete the segmentation task. We tested our method on myocardium segmentation from an open-source 2D heart dataset. TEDSNet preserved topology in 100% of the cases, compared to 90% from the U-Net, without sacrificing on Hausdorff Distance or Dice performance. Code will be made available at: www.github.com/mwyburd/TEDS-Net.

[1]  Dimitris Samaras,et al.  Topology-Preserving Deep Image Segmentation , 2019, NeurIPS.

[2]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[3]  Cleve B. Moler,et al.  Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years Later , 1978, SIAM Rev..

[4]  Mert R. Sabuncu,et al.  VoxelMorph: A Learning Framework for Deformable Medical Image Registration , 2018, IEEE Transactions on Medical Imaging.

[5]  E. Braunwald,et al.  Hypertrophic Cardiomyopathy: Genetics, Pathogenesis, Clinical Manifestations, Diagnosis, and Therapy. , 2017, Circulation research.

[6]  Pascal Fua,et al.  Probabilistic Atlases to Enforce Topological Constraints , 2019, MICCAI.

[7]  Mert R. Sabuncu,et al.  Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfaces , 2019, Medical Image Anal..

[8]  Mert R. Sabuncu,et al.  Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration , 2018, MICCAI.

[9]  J. Alison Noble,et al.  &OHgr;‐Net (Omega‐Net): Fully automatic, multi‐view cardiac MR detection, orientation, and segmentation with deep neural networks☆ , 2018, Medical Image Anal..

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Mark Jenkinson,et al.  Spatial Warping Network for 3D Segmentation of the Hippocampus in MR Images , 2019, MICCAI.

[12]  J. Millson On the first Betti number of a constant negatively curved manifold , 1976 .

[13]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[14]  Nikos Paragios,et al.  Linear and Deformable Image Registration with 3D Convolutional Neural Networks , 2018, RAMBO+BIA+TIA@MICCAI.

[15]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[16]  Septimiu E. Salcudean,et al.  Liver Segmentation in Magnetic Resonance Imaging via Mean Shape Fitting with Fully Convolutional Neural Networks , 2019, MICCAI.

[17]  Nicholas Ayache,et al.  A Log-Euclidean Polyaffine Framework for Locally Rigid or Affine Registration , 2006, WBIR.

[18]  Pascal Fua,et al.  Beyond the Pixel-Wise Loss for Topology-Aware Delineation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.