A Topological Loss Function for Deep-Learning Based Image Segmentation Using Persistent Homology

We introduce a method for training neural networks to perform image or volume segmentation in which prior knowledge about the topology of the segmented object can be explicitly provided and then incorporated into the training process. By using the differentiable properties of persistent homology, a concept used in topological data analysis, we can specify the desired topology of segmented objects in terms of their Betti numbers and then drive the proposed segmentations to contain the specified topological features. Importantly this process does not require any ground-truth labels, just prior knowledge of the topology of the structure being segmented. We demonstrate our approach in four experiments: one on MNIST image denoising and digit recognition, one on left ventricular myocardium segmentation from magnetic resonance imaging data from the UK Biobank, one on the ACDC public challenge dataset and one on placenta segmentation from 3-D ultrasound. We find that embedding explicit prior knowledge in neural network segmentation tasks is most beneficial when the segmentation task is especially challenging and that it can be used in either a semi-supervised or post-processing context to extract a useful training gradient from images without pixelwise labels.

[1]  Chao Chen,et al.  TopoReg: A Topological Regularizer for Classifiers , 2018, ArXiv.

[2]  Ben Glocker,et al.  TeTrIS: Template Transformer Networks for Image Segmentation With Shape Priors , 2019, IEEE Transactions on Medical Imaging.

[3]  Klaus H. Maier-Hein,et al.  A Probabilistic U-Net for Segmentation of Ambiguous Images , 2018, NeurIPS.

[4]  Alban Goupil,et al.  Topological persistence based on pixels for object segmentation in biomedical images , 2017, 2017 Fourth International Conference on Advances in Biomedical Engineering (ICABME).

[5]  Mason A. Porter,et al.  A roadmap for the computation of persistent homology , 2015, EPJ Data Science.

[6]  Roberto Franzosi,et al.  Persistent homology analysis of phase transitions. , 2016, Physical review. E.

[7]  David B. A. Epstein,et al.  Persistent Homology for Fast Tumor Segmentation in Whole Slide Histology Images , 2016, MIUA.

[8]  Chao Chen,et al.  Efficient Computation of Persistent Homology for Cubical Data , 2012 .

[9]  J. Marron,et al.  Persistent Homology Analysis of Brain Artery Trees. , 2014, The annals of applied statistics.

[10]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[11]  Karsten M. Borgwardt,et al.  Neural Persistence: A Complexity Measure for Deep Neural Networks Using Algebraic Topology , 2018, ICLR.

[12]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[13]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[14]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[15]  Radu State,et al.  PHom-GeM: Persistent Homology for Generative Models , 2019, 2019 6th Swiss Conference on Data Science (SDS).

[16]  Giovanni Montana,et al.  Topology-preserving augmentation for CNN-based segmentation of congenital heart defects from 3D paediatric CMR , 2019, SUSI/PIPPI@MICCAI.

[17]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[18]  Leonidas J. Guibas,et al.  A Topology Layer for Machine Learning , 2019, AISTATS.

[19]  Danielle S Bassett,et al.  The importance of the whole: Topological data analysis for the network neuroscientist , 2018, Network Neuroscience.

[20]  Herbert Edelsbrunner,et al.  Topological persistence and simplification , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[21]  Bruce Fischl,et al.  Geometrically Accurate Topology-Correction of Cortical Surfaces Using Nonseparating Loops , 2007, IEEE Transactions on Medical Imaging.

[22]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[24]  Bunyarit Uyyanonvara,et al.  Blood vessel segmentation methodologies in retinal images - A survey , 2012, Comput. Methods Programs Biomed..

[25]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[26]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[27]  Pascal Fua,et al.  Beyond the Pixel-Wise Loss for Topology-Aware Delineation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  B. Mosadegh,et al.  Cardiac 3D Printing and its Future Directions. , 2017, JACC. Cardiovascular imaging.

[29]  M. Niethammer,et al.  Connectivity-Optimized Representation Learning via Persistent Homology – Supplementary material – , 2019 .

[30]  Chao Chen,et al.  Segmenting the Papillary Muscles and the Trabeculae from High Resolution Cardiac CT through Restoration of Topological Handles , 2013, IPMI.

[31]  I. Valverde,et al.  A systematic review of image segmentation methodology, used in the additive manufacture of patient-specific 3D printed models of the cardiovascular system , 2016, JRSM cardiovascular disease.

[32]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[33]  Hugues Benoit-Cattin,et al.  Semi-supervised Learning for Segmentation Under Semantic Constraint , 2018, MICCAI.

[34]  Paul A. Yushkevich,et al.  Deformable M-Reps for 3D Medical Image Segmentation , 2003, International Journal of Computer Vision.

[35]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[36]  Ilkay Öksüz,et al.  Explicit topological priors for deep-learning based image segmentation using persistent homology , 2019, IPMI.

[37]  Jong Chul Ye,et al.  Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis , 2016, ArXiv.

[38]  Ben Glocker,et al.  Semi-supervised Learning for Network-Based Cardiac MR Image Segmentation , 2017, MICCAI.

[39]  H. Edelsbrunner,et al.  Persistent Homology — a Survey , 2022 .

[40]  Dimitris Samaras,et al.  Topology-Preserving Deep Image Segmentation , 2019, NeurIPS.

[41]  P. Matthews,et al.  UK Biobank’s cardiovascular magnetic resonance protocol , 2015, Journal of Cardiovascular Magnetic Resonance.