A persistent homology-based topological loss for CNN-based multi-class segmentation of CMR

Multi-class segmentation of cardiac magnetic resonance (CMR) images seeks a separation of data into anatomical components with known structure and configuration. The most popular CNN-based methods are optimised using pixel wise loss functions, ignorant of the spatially extended features that characterise anatomy. Therefore, whilst sharing a high spatial overlap with the ground truth, inferred CNN-based segmentations can lack coherence, including spurious connected components, holes and voids. Such results are implausible, violating anticipated anatomical topology. In response, (single-class) persistent homologybased loss functions have been proposed to capture global anatomical features. Our work extends these approaches to the task of multi-class segmentation. Building an enriched topological description of all class labels and class label pairs, our loss functions make predictable and statistically significant improvements in segmentation topology using a CNN-based post-processing framework. We also present (and make available) a highly efficient implementation based on cubical complexes and parallel execution, enabling practical application within high resolution 3D data for the first time. We demonstrate our approach on 2D short axis and 3D whole heart CMR segmentation, advancing a detailed and faithful analysis of performance on two publicly available datasets.

[1]  David B. A. Epstein,et al.  Persistent Homology for Fast Tumor Segmentation in Whole Slide Histology Images , 2016, MIUA.

[2]  Polina Golland,et al.  A topological encoding convolutional neural network for segmentation of 3D multiphoton images of brain vasculature using persistent homology , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Valeriu Vrabie,et al.  Homology functionality for grayscale image segmentation , 2016 .

[4]  Ronald M. Summers,et al.  Deep Small Bowel Segmentation with Cylindrical Topological Constraints , 2020, MICCAI.

[5]  Xiahai Zhuang,et al.  MvMM-RegNet: A new image registration framework based on multivariate mixture model and neural network estimation , 2020, MICCAI.

[6]  Ilkay Öksüz,et al.  A Topological Loss Function for Deep-Learning Based Image Segmentation Using Persistent Homology , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Konstantinos Kamnitsas,et al.  Anatomically Constrained Neural Networks (ACNNs): Application to Cardiac Image Enhancement and Segmentation , 2017, IEEE Transactions on Medical Imaging.

[8]  Ilkay Öksüz,et al.  Explicit topological priors for deep-learning based image segmentation using persistent homology , 2019, IPMI.

[9]  Mustafa Hajij,et al.  TDA-Net: Fusion of Persistent Homology and Deep Learning Features for COVID-19 Detection From Chest X-Ray Images , 2021, 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[10]  David Anderson,et al.  Three-dimensional printed models for surgical planning of complex congenital heart defects: an international multicentre study , 2017, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[11]  Daniel Rueckert,et al.  Automatic 3D bi-ventricular segmentation of cardiac images by a shape-refined multi-task deep learning approach , 2018, IEEE Transactions on Medical Imaging.

[12]  D. Rueckert,et al.  Deep Learning for Cardiac Image Segmentation: A Review , 2019, Frontiers in Cardiovascular Medicine.

[13]  Pierre-Louis Bazin,et al.  Digital Homeomorphisms in Deformable Registration , 2007, IPMI.

[14]  Leonidas J. Guibas,et al.  A Topology Layer for Machine Learning , 2019, AISTATS.

[15]  Olivier Gevaert,et al.  Topological image modification for object detection and topological image processing of skin lesions , 2020, Scientific Reports.

[16]  Hugues Benoit-Cattin,et al.  Semi-supervised Learning for Segmentation Under Semantic Constraint , 2018, MICCAI.

[17]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[18]  G. Montana,et al.  A persistent homology-based topological loss function for multi-class CNN segmentation of cardiac MRI , 2020, M&Ms and EMIDEC/STACOM@MICCAI.

[19]  Marc Pollefeys,et al.  Uncertainty Quantification in CNN-Based Surface Prediction Using Shape Priors , 2018, ShapeMI@MICCAI.

[20]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[21]  Marc Niethammer,et al.  Connectivity-Optimized Representation Learning via Persistent Homology , 2019, ICML.

[22]  Klaus H. Maier-Hein,et al.  nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation , 2018, Bildverarbeitung für die Medizin.

[23]  Xin Yang,et al.  Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? , 2018, IEEE Transactions on Medical Imaging.

[24]  Dimitris Samaras,et al.  Topology-Preserving Deep Image Segmentation , 2019, NeurIPS.

[25]  Andreas Uhl,et al.  Deep Learning with Topological Signatures , 2017, NIPS.

[26]  Qian Wang,et al.  Automatic Heart and Vessel Segmentation Using Random Forests and a Local Phase Guided Level Set Method , 2016, RAMBO+HVSMR@MICCAI.

[27]  Jian Zhuang,et al.  ImageCHD: A 3D Computed Tomography Image Dataset for Classification of Congenital Heart Disease , 2020, MICCAI.

[28]  I. Valverde,et al.  A systematic review of image segmentation methodology, used in the additive manufacture of patient-specific 3D printed models of the cardiovascular system , 2016, JRSM cardiovascular disease.

[29]  Vanessa Robins,et al.  Duality in Persistent Homology of Images , 2020, ArXiv.

[30]  Gustavo Carneiro,et al.  Combining deep learning and level set for the automated segmentation of the left ventricle of the heart from cardiac cine magnetic resonance , 2017, Medical Image Anal..

[31]  Dimitris N. Metaxas,et al.  Few-Shot Learning by a Cascaded Framework With Shape-Constrained Pseudo Label Assessment for Whole Heart Segmentation , 2021, IEEE Transactions on Medical Imaging.

[32]  Sébastien Ourselin,et al.  Multi-atlas Propagation Whole Heart Segmentation from MRI and CTA Using a Local Normalised Correlation Coefficient Criterion , 2013, FIMH.

[33]  Maria Drangova,et al.  Subject-specific models for image-guided cardiac surgery , 2008, Physics in medicine and biology.

[34]  Peter A. Calabresi,et al.  Fully Convolutional Boundary Regression for Retina OCT Segmentation , 2019, MICCAI.

[35]  Olivier Bernard,et al.  Cardiac MRI Segmentation with Strong Anatomical Guarantees , 2019, MICCAI.

[36]  Ghassan Hamarneh,et al.  Topology Aware Fully Convolutional Networks for Histology Gland Segmentation , 2016, MICCAI.

[37]  Wenjia Bai,et al.  Fully Automated, Quality-Controlled Cardiac Analysis From CMR: Validation and Large-Scale Application to Characterize Cardiac Function , 2019, JACC. Cardiovascular imaging.

[38]  Mason A. Porter,et al.  A roadmap for the computation of persistent homology , 2015, EPJ Data Science.

[39]  Guang Yang,et al.  Evaluation of algorithms for Multi-Modality Whole Heart Segmentation: An open-access grand challenge , 2019, Medical Image Anal..

[40]  Ben Glocker,et al.  Automated cardiovascular magnetic resonance image analysis with fully convolutional networks , 2017, Journal of Cardiovascular Magnetic Resonance.

[41]  Kazushi Ahara,et al.  Cubical Ripser: Software for computing persistent homology of image and volume data , 2020, ArXiv.