Probabilistic Atlases to Enforce Topological Constraints

Probabilistic atlases (PAs) have long been used in standard segmentation approaches and, more recently, in conjunction with Convolutional Neural Networks (CNNs). However, their use has been restricted to relatively standardized structures such as the brain or heart which have limited or predictable range of deformations. Here we propose an encoding-decoding CNN architecture that can exploit rough atlases that encode only the topology of the target structures that can appear in any pose and have arbitrarily complex shapes to improve the segmentation results. It relies on the output of the encoder to compute both the pose parameters used to deform the atlas and the segmentation mask itself, which makes it effective and end-to-end trainable.

[1]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[2]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[3]  Jianbo Shi,et al.  Unsupervised Learning of Important Objects from First-Person Videos , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[4]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[5]  Timo Dickscheid,et al.  Improving Cytoarchitectonic Segmentation of Human Brain Areas with Self-supervised Siamese Networks , 2018, MICCAI.

[6]  Peter H. Li,et al.  High-Precision Automated Reconstruction of Neurons with Flood-filling Networks , 2017 .

[7]  Aggelos K. Katsaggelos,et al.  Efficient Video Object Segmentation via Network Modulation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[8]  Timo Dickscheid,et al.  Parcellation of visual cortex on high-resolution histological brain sections using convolutional neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[9]  Shunxing Bao,et al.  Spatially Localized Atlas Network Tiles Enables 3D Whole Brain Segmentation from Limited Data , 2018, MICCAI.

[10]  Sébastien Ourselin,et al.  A Probabilistic Model Combining Deep Learning and Multi-atlas Segmentation for Semi-automated Labelling of Histology , 2018, MICCAI.

[11]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Henggui Zhang,et al.  VoxelAtlasGAN: 3D Left Ventricle Segmentation on Echocardiography with Atlas Guided Generation and Voxel-to-voxel Discrimination , 2018, MICCAI.

[13]  Frédo Durand,et al.  Synthesizing Images of Humans in Unseen Poses , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Stefan Heldmann,et al.  Enhancing Label-Driven Deep Deformable Image Registration with Local Distance Metrics for State-of-the-Art Cardiac Motion Tracking , 2018, Bildverarbeitung für die Medizin.

[15]  Nassir Navab,et al.  Hashing-Based Atlas Ranking and Selection for Multiple-Atlas Segmentation , 2018, MICCAI.