Anatomical Data Augmentation via Fluid-based Image Registration

We introduce a fluid-based image augmentation method for medical image analysis. In contrast to existing methods, our framework generates anatomically meaningful images via interpolation from the geodesic subspace underlying given samples. Our approach consists of three steps: 1) given a source image and a set of target images, we construct a geodesic subspace using the Large Deformation Diffeomorphic Metric Mapping (LDDMM) model; 2) we sample transformations from the resulting geodesic subspace; 3) we obtain deformed images and segmentations via interpolation. Experiments on brain (LPBA) and knee (OAI) data illustrate the performance of our approach on two tasks: 1) data augmentation during training and testing for image segmentation; 2) one-shot learning for single atlas image segmentation. We demonstrate that our approach generates anatomically meaningful data and improves performance on these tasks over competing approaches. Code is available at https://github.com/uncbiag/easyreg.

[1]  Nikos Paragios,et al.  AtlasNet: Multi-atlas Non-linear Deep Networks for Medical Image Segmentation , 2018, MICCAI.

[2]  Daniel L. Rubin,et al.  Differential Data Augmentation Techniques for Medical Imaging Classification Tasks , 2017, AMIA.

[3]  Yaozong Gao,et al.  ASDNet: Attention Based Semi-supervised Deep Networks for Medical Image Segmentation , 2018, MICCAI.

[4]  Michael I. Miller,et al.  Evolutions equations in computational anatomy , 2009, NeuroImage.

[5]  Michael I. Miller,et al.  Principal Component Based Diffeomorphic Surface Mapping , 2012, IEEE Transactions on Medical Imaging.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Stefan Zachow,et al.  Automated segmentation of knee bone and cartilage combining statistical shape knowledge and convolutional neural networks: Data from the Osteoarthritis Initiative , 2019, Medical Image Anal..

[8]  Serim Park,et al.  Representing and Learning High Dimensional Data with the Optimal Transport Map from a Probabilistic Viewpoint , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Ender Konukoglu,et al.  Semi-Supervised and Task-Driven Data Augmentation , 2019, IPMI.

[10]  Ronald M. Summers,et al.  Anatomy-specific classification of medical images using deep convolutional nets , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[11]  Nassir Navab,et al.  Semi-supervised Deep Learning for Fully Convolutional Networks , 2017, MICCAI.

[12]  John W. Fisher,et al.  Dreaming More Data: Class-dependent Distributions over Diffeomorphisms for Learned Data Augmentation , 2015, AISTATS.

[13]  Nassir Navab,et al.  Manifold Exploring Data Augmentation with Geometric Transformations for Increased Performance and Robustness , 2019, IPMI.

[14]  Ling Shao,et al.  Collaborative Learning of Semi-Supervised Segmentation and Classification for Medical Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  François-Xavier Vialard,et al.  Metric Learning for Image Registration , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Paul Dupuis,et al.  Variational problems on ows of di eomorphisms for image matching , 1998 .

[17]  Carlos A. Silva,et al.  Augmenting data when training a CNN for retinal vessel segmentation: How to warp? , 2017, 2017 IEEE 5th Portuguese Meeting on Bioengineering (ENBENG).

[18]  Marc Niethammer,et al.  Region-specific Diffeomorphic Metric Mapping , 2019, NeurIPS.

[19]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[20]  Daniel Rueckert,et al.  Manifold Learning for Medical Image Registration, Segmentation, and Classification , 2012 .

[21]  Marc Niethammer,et al.  Contextual Additive Networks to Efficiently Boost 3D Image Segmentations , 2018, DLMIA/ML-CDS@MICCAI.

[22]  Frédo Durand,et al.  Data augmentation using learned transforms for one-shot medical image segmentation , 2019, ArXiv.

[23]  Shuai Chen,et al.  Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentation , 2019, MICCAI.

[24]  Guido Gerig,et al.  Unbiased diffeomorphic atlas construction for computational anatomy , 2004, NeuroImage.

[25]  Erik G. Learned-Miller,et al.  Data driven image models through continuous joint alignment , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Xu Han,et al.  Networks for Joint Affine and Non-Parametric Image Registration , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Marc Niethammer,et al.  DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentation , 2019, MICCAI.

[28]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.

[29]  Ben Glocker,et al.  Semi-supervised Learning for Network-Based Cardiac MR Image Segmentation , 2017, MICCAI.

[30]  Mattias P. Heinrich,et al.  OBELISK - One Kernel to Solve Nearly Everything: Unified 3D Binary Convolutions for Image Analysis , 2018 .

[31]  P. Thomas Fletcher,et al.  Bayesian Estimation of Regularization and Atlas Building in Diffeomorphic Image Registration , 2013, IPMI.

[32]  Nassir Navab,et al.  Data Augmentation with Manifold Exploring Geometric Transformations for Increased Performance and Robustness , 2019, ArXiv.

[33]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[34]  Jeffrey L. Gunter,et al.  Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks , 2018, SASHIMI@MICCAI.

[35]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[36]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.