Registration Based Data Augmentation for Multiple Sclerosis Lesion Segmentation

Deep learning has shown outstanding performance on various computer vision tasks such as image segmentation. To take advantage of deep learning in image segmentation, one would need a huge amount of annotated data since deep learning models are data-intensive. One of the main challenges of using deep learning methods in the medical domain is the shortage of available annotated data. To tackle this problem, in this paper, we propose a registration based framework for augmenting multiple sclerosis datasets. In this framework, by registering images of two different patients, we create a new image, which smoothly adds lesions from the first patient into a brain image, structured like the second patient. Due to their nature, multiple sclerosis lesions vary in shape, size, location and number of occurrence, thus registering images of two different subjects, will create a realistic image. The proposed method is capable of introducing diversity to data distribution, which other traditional augmentation methods do not offer. To check the effectiveness of our proposed method, we compare the performance of 3D-Unet on different augmented and non-augmented datasets. Experimental results indicate that the best performance is achieved when combining both the proposed method with traditional augmentation techniques.

[1]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[2]  A. Ardeshir Goshtasby,et al.  2-D and 3-D Image Registration: for Medical, Remote Sensing, and Industrial Applications , 2005 .

[3]  Mengxiao Hu,et al.  Exploring Bias in GAN-based Data Augmentation for Small Samples , 2019, ArXiv.

[4]  Sander Dieleman,et al.  Rotation-invariant convolutional neural networks for galaxy morphology prediction , 2015, ArXiv.

[5]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[6]  Hayit Greenspan,et al.  Synthetic data augmentation using GAN for improved liver lesion classification , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[9]  Peter A. Calabresi,et al.  Multiple Sclerosis Lesion Segmentation from Brain MRI via Fully Convolutional Neural Networks , 2018, ArXiv.

[10]  Steven Euijong Whang,et al.  A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective , 2018, IEEE Transactions on Knowledge and Data Engineering.

[11]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[12]  K. Ramesh,et al.  Review on 2D and 3D MRI Image Segmentation Techniques. , 2019, Current medical imaging reviews.

[13]  Frédo Durand,et al.  Data augmentation using learned transforms for one-shot medical image segmentation , 2019, ArXiv.

[14]  Egor Krivov,et al.  MRI Augmentation via Elastic Registration for Brain Lesions Segmentation , 2017, BrainLes@MICCAI.

[15]  Vijayan K. Asari,et al.  The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches , 2018, ArXiv.

[16]  Xavier Lladó,et al.  Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review , 2017, Artif. Intell. Medicine.

[17]  Alex Rovira,et al.  Improving automated multiple sclerosis lesion segmentation with a cascaded 3D convolutional neural network approach , 2017, NeuroImage.

[18]  B. Efron.  The jackknife, the bootstrap, and other resampling plans , 1987 .

[19]  Snehashis Roy,et al.  Longitudinal multiple sclerosis lesion segmentation: Resource and challenge , 2017, NeuroImage.

[20]  R. Merjulah,et al.  Segmentation technique for medical image processing: A survey , 2017, 2017 International Conference on Inventive Computing and Informatics (ICICI).