Unsupervised Adversarial Correction of Rigid MR Motion Artifacts

Motion is one of the main sources for artifacts in magnetic resonance (MR) images. It can have significant consequences on the diagnostic quality of the resultant scans. Previously, supervised adversarial approaches have been suggested for the correction of MR motion artifacts. However, these approaches suffer from the limitation of required paired co-registered datasets for training which are often hard or impossible to acquire. Building upon our previous work, we introduce a new adversarial framework with a new generator architecture and loss function for the unsupervised correction of severe rigid motion artifacts in the brain region. Quantitative and qualitative comparisons with other supervised and unsupervised translation approaches showcase the enhanced performance of the introduced framework.

[1]  Yuichi Yoshida,et al.  Spectral Normalization for Generative Adversarial Networks , 2018, ICLR.

[2]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[4]  David Atkinson,et al.  Accelerated motion corrected three‐dimensional abdominal MRI using total variation regularized SENSE reconstruction , 2015, Magnetic resonance in medicine.

[5]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[6]  Bin Yang,et al.  Retrospective correction of motion‐affected MR images using deep learning frameworks , 2019, Magnetic resonance in medicine.

[7]  O. Speck,et al.  Prospective Real-Time Slice-by-Slice Motion Correction for fMRI in Freely Moving Subjects , 2006, Magnetic Resonance Materials in Physics, Biology and Medicine.

[8]  Thierry Blu,et al.  MR‐based respiratory and cardiac motion correction for PET imaging , 2017, Medical Image Anal..

[9]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[10]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[11]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Li Fei-Fei,et al.  Perceptual Losses for Real-Time Style Transfer and Super-Resolution , 2016, ECCV.

[13]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[14]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[15]  Bin Yang,et al.  MedGAN: Medical Image Translation using GANs , 2018, Comput. Medical Imaging Graph..

[16]  Bin Yang,et al.  Unsupervised Medical Image Translation Using Cycle-MedGAN , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[17]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[18]  K. T. Block,et al.  Undersampled radial MRI with multiple coils. Iterative image reconstruction using a total variation constraint , 2007, Magnetic resonance in medicine.

[19]  Petros Martirosian,et al.  Self‐navigated 4D cartesian imaging of periodic motion in the body trunk using partial k‐space compressed sensing , 2017, Magnetic resonance in medicine.

[20]  Kwang In Kim,et al.  Improving Shape Deformation in Unsupervised Image-to-Image Translation , 2018, ECCV.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Dinggang Shen,et al.  Non-rigid Brain MRI Registration Using Two-stage Deep Perceptive Networks. , 2018, Proceedings of the International Society for Magnetic Resonance in Medicine ... Scientific Meeting and Exhibition. International Society for Magnetic Resonance in Medicine. Scientific Meeting and Exhibition.

[23]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Markus Henningsson,et al.  Highly efficient nonrigid motion‐corrected 3D whole‐heart coronary vessel wall imaging , 2016, Magnetic resonance in medicine.

[25]  Sergios Gatidis,et al.  Retrospective Correction Of Rigid And Non-Rigid MR Motion Artifacts Using Gans , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[26]  David Atkinson,et al.  Automatic correction of motion artifacts in magnetic resonance images using an entropy focus criterion , 1997, IEEE Transactions on Medical Imaging.

[27]  Trevor Darrell,et al.  Adversarial Feature Learning , 2016, ICLR.

[28]  M. Zaitsev,et al.  Motion artifacts in MRI: A complex problem with many partial solutions , 2015, Journal of magnetic resonance imaging : JMRI.

[29]  Leon A. Gatys,et al.  Image Style Transfer Using Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).