Retrospective Motion Correction in Multishot MRI using Generative Adversarial Network

Multishot Magnetic Resonance Imaging (MRI) is a promising data acquisition technique that can produce a high-resolution image with relatively less data acquisition time than the standard spin echo. The downside of multishot MRI is that it is very sensitive to subject motion and even small levels of motion during the scan can produce artifacts in the final magnetic resonance (MR) image, which may result in a misdiagnosis. Numerous efforts have focused on addressing this issue; however, all of these proposals are limited in terms of how much motion they can correct and require excessive computational time. In this paper, we propose a novel generative adversarial network (GAN)-based conjugate gradient SENSE (CG-SENSE) reconstruction framework for motion correction in multishot MRI. First CG-SENSE reconstruction is employed to reconstruct an image from the motion-corrupted k -space data and then the GAN-based proposed framework is applied to correct the motion artifacts. The proposed method has been rigorously evaluated on synthetically corrupted data on varying degrees of motion, numbers of shots, and encoding trajectories. Our analyses (both quantitative as well as qualitative/visual analysis) establish that the proposed method is robust and reduces several-fold the computational time reported by the current state-of-the-art technique.

[1]  Ali N. Akansu,et al.  A class of fast Gaussian binomial filters for speech and image processing , 1991, IEEE Trans. Signal Process..

[2]  Alessandro Sorichetta,et al.  High resolution global gridded data for use in population studies , 2017, Scientific Data.

[3]  Jeffrey A. Fessler,et al.  Accelerated Regularized Estimation of MR Coil Sensitivities Using Augmented Lagrangian Methods , 2013, IEEE Transactions on Medical Imaging.

[4]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[5]  Peter Börnert,et al.  Parallel magnetic resonance imaging , 2007, Neurotherapeutics.

[6]  P. Batchelor,et al.  Matrix description of general motion correction applied to multishot images , 2005, Magnetic resonance in medicine.

[7]  J V Hajnal,et al.  Detection and elimination of motion artifacts by regeneration of k‐space , 2002, Magnetic resonance in medicine.

[8]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[9]  Wilson Fong Handbook of MRI Pulse Sequences , 2005 .

[10]  M. Zaitsev,et al.  Motion artifacts in MRI: A complex problem with many partial solutions , 2015, Journal of magnetic resonance imaging : JMRI.

[11]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[12]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[13]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[14]  Abraham Gedamu,et al.  Subject movement during multislice interleaved MR acquisitions: Prevalence and potential effect on MRI‐derived brain pathology measurements and multicenter clinical trials of therapeutics for multiple sclerosis , 2012, Journal of magnetic resonance imaging : JMRI.

[15]  Bernhard Schölkopf,et al.  Retrospective Motion Correction of Magnitude-Input MR Images , 2015, MLMMI@ICML.

[16]  Guoyan Zheng,et al.  Periacetabular osteotomy through the pararectus approach: technical feasibility and control of fragment mobility by a validated surgical navigation system in a cadaver experiment , 2016, International Orthopaedics.

[17]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[19]  Rajib Rana,et al.  Phonocardiographic Sensing Using Deep Learning for Abnormal Heartbeat Detection , 2018, IEEE Sensors Journal.

[20]  Joseph V. Hajnal,et al.  Sensitivity Encoding for Aligned Multishot Magnetic Resonance Reconstruction , 2016, IEEE Transactions on Computational Imaging.

[21]  Klaus Scheffler,et al.  Ultra-high resolution imaging of the human brain using acquisition-weighted imaging at 9.4 T , 2014, NeuroImage.

[22]  Jana Hutter,et al.  Three‐dimensional motion corrected sensitivity encoding reconstruction for multi‐shot multi‐slice MRI: Application to neonatal brain imaging , 2017, Magnetic resonance in medicine.

[23]  Walter F Block,et al.  POCS‐enhanced correction of motion artifacts in parallel MRI , 2010, Magnetic resonance in medicine.

[24]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[25]  Bernhard Schölkopf,et al.  Blind retrospective motion correction of MR images , 2012, Magnetic resonance in medicine.

[26]  Matthew A Bernstein,et al.  CHAPTER 14 – BASIC PULSE SEQUENCES , 2004 .

[27]  Bernhard Schölkopf,et al.  Blind multirigid retrospective motion correction of MR images , 2015, Magnetic resonance in medicine.

[28]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[29]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[30]  R R Edelman,et al.  Echo-planar MR imaging. , 1994, Radiology.

[31]  P. Mansfield Multi-planar image formation using NMR spin echoes , 1977 .

[32]  Hammad Omer,et al.  A graphical generalized implementation of SENSE reconstruction using Matlab , 2010 .

[33]  Vikas Gulani,et al.  Non‐Cartesian parallel imaging reconstruction , 2014, Journal of magnetic resonance imaging : JMRI.

[34]  F Godenschweger,et al.  Motion correction in MRI of the brain , 2016, Physics in medicine and biology.

[35]  Rajib Rana,et al.  Transfer Learning for Improving Speech Emotion Classification Accuracy , 2018, INTERSPEECH.

[36]  Siddique Latif,et al.  Using deep autoencoders for facial expression recognition , 2017, 2017 13th International Conference on Emerging Technologies (ICET).

[37]  P Mansfield,et al.  REAL-TIME NUCLEAR MAGNETIC RESONANCE CLINICAL IMAGING IN PAEDIATRICS , 1983, The Lancet.

[38]  Anders M. Dale,et al.  Prospective motion correction of high-resolution magnetic resonance imaging data in children , 2010, NeuroImage.

[39]  Song Han,et al.  Deep Generative Adversarial Networks for Compressed Sensing Automates MRI , 2017, ArXiv.

[40]  Konstantinos Kamnitsas,et al.  Generative adversarial networks and adversarial methods in biomedical image analysis , 2018, ArXiv.

[41]  Yu-Bin Yang,et al.  Image Restoration Using Convolutional Auto-encoders with Symmetric Skip Connections , 2016, ArXiv.

[42]  Rajib Rana,et al.  Variational Autoencoders for Learning Latent Representations of Speech Emotion , 2017, INTERSPEECH.

[43]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  S. Riederer,et al.  Analysis of T2 limitations and off‐resonance effects on spatial resolution and artifacts in echo‐planar imaging , 1990, Magnetic resonance in medicine.

[45]  Rajib Rana,et al.  Automating Motion Correction in Multishot MRI Using Generative Adversarial Networks , 2018, ArXiv.

[46]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[47]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[48]  Yoshimi Anzai,et al.  Toward Quantifying the Prevalence, Severity, and Cost Associated With Patient Motion During Clinical MR Examinations. , 2015, Journal of the American College of Radiology : JACR.

[49]  Daniel S. Falster,et al.  Corrigendum: The Coral Trait Database, a curated database of trait information for coral species from the global oceans , 2017, Scientific Data.

[50]  Arthur W. Toga,et al.  Retrospective correction of motion artifact affected structural MRI images using deep learning of simulated motion , 2018 .

[51]  P. Boesiger,et al.  Advances in sensitivity encoding with arbitrary k‐space trajectories , 2001, Magnetic resonance in medicine.