Dynamic MRI Reconstruction with Motion-Guided Network

Temporal correlation in dynamic magnetic resonance imaging (MRI), such as cardiac MRI, is informative and important to understand motion mechanisms of body regions. Modeling such information into the MRI reconstruction process produces temporally coherent image sequence and reduces imaging artifacts and blurring. However, existing deep learning based approaches neglect motion information during the reconstruction procedure, while traditional motion-guided methods are hindered by heuristic parameter tuning and long inference time. We propose a novel dynamic MRI reconstruction approach called MODRN that unitizes deep neural networks with motion information to improve reconstruction quality. The central idea is to decompose the motion-guided optimization problem of dynamic MRI reconstruction into three components: dynamic reconstruction, motion estimation and motion compensation. Extensive experiments have demonstrated the effectiveness of our proposed approach compared to other state-of-the-art approaches.

[1]  Daniel Rueckert,et al.  Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  Bruce R. Rosen,et al.  Image reconstruction by domain-transform manifold learning , 2017, Nature.

[4]  Dimitris N. Metaxas,et al.  MRI Reconstruction Via Cascaded Channel-Wise Attention Network , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[5]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction , 2017, IPMI.

[6]  Nicole Seiberlich,et al.  Sparse Reconstruction Techniques in Magnetic Resonance Imaging: Methods, Applications, and Challenges to Clinical Adoption , 2016, Investigative radiology.

[7]  Christopher Joseph Pal,et al.  Delving Deeper into Convolutional Networks for Learning Video Representations , 2015, ICLR.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  K. Bredies,et al.  Parallel imaging with nonlinear reconstruction using variational penalties , 2012, Magnetic resonance in medicine.

[10]  Christian Ledig,et al.  Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  A. Manduca,et al.  Local versus Global Low-Rank Promotion in Dynamic MRI Series Reconstruction , 2010 .

[12]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[13]  Chong Chen,et al.  A New Variational Model for Joint Image Reconstruction and Motion Estimation in Spatiotemporal Imaging , 2018, SIAM J. Imaging Sci..

[14]  Xiaoyi Jiang,et al.  Motion Correction in Dual Gated Cardiac PET Using Mass-Preserving Image Registration , 2012, IEEE Transactions on Medical Imaging.

[15]  Jong Chul Ye,et al.  Radial k‐t FOCUSS for high‐resolution cardiac cine MRI , 2010, Magnetic resonance in medicine.

[16]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[17]  Patrick Putzky,et al.  Recurrent inference machines for accelerated MRI reconstruction. , 2018 .

[18]  Jong Chul Ye,et al.  Improved k–t BLAST and k–t SENSE using FOCUSS , 2007, Physics in medicine and biology.

[19]  Stefan Roth,et al.  UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Loss , 2017, AAAI.

[20]  Bingbing Ni,et al.  Unsupervised Deep Learning for Optical Flow Estimation , 2017, AAAI.

[21]  Jong Chul Ye,et al.  Motion estimated and compensated compressed sensing dynamic magnetic resonance imaging: What we can learn from video compression techniques , 2010 .

[22]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[23]  Thomas Brox,et al.  End-to-End Learning of Video Super-Resolution with Motion Compensation , 2017, GCPR.

[24]  Jian Sun,et al.  Deep ADMM-Net for Compressive Sensing MRI , 2016, NIPS.

[25]  Jong Chul Ye,et al.  k‐t FOCUSS: A general compressed sensing framework for high resolution dynamic MRI , 2009, Magnetic resonance in medicine.

[26]  Mathews Jacob,et al.  Accelerated Dynamic MRI Exploiting Sparsity and Low-Rank Structure: k-t SLR , 2011, IEEE Transactions on Medical Imaging.

[27]  Michael Brady,et al.  Motion Correction and Attenuation Correction for Respiratory Gated PET Images , 2011, IEEE Transactions on Medical Imaging.