4DFlowNet: Super-Resolution 4D Flow MRI Using Deep Learning and Computational Fluid Dynamics

4D flow magnetic resonance imaging (MRI) is an emerging imaging technique where spatiotemporal 3D blood velocity can be captured with full volumetric coverage in a single non-invasive examination. This enables qualitative and quantitative analysis of hemodynamic flow parameters of the heart and great vessels. An increase in the image resolution would provide more accuracy and allow better assessment of the blood flow, especially for patients with abnormal flows. However, this must be balanced with increasing imaging time. The recent success of deep learning in generating super resolution images shows promise for implementation in medical images. We utilized computational fluid dynamics simulations to generate fluid flow simulations and represent them as synthetic 4D flow MRI data. We built our training dataset to mimic actual 4D flow MRI data with its corresponding noise distribution. Our novel 4DFlowNet network was trained on this synthetic 4D flow data and was capable in producing noise-free super resolution 4D flow phase images with upsample factor of 2. We also tested the 4DFlowNet in actual 4D flow MR images of a phantom and normal volunteer data, and demonstrated comparable results with the actual flow rate measurements giving an absolute relative error of 0.6–5.8% and 1.1–3.8% in the phantom data and normal volunteer data, respectively.

[1]  Krishna S. Nayak,et al.  Computational fluid dynamics simulations of blood flow regularized by 3D phase contrast MRI , 2015, Biomedical engineering online.

[2]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[4]  Christian Ledig,et al.  Checkerboard artifact free sub-pixel convolution: A note on sub-pixel convolution, resize convolution and convolution resize , 2017, ArXiv.

[5]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Ahmadreza Baghaie,et al.  Merging computational fluid dynamics and 4D Flow MRI using proper orthogonal decomposition and ridge regression. , 2017, Journal of biomechanics.

[7]  Verónica Vilaplana,et al.  Brain MRI super-resolution using 3D generative adversarial networks , 2018, ArXiv.

[8]  Shreyas S Vasanawala,et al.  Congenital heart disease assessment with 4D flow MRI , 2015, Journal of magnetic resonance imaging : JMRI.

[9]  Dimos Poulikakos,et al.  A study on the compliance of a right coronary artery and its impact on wall shear stress. , 2008, Journal of biomechanical engineering.

[10]  K. Ho-Shon,et al.  A comparison of 4D flow MRI-derived wall shear stress with computational fluid dynamics methods for intracranial aneurysms and carotid bifurcations - A review. , 2018, Magnetic resonance imaging.

[11]  C. C. Law,et al.  ParaView: An End-User Tool for Large-Data Visualization , 2005, The Visualization Handbook.

[12]  Paolo Crosetto,et al.  Physiological simulation of blood flow in the aorta: comparison of hemodynamic indices as predicted by 3-D FSI, 3-D rigid wall and 1-D models. , 2013, Medical engineering & physics.

[13]  A. Marsden,et al.  Intracardiac 4D Flow MRI in Congenital Heart Disease: Recommendations on Behalf of the ISMRM Flow & Motion Study Group , 2019, Journal of magnetic resonance imaging : JMRI.

[14]  Charu C. Aggarwal,et al.  Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining , 2016, KDD.

[15]  Hanspeter Pfister,et al.  A Lattice Boltzmann Simulation of Hemodynamics in a Patient-Specific Aortic Coarctation Model , 2012, STACOM.

[16]  Paul Strauss,et al.  Magnetic Resonance Imaging Physical Principles And Sequence Design , 2016 .

[17]  Tino Ebbers,et al.  Improving visualization of 4D flow cardiovascular magnetic resonance with four-dimensional angiographic data: generation of a 4D phase-contrast magnetic resonance CardioAngiography (4D PC-MRCA) , 2017, Journal of Cardiovascular Magnetic Resonance.

[18]  Claudio Chiastra,et al.  On the necessity of modelling fluid-structure interaction for stented coronary arteries. , 2014, Journal of the mechanical behavior of biomedical materials.

[19]  Wei Li,et al.  Convolutional Neural Networks for Steady Flow Approximation , 2016, KDD.

[20]  Feng Shi,et al.  Brain MRI super resolution using 3D deep densely connected neural networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[21]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Robert S. Leiken,et al.  A User’s Guide , 2011 .

[24]  Wang Ying,et al.  Quantifying errors in flow measurement using phase contrast magnetic resonance imaging: comparison of several boundary detection methods. , 2015, Magnetic resonance imaging.

[25]  M. Markl,et al.  4D flow cardiovascular magnetic resonance consensus statement , 2015, Journal of Cardiovascular Magnetic Resonance.

[26]  H. Yaku,et al.  New imaging tools in cardiovascular medicine: computational fluid dynamics and 4D flow MRI , 2017, General Thoracic and Cardiovascular Surgery.

[27]  Pankaj Garg,et al.  Clinical applications of intra-cardiac four-dimensional flow cardiovascular magnetic resonance: A systematic review , 2017, International journal of cardiology.

[28]  H. Gudbjartsson,et al.  The rician distribution of noisy mri data , 1995, Magnetic resonance in medicine.

[29]  J. Pepper,et al.  On the choice of outlet boundary conditions for patient-specific analysis of aortic flow using computational fluid dynamics. , 2017, Journal of biomechanics.

[30]  Sudharsan Madhavan,et al.  The effect of inlet and outlet boundary conditions in image-based CFD modeling of aortic flow , 2018, BioMedical Engineering OnLine.

[31]  A. Marsden,et al.  Intracardiac 4D Flow MRI in Congenital Heart Disease: Recommendations on Behalf of the ISMRM Flow & Motion Study Group , 2019, Journal of magnetic resonance imaging : JMRI.

[32]  Christof Karmonik,et al.  CFD Challenge: Predicting Patient-Specific Hemodynamics at Rest and Stress through an Aortic Coarctation , 2013, STACOM.

[33]  Christian Ledig,et al.  Is the deconvolution layer the same as a convolutional layer? , 2016, ArXiv.