Automatic measurement plane placement for 4D Flow MRI of the great vessels using deep learning

Purpose Despite the great potential and flexibility of 4D flow MRI for hemodynamic analysis, a major limitation is the need for time-consuming and user-dependent post-processing. We propose a fast four-step algorithm for rapid, robust, and repeatable flow measurements in the great vessels based on automatic placement of measurement planes and vessel segmentation. Methods Our algorithm works by (1) subsampling the 3D image into 3D patches, (2) predicting the probability of each patch containing individual vessels and location/orientation of the vessel within the patch via a convolutional neural network, (3) selecting the predicted planes with highest probabilities for each vessel, and (4) shifting the plane centers to the maximum velocity within each plane. The method was trained on 283 scans and evaluated on 40 unseen scans by comparing algorithm-derived processing times, plane locations, and flow measurements to those of two manual observers (graduate students) using t-tests, Pearson correlation, and Bland–Altman analysis. Results The average processing time for the algorithm (18 s) was shorter than observer 1 (362 s; P  < 0.001) and observer 2 (317 s; P  < 0.001). The distance between planes placed by the algorithm and those placed by manual observers was slightly greater (O1 vs. algorithm: 9.0 mm, O2 vs. algorithm: 10.3 mm) than the distance between planes placed by the two manual observers (8.3 mm). The correlation between flow values for planes placed by the algorithm and those placed by manual observers was slightly lower (O1 vs. algorithm: R  = 0.68, O2 vs. algorithm: R  = 0.72) than the flow correlation between the two manual observers ( R  = 0.81). Conclusion Our method is a feasible and accurate approach for fast, reproducible, and automated flow measurement and visualization in 4D flow MRI of the great vessels, with similar variability compared to a manual annotator as the variability between two manual observers. This approach could be applied in other anatomical regions.

[1]  Marcel Breeuwer,et al.  Interactive Virtual Probing of 4D MRI Blood-Flow , 2011, IEEE Transactions on Visualization and Computer Graphics.

[2]  Michael Markl,et al.  4D flow MRI , 2012, Journal of magnetic resonance imaging : JMRI.

[3]  F. Korosec,et al.  PC VIPR: a high-speed 3D phase-contrast method for flow quantification and high-resolution angiography. , 2005, AJNR. American journal of neuroradiology.

[4]  M. Lustig,et al.  Venous and arterial flow quantification are equally accurate and precise with parallel imaging compressed sensing 4D phase contrast MRI , 2013, Journal of magnetic resonance imaging : JMRI.

[5]  Ben Glocker,et al.  Stratified Decision Forests for Accurate Anatomical Landmark Localization in Cardiac Images , 2017, IEEE Transactions on Medical Imaging.

[6]  J. Hennig,et al.  Quantitative 2D and 3D phase contrast MRI: Optimized analysis of blood flow and vessel wall parameters , 2008, Magnetic resonance in medicine.

[7]  D. Rueckert,et al.  Stratified Decision Forests for Accurate Anatomical Landmark Localization in Cardiac Images. , 2017, IEEE transactions on medical imaging.

[8]  M. Markl,et al.  4D flow cardiovascular magnetic resonance consensus statement , 2015, Journal of Cardiovascular Magnetic Resonance.

[9]  Petter Dyverfeldt,et al.  Atlas-based analysis of 4D flow CMR: Automated vessel segmentation and flow quantification , 2015, Journal of Cardiovascular Magnetic Resonance.

[10]  Tom Schaul,et al.  Dueling Network Architectures for Deep Reinforcement Learning , 2015, ICML.

[11]  Kevin M Johnson,et al.  Quantification of Thoracic Blood Flow Using Volumetric Magnetic Resonance Imaging With Radial Velocity Encoding: In Vivo Validation , 2013, Investigative radiology.

[12]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[13]  Evan M Masutani,et al.  Deep Learning-based Prescription of Cardiac MRI Planes. , 2019, Radiology. Artificial intelligence.

[14]  M. Markl,et al.  Longitudinal Evaluation of Aortic Hemodynamics in Marfan Syndrome: New Insights from a 4D Flow Cardiovascular Magnetic Resonance Multi-Year Follow-Up Study , 2017, Journal of Cardiovascular Magnetic Resonance.

[15]  Kevin M. Johnson,et al.  Longitudinal Monitoring of Hepatic Blood Flow before and after TIPS by Using 4D-Flow MR Imaging. , 2016, Radiology.

[16]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Vikas Gupta,et al.  Automated multi‐atlas segmentation of cardiac 4D flow MRI , 2018, Medical Image Anal..

[18]  Sebastian Schmitter,et al.  4D Flow MRI , 2018 .

[19]  M. Alley,et al.  Bicuspid Aortic Valve : Four-dimensional MR Evaluation of Ascending Aortic Systolic Flow Patterns 1 , 2010 .

[20]  Kecheng Liu,et al.  A review on MR vascular image processing algorithms: acquisition and prefiltering: part I , 2002, IEEE Transactions on Information Technology in Biomedicine.

[21]  Oliver Wieben,et al.  Fast 4D flow MRI intracranial segmentation and quantification in tortuous arteries , 2015, Journal of magnetic resonance imaging : JMRI.

[22]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[23]  Huy Nguyen,et al.  Automated segmentation of blood-flow regions in large thoracic arteries using 3D-cine PC-MRI measurements , 2012, International Journal of Computer Assisted Radiology and Surgery.

[24]  Michael B. Scott,et al.  Fully automated 3D aortic segmentation of 4D flow MRI for hemodynamic analysis using deep learning , 2020, Magnetic resonance in medicine.

[25]  Loïc Le Folgoc,et al.  Evaluating reinforcement learning agents for anatomical landmark detection , 2019, Medical Image Anal..

[26]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[27]  M. Markl,et al.  Comprehensive 4D velocity mapping of the heart and great vessels by cardiovascular magnetic resonance , 2011, Journal of cardiovascular magnetic resonance : official journal of the Society for Cardiovascular Magnetic Resonance.

[28]  David Saloner,et al.  Clinical evaluation of aortic coarctation with 4D flow MR imaging , 2010, Journal of magnetic resonance imaging : JMRI.