End-to-End AI-based MRI Reconstruction and Lesion Detection Pipeline for Evaluation of Deep Learning Image Reconstruction

Deep learning techniques have emerged as a promising approach to highly accelerated MRI. However, recent reconstruction challenges have shown several drawbacks in current deep learning approaches, including the loss of fine image details even using models that perform well in terms of global quality metrics. In this study, we propose an end-to-end deep learning framework for image reconstruction and pathology detection, which enables a clinically aware evaluation of deep learning reconstruction quality. The solution is demonstrated for a use case in detecting meniscal tears on knee MRI studies, ultimately finding a loss of fine image details with common reconstruction methods expressed as a reduced ability to detect important pathology like meniscal tears. Despite the common practice of quantitative reconstruction methodology evaluation with metrics such as SSIM, impaired pathology detection as an automated pathology-based reconstruction evaluation approach suggests existing quantitative methods do not capture clinically important reconstruction outcomes.

[1]  Aaron Defazio,et al.  End-to-End Variational Networks for Accelerated MRI Reconstruction , 2020, MICCAI.

[2]  Florian Knoll,et al.  fastMRI+: Clinical Pathology Annotations for Knee and Brain Fully Sampled Multi-Coil MRI Data , 2021, ArXiv.

[3]  Steen Moeller,et al.  Deep-Learning Methods for Parallel Magnetic Resonance Imaging Reconstruction: A Survey of the Current Approaches, Trends, and Issues , 2020, IEEE Signal Processing Magazine.

[4]  Lars Kasper,et al.  CG‐SENSE revisited: Results from the first ISMRM reproducibility challenge , 2020, Magnetic Resonance in Medicine.

[5]  Michael G. Rabbat,et al.  Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge , 2020, Magnetic resonance in medicine.

[6]  Daniel Rueckert,et al.  A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction , 2017, IEEE Transactions on Medical Imaging.

[7]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[8]  Dong Liang,et al.  Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks , 2020, IEEE Signal Processing Magazine.

[9]  Michael Schacht Hansen,et al.  Gadgetron: An open source framework for medical image reconstruction , 2013, Magnetic resonance in medicine.

[10]  Steen Moeller,et al.  Self‐supervised learning of physics‐guided reconstruction neural networks without fully sampled reference data , 2019, Magnetic resonance in medicine.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Jeffrey A. Fessler,et al.  Optimization Methods for Magnetic Resonance Image Reconstruction: Key Models and Optimization Algorithms , 2020, IEEE Signal Processing Magazine.

[13]  Pascal Vincent,et al.  fastMRI: An Open Dataset and Benchmarks for Accelerated MRI , 2018, ArXiv.

[14]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[15]  Thomas Pock,et al.  Learning a variational network for reconstruction of accelerated MRI data , 2017, Magnetic resonance in medicine.

[16]  Mathews Jacob,et al.  MoDL: Model-Based Deep Learning Architecture for Inverse Problems , 2017, IEEE Transactions on Medical Imaging.

[17]  Robin M Heidemann,et al.  Generalized autocalibrating partially parallel acquisitions (GRAPPA) , 2002, Magnetic resonance in medicine.

[18]  Leslie Ying,et al.  Accelerating magnetic resonance imaging via deep learning , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[19]  Peter Kellman,et al.  Distributed MRI reconstruction using gadgetron‐based cloud computing , 2015, Magnetic resonance in medicine.

[20]  Doug,et al.  ultralytics/yolov5: v5.0 - YOLOv5-P6 1280 models, AWS, Supervise.ly and YouTube integrations , 2021 .

[21]  Jean-Luc Starck,et al.  Results of the 2020 fastMRI Challenge for Machine Learning MR Image Reconstruction , 2021, IEEE Transactions on Medical Imaging.