Isotropic Reconstruction of MR Images Using 3D Patch-Based Self-Similarity Learning

Isotropic three-dimensional (3D) acquisition is a challenging task in magnetic resonance imaging (MRI). Particularly in cardiac MRI, due to hardware and time limitations, current 3D acquisitions are limited by low-resolution, especially in the through-plane direction, leading to poor image quality in that dimension. To overcome this problem, super-resolution (SR) techniques have been proposed to reconstruct a single isotropic 3D volume from multiple anisotropic acquisitions. Previously, local regularization techniques such as total variation have been applied to limit noise amplification while preserving sharp edges and small features in the images. In this paper, inspired by the recent progress in patch-based reconstruction, we propose a novel isotropic 3D reconstruction scheme that integrates non-local and self-similarity information from 3D patch neighborhoods. By grouping 3D patches with similar structures, we enforce the natural sparsity of MR images, which can be expressed by a low-rank structure, leading to robust image reconstruction with high signal-to-noise ratio efficiency. An Augmented Lagrangian formulation of the problem is proposed to efficiently decompose the optimization into a low-rank volume denoising and a SR reconstruction. Experimental results in simulations, brain imaging and clinical cardiac MRI, demonstrate that the proposed joint SR and self-similarity learning framework outperforms current state-of-the-art methods. The proposed reconstruction of isotropic 3D volumes may be particularly useful for cardiac applications, such as myocardial infarction scar assessment by late gadolinium enhancement MRI.

[1]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[2]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[3]  W. Stevenson,et al.  Characterization of the Peri-Infarct Zone by Contrast-Enhanced Cardiac Magnetic Resonance Imaging Is a Powerful Predictor of Post–Myocardial Infarction Mortality , 2006, Circulation.

[4]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[5]  Tevfik F Ismail,et al.  Accelerated free‐breathing whole‐heart 3D T2 mapping with high isotropic resolution , 2019, Magnetic resonance in medicine.

[6]  Maxime Sermesant,et al.  Impact of New Technologies and Approaches for Post–Myocardial Infarction Ventricular Tachycardia Ablation During Long-Term Follow-Up , 2016, Circulation. Arrhythmia and electrophysiology.

[7]  Colin Studholme,et al.  Registration-based approach for reconstruction of high-resolution in utero fetal MR brain images. , 2006, Academic radiology.

[8]  Gwendoline Blanchet,et al.  An explicit sharpness index related to global phase coherence , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[9]  Andrea Mazzanti,et al.  [2015 ESC Guidelines for the management of patients with ventricular arrhythmias and the prevention of sudden cardiac death]. , 2015, Kardiologia polska.

[10]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[11]  René M. Botnar,et al.  Five‐minute whole‐heart coronary MRA with sub‐millimeter isotropic resolution, 100% respiratory scan efficiency, and 3D‐PROST reconstruction , 2018, Magnetic resonance in medicine.

[12]  Vahid Tarokh,et al.  Low‐dimensional‐structure self‐learning and thresholding: Regularization beyond compressed sensing for MRI Reconstruction , 2011, Magnetic resonance in medicine.

[13]  Nicholas Ayache,et al.  Integration of Merged Delayed‐Enhanced Magnetic Resonance Imaging and Multidetector Computed Tomography for the Guidance of Ventricular Tachycardia Ablation: A Pilot Study , 2013, Journal of cardiovascular electrophysiology.

[14]  Ning Zhang,et al.  Localizing the critical isthmus of postinfarct ventricular tachycardia: the value of pace-mapping during sinus rhythm. , 2014, Heart rhythm.

[15]  Henry R. Halperin,et al.  Quantitative Assessment of Single-Image Super-Resolution in Myocardial Scar Imaging , 2014, IEEE Journal of Translational Engineering in Health and Medicine.

[16]  Rachid Deriche,et al.  The use of super‐resolution techniques to reduce slice thickness in functional MRI , 2004, Int. J. Imaging Syst. Technol..

[17]  Maxime Descoteaux,et al.  Collaborative patch-based super-resolution for diffusion-weighted images , 2013, NeuroImage.

[18]  Y. Raghavender Rao,et al.  Super-Resolution Reconstruction for Cardiac MRI using Coupled Dictionary Learning , 2016 .

[19]  Daniel Rueckert,et al.  Super-resolution reconstruction of cardiac MRI using coupled dictionary learning , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[20]  Freddy Odille,et al.  Motion-Corrected, Super-Resolution Reconstruction for High-Resolution 3D Cardiac Cine MRI , 2015, MICCAI.

[21]  Juha Koikkalainen,et al.  Segmentation of Cardiac Structures Simultaneously from Short- and Long-Axis MR Images , 2004, MICCAI.

[22]  Freddy Odille,et al.  Isotropic 3D cardiac cine MRI allows efficient sparse segmentation strategies based on 3D surface reconstruction , 2018, Magnetic resonance in medicine.

[23]  Katja Zeppenfeld,et al.  Infarct Tissue Heterogeneity Assessed With Contrast-Enhanced MRI Predicts Spontaneous Ventricular Arrhythmia in Patients With Ischemic Cardiomyopathy and Implantable Cardioverter-Defibrillator , 2009, Circulation. Cardiovascular imaging.

[24]  René M. Botnar,et al.  High‐dimensionality undersampled patch‐based reconstruction (HD‐PROST) for accelerated multi‐contrast MRI , 2019, Magnetic resonance in medicine.

[25]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[26]  Oleh Dzyubachyk,et al.  Super‐resolution reconstruction of late gadolinium‐enhanced MRI for improved myocardial scar assessment , 2015, Journal of magnetic resonance imaging : JMRI.

[27]  D. Shen,et al.  LRTV: MR Image Super-Resolution With Low-Rank and Total Variation Regularizations , 2015, IEEE Transactions on Medical Imaging.

[28]  Tim Smith,et al.  Effectiveness of prophylactic implantation of cardioverter-defibrillators without cardiac resynchronization therapy in patients with ischaemic or non-ischaemic heart disease: a systematic review and meta-analysis , 2010, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[29]  Jan Sijbers,et al.  Super‐resolution reconstruction of diffusion parameters from diffusion‐weighted images with different slice orientations , 2016, Magnetic resonance in medicine.

[30]  D. Louis Collins,et al.  Non-local MRI upsampling , 2010, Medical Image Anal..

[31]  D. Callans,et al.  Risk Stratification for Ventricular Arrhythmias and Scd Role of Cardiac Magnetic Resonance Imaging in the Management and Treatment of Ventricular Tachycardia in Patients with Structural Heart Disease , 2022 .

[32]  D. Louis Collins,et al.  MRI Superresolution Using Self-Similarity and Image Priors , 2010, Int. J. Biomed. Imaging.

[33]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[34]  Wiro J Niessen,et al.  Super‐resolution methods in MRI: Can they improve the trade‐off between resolution, signal‐to‐noise ratio, and acquisition time? , 2012, Magnetic resonance in medicine.

[35]  Daniel Rueckert,et al.  Cardiac Image Super-Resolution with Global Correspondence Using Multi-Atlas PatchMatch , 2013, MICCAI.

[36]  Freddy Odille,et al.  Electroanatomic characterization of post-infarct scars comparison with 3-dimensional myocardial scar reconstruction based on magnetic resonance imaging. , 2008, Journal of the American College of Cardiology.

[37]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[38]  Konstantinos Kamnitsas,et al.  Multi-input Cardiac Image Super-Resolution Using Convolutional Neural Networks , 2016, MICCAI.

[39]  Simon K. Warfield,et al.  Robust Super-Resolution Volume Reconstruction From Slice Acquisitions: Application to Fetal Brain MRI , 2010, IEEE Transactions on Medical Imaging.