Diffusion-weighted and spectroscopic MRI super-resolution using sparse representations

Abstract Diffusion-weighted magnetic resonance imaging (DW-MRI) and spectroscopic MRI (MRSI) are powerful diagnostic imaging tools as they provide complementary information over conventional MRI. Imaging is done at a low-resolution (LR) as the scanning time for high-resolution (HR) MR images would be very long and not practical besides being expensive for imaging. In this paper, we propose a novel single image super-resolution (SISR) scheme to improve spatial resolution of DW and MRS images. It is based on patch-wise sparse reconstruction of HR patches from LR feature patches utilizing a pair of learned overcomplete dictionaries. Reconstruction not only exploits the sparsity of MR image but also utilize the non-local self-similarity of patches of the input LR image as prior knowledge. Experiments are done using magnitude images of DW-MRI and MRSI along with a synthetic image. Performance evaluations based on different matrices besides visual analysis are carried out to validate and compare the obtained results with the state-of-the-art. It is observed that the proposed method clearly outperforms recent methods in terms of both quantitative and visual analysis. Finally, the proposed algorithm is also implemented using the GP-GPU based parallel hardware along with sequential implementations in order to showcase its potential for real clinical applications.

[1]  Xuelong Li,et al.  Geometry constrained sparse coding for single image super-resolution , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Baoxin Li,et al.  Single Image Super Resolution Using Joint Regularization , 2018, IEEE Signal Processing Letters.

[3]  Lan Tang,et al.  Group sparsity residual constraint for image denoising with external nonlocal self-similarity prior , 2018, Neurocomputing.

[4]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[5]  Norberto Malpica,et al.  Single-image super-resolution of brain MR images using overcomplete dictionaries , 2013, Medical Image Anal..

[6]  Yaoqin Xie,et al.  An edge-directed interpolation method for fetal spine MR images , 2013, Biomedical engineering online.

[7]  Maurizio di Bisceglie,et al.  Image Registration using Non-Linear Diffusion , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[8]  Michal Irani,et al.  Separating Signal from Noise Using Patch Recurrence across Scales , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[10]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[11]  Andrew Maudsley,et al.  Improved Reconstruction for MR Spectroscopic Imaging , 2007, IEEE Transactions on Medical Imaging.

[12]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[13]  Michael Elad,et al.  A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution , 2014, IEEE Transactions on Image Processing.

[14]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[15]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[16]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Baoxin Li,et al.  Single image super-resolution using collaborative representation and non-local self-similarity , 2018, Signal Process..

[18]  David Zhang,et al.  Patch Group Based Nonlocal Self-Similarity Prior Learning for Image Denoising , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Di Zhang,et al.  Brain MR image super-resolution reconstruction via sparse representation and non-local similarity regularisation , 2014 .

[20]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[21]  Truong Q. Nguyen,et al.  Single Image Super-Resolution Using Local Geometric Duality and Non-Local Similarity , 2016, IEEE Transactions on Image Processing.

[22]  Sabine Van Huffel,et al.  Patch-Based Super-Resolution of MR Spectroscopic Images: Application to Multiple Sclerosis , 2017, Front. Neurosci..

[23]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[24]  Filiberto Pla,et al.  Single-frame super-resolution in remote sensing: a practical overview , 2017 .

[25]  Eric Van Reeth,et al.  Super-resolution in magnetic resonance imaging: A review , 2012 .

[26]  Di Zhang,et al.  MR image super-resolution reconstruction using sparse representation, nonlocal similarity and sparse derivative prior , 2015, Comput. Biol. Medicine.

[27]  Bhabesh Deka,et al.  Sparse Representation Based Super-Resolution of MRI Images with Non-Local Total Variation Regularization , 2019, PReMI.

[28]  D. Shen,et al.  LRTV: MR Image Super-Resolution With Low-Rank and Total Variation Regularizations , 2015, IEEE Transactions on Medical Imaging.

[29]  Wiro J Niessen,et al.  Super‐resolution methods in MRI: Can they improve the trade‐off between resolution, signal‐to‐noise ratio, and acquisition time? , 2012, Magnetic resonance in medicine.