Fast single image super-resolution using estimated low-frequency k-space data in MRI.

PURPOSE Single image super-resolution (SR) is highly desired in many fields but obtaining it is often technically limited in practice. The purpose of this study was to propose a simple, rapid and robust single image SR method in magnetic resonance (MR) imaging (MRI). METHODS The idea is based on the mathematical formulation of the intrinsic link in k-space between a given (modulus) low-resolution (LR) image and the desired SR image. The method consists of two steps: 1) estimating the low-frequency k-space data of the desired SR image from a single LR image; 2) reconstructing the SR image using the estimated low-frequency and zero-filled high-frequency k-space data. The method was evaluated on digital phantom images, physical phantom MR images and real brain MR images, and compared with existing SR methods. RESULTS The proposed SR method exhibited a good robustness by reaching a clearly higher PSNR (25.77dB) and SSIM (0.991) averaged over different noise levels in comparison with existing edge-guided nonlinear interpolation (EGNI) (PSNR=23.78dB, SSIM=0.983), zero-filling (ZF) (PSNR=24.09dB, SSIM=0.985) and total variation (TV) (PSNR=24.54dB, SSIM=0.987) methods while presenting the same order of computation time as the ZF method but being much faster than the EGNI or TV method. The average PSNR or SSIM over different slice images of the proposed method (PSNR=26.33 dB or SSIM=0.955) was also higher than the EGNI (PSNR=25.07dB or SSIM=0.952), ZF (PSNR=24.97dB or SSIM=0.950) and TV (PSNR=25.70dB or SSIM=0.953) methods, demonstrating its good robustness to variation in anatomical structure of the images. Meanwhile, the proposed method always produced less ringing artifacts than the ZF method, gave a clearer image than the EGNI method, and did not exhibit any blocking effect presented in the TV method. In addition, the proposed method yielded the highest spatial consistency in the inter-slice dimension among the four methods. CONCLUSIONS This study proposed a fast, robust and efficient single image SR method with high spatial consistency in the inter-slice dimension for clinical MR images by estimating the low-frequency k-space data of the desired SR image from a single spatial modulus LR image.

[1]  Truong Q. Nguyen,et al.  Markov Random Field Model-Based Edge-Directed Image Interpolation , 2007, IEEE Transactions on Image Processing.

[2]  Ting-Zhu Huang,et al.  Single-Image Super-Resolution via an Iterative Reproducing Kernel Hilbert Space Method , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Rong Li,et al.  Extracting contrast-filled vessels in X-ray angiography by graduated RPCA with motion coherency constraint , 2017, Pattern Recognit..

[4]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[5]  Wiro J Niessen,et al.  Super‐resolution methods in MRI: Can they improve the trade‐off between resolution, signal‐to‐noise ratio, and acquisition time? , 2012, Magnetic resonance in medicine.

[6]  Truong Q. Nguyen,et al.  Novel Example-Based Method for Super-Resolution and Denoising of Medical Images , 2014, IEEE Transactions on Image Processing.

[7]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[8]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[9]  Zheng Wang,et al.  SRLSP: A Face Image Super-Resolution Algorithm Using Smooth Regression With Local Structure Prior , 2017, IEEE Transactions on Multimedia.

[10]  Norberto Malpica,et al.  Single-image super-resolution of brain MR images using overcomplete dictionaries , 2013, Medical Image Anal..

[11]  Carl-Fredrik Westin,et al.  A joint compressed-sensing and super-resolution approach for very high-resolution diffusion imaging , 2016, NeuroImage.

[12]  John F. Roddick,et al.  Sparse representation-based MRI super-resolution reconstruction , 2014 .

[13]  Xuelong Li,et al.  Learning Multiple Linear Mappings for Efficient Single Image Super-Resolution , 2015, IEEE Transactions on Image Processing.

[14]  Stefan Ropele,et al.  Super‐resolution MRI using microscopic spatial modulation of magnetization , 2010, Magnetic resonance in medicine.

[15]  Jin Hyung Kim,et al.  Efficient Learning of Image Super-Resolution and Compression Artifact Removal with Semi-Local Gaussian Processes , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Xavier Bresson,et al.  An efficient total variation algorithm for super-resolution in fetal brain MRI with adaptive regularization , 2015, NeuroImage.

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[18]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Truong Q. Nguyen,et al.  Single Image Superresolution Based on Gradient Profile Sharpness , 2015, IEEE Transactions on Image Processing.

[20]  Dinggang Shen,et al.  Brain atlas fusion from high-thickness diagnostic magnetic resonance images by learning-based super-resolution , 2017, Pattern Recognit..

[21]  Paul C. Lauterbur,et al.  Principles of magnetic resonance imaging : a signal processing perspective , 1999 .

[22]  Binjie Qin,et al.  Structure matching driven by joint-saliency-structure adaptive kernel regression , 2016, Appl. Soft Comput..

[23]  Xinbo Gao,et al.  Image super-resolution using non-local Gaussian process regression , 2016, Neurocomputing.

[24]  Hartwig R. Siebner,et al.  Interpolation of diffusion weighted imaging datasets , 2014, NeuroImage.

[25]  Eduardo Romero,et al.  A sparse Bayesian representation for super-resolution of cardiac MR images. , 2017, Magnetic resonance imaging.

[26]  D. Shen,et al.  LRTV: MR Image Super-Resolution With Low-Rank and Total Variation Regularizations , 2015, IEEE Transactions on Medical Imaging.

[27]  Di Zhang,et al.  MR image super-resolution reconstruction using sparse representation, nonlocal similarity and sparse derivative prior , 2015, Comput. Biol. Medicine.

[28]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[29]  Xiaoqiang Lu,et al.  MR image super-resolution via manifold regularized sparse learning , 2015, Neurocomputing.

[30]  Xinbo Gao,et al.  Single image super-resolution using regularization of non-local steering kernel regression , 2016, Signal Process..

[31]  D. Louis Collins,et al.  Non-local MRI upsampling , 2010, Medical Image Anal..

[32]  Thomas B. Moeslund,et al.  Super-resolution: a comprehensive survey , 2014, Machine Vision and Applications.

[33]  Olivier Clatz,et al.  Non-rigid alignment of pre-operative MRI, fMRI, and DT-MRI with intra-operative MRI for enhanced visualization and navigation in image-guided neurosurgery , 2007, NeuroImage.