MR image super-resolution via manifold regularized sparse learning

Single image super-resolution (SR) has been shown useful in Magnetic Resonance (MR) image based diagnosis, where the image resolution is still limited. The basic goal of single image SR is to produce a high-resolution (HR) image from corresponding low-resolution (LR) image. However, most existing SR algorithms often fail to: (1) reflect the intrinsic structure between MR images and (2) exploit the intra-patient information of MR images. In fact, MR images are more likely to vary along a low dimensional submanifold, which can be embedded in the high dimensional space. It has also been shown that the structure information of MR images and the priors of the MR images of different modality are important for improving the image resolution. To take full advantage of manifold structure information and intra-patient prior of MR images, a novel single image super-resolution algorithm for MR images is proposed in this paper. Compared with the existing works, the proposed algorithm has the following merits: (1) the proposed sparse coding based algorithm integrates manifold constraints to handle the inverse problem in MR image SR; (2) the manifold structure of the intra-patient MR image is considered for image SR; and (3) the topological structure of the intra-patient MR image can be preserved to improve the reconstructed result. Experiments show that the proposed algorithm is more effective than the state-of-the-art algorithms.

[1]  Kilian Q. Weinberger,et al.  Learning a kernel matrix for nonlinear dimensionality reduction , 2004, ICML.

[2]  Mark J. T. Smith,et al.  A New Method for Registration-Based Medical Image Interpolation , 2008, IEEE Transactions on Medical Imaging.

[3]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[4]  Dacheng Tao,et al.  Multi-View Intact Space Learning , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[6]  Bo Du,et al.  Random-Selection-Based Anomaly Detector for Hyperspectral Imagery , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Simon K. Warfield,et al.  Robust Super-Resolution Volume Reconstruction From Slice Acquisitions: Application to Fetal Brain MRI , 2010, IEEE Transactions on Medical Imaging.

[8]  Manjunath V. Joshi,et al.  A learning-based method for image super-resolution from zoomed observations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[10]  Markus Flierl,et al.  Graph-Preserving Sparse Nonnegative Matrix Factorization With Application to Facial Expression Recognition , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[12]  Varsha H. Patil Super Resolution in Medical Imaging for An Automated Proficient Process , 2006 .

[13]  B. S. Manjunath,et al.  Multisensor Image Fusion Using the Wavelet Transform , 1995, CVGIP Graph. Model. Image Process..

[14]  Xuelong Li,et al.  Discriminant Locally Linear Embedding With High-Order Tensor Data , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[16]  Sheng Chen,et al.  Sparse modeling using orthogonal forward regression with PRESS statistic and regularization , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[19]  Hayit Greenspan,et al.  Super-Resolution in Medical Imaging , 2009, Comput. J..

[20]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[21]  Bo Du,et al.  A Discriminative Metric Learning Based Anomaly Detection Method , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Lixin Shen,et al.  Multiframe Super-Resolution Reconstruction Using Sparse Directional Regularization , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Alan C. Evans,et al.  BrainWeb: Online Interface to a 3D MRI Simulated Brain Database , 1997 .

[24]  Xuelong Li,et al.  Principal Component 2-D Long Short-Term Memory for Font Recognition on Single Chinese Characters , 2016, IEEE Transactions on Cybernetics.

[25]  Bo Du,et al.  Target detection based on a dynamic subspace , 2014, Pattern Recognit..

[26]  Mei Han,et al.  Soft Edge Smoothness Prior for Alpha Channel Super Resolution , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale l1-Regularized Logistic Regression , 2007, J. Mach. Learn. Res..

[28]  N. Alon,et al.  Resolution enhancement in MRI. , 2006, Magnetic resonance imaging.

[29]  P Bharanee,et al.  RESOLUTION ENHANCEMENT IN MRI VIDEO SEQUENCE USING MODIFIED , 2014 .

[30]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[31]  Chun Chen,et al.  Graph Regularized Sparse Coding for Image Representation , 2011, IEEE Transactions on Image Processing.

[32]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[33]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Alan Connelly,et al.  Track-density imaging (TDI): Super-resolution white matter imaging using whole-brain track-density mapping , 2010, NeuroImage.

[35]  Mei Han,et al.  SoftCuts: A Soft Edge Smoothness Prior for Color Image Super-Resolution , 2009, IEEE Transactions on Image Processing.

[36]  Dacheng Tao,et al.  Large-Margin Multi-ViewInformation Bottleneck , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[38]  Intermodality Priors A Non-local Approach for Image Super-Resolution using , 2010 .