Single-image super-resolution of brain MR images using overcomplete dictionaries

Resolution in Magnetic Resonance (MR) is limited by diverse physical, technological and economical considerations. In conventional medical practice, resolution enhancement is usually performed with bicubic or B-spline interpolations, strongly affecting the accuracy of subsequent processing steps such as segmentation or registration. This paper presents a sparse-based super-resolution method, adapted for easily including prior knowledge, which couples up high and low frequency information so that a high-resolution version of a low-resolution brain MR image is generated. The proposed approach includes a whole-image multi-scale edge analysis and a dimensionality reduction scheme, which results in a remarkable improvement of the computational speed and accuracy, taking nearly 26 min to generate a complete 3D high-resolution reconstruction. The method was validated by comparing interpolated and reconstructed versions of 29 MR brain volumes with the original images, acquired in a 3T scanner, obtaining a reduction of 70% in the root mean squared error, an increment of 10.3 dB in the peak signal-to-noise ratio, and an agreement of 85% in the binary gray matter segmentations. The proposed method is shown to outperform a recent state-of-the-art algorithm, suggesting a substantial impact in voxel-based morphometry studies.

[1]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[2]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[3]  Russell M. Mersereau,et al.  A Super-Resolution Framework for 3-D High-Resolution and High-Contrast Imaging Using 2-D Multislice MRI , 2009, IEEE Transactions on Medical Imaging.

[4]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[5]  Hayit Greenspan,et al.  Super-Resolution in Medical Imaging , 2009, Comput. J..

[6]  François Rousseau,et al.  Brain Hallucination , 2008, ECCV.

[7]  N. Alon,et al.  Resolution enhancement in MRI. , 2006, Magnetic resonance imaging.

[8]  E. Kholmovski,et al.  Acquisition and reconstruction of undersampled radial data for myocardial perfusion magnetic resonance imaging , 2009, Journal of magnetic resonance imaging : JMRI.

[9]  Gabriel Peyré,et al.  Sparse Modeling of Textures , 2009, Journal of Mathematical Imaging and Vision.

[10]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[11]  小野 道夫,et al.  Atlas of the Cerebral Sulci , 1990 .

[12]  Yoram Bresler,et al.  MR Image Reconstruction From Highly Undersampled k-Space Data by Dictionary Learning , 2011, IEEE Transactions on Medical Imaging.

[13]  David Capel,et al.  Image Mosaicing and Super-resolution , 2004, Distinguished Dissertations.

[14]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[15]  P. Yger,et al.  An Optimized Blockwise Non Local Means Denoising Filter for 3D Magnetic Resonance Images , 2007 .

[16]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[17]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Hayit Greenspan,et al.  MRI inter-slice reconstruction using super-resolution , 2002 .

[19]  P. Jaccard,et al.  Etude comparative de la distribution florale dans une portion des Alpes et des Jura , 1901 .

[20]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[21]  Bruno A. Olshausen,et al.  Principles of Image Representation in Visual Cortex , 2003 .

[22]  J. C. Ye,et al.  Projection reconstruction MR imaging using FOCUSS , 2007, Magnetic resonance in medicine.

[23]  Pierrick Coupé,et al.  3D Wavelet Subbands Mixing for Image Denoising , 2008, Int. J. Biomed. Imaging.

[24]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[25]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Habib Zaidi,et al.  On the V-Line Radon Transform and Its Imaging Applications , 2010, Int. J. Biomed. Imaging.

[27]  Nicholas Ayache,et al.  Medical Image Analysis: Progress over Two Decades and the Challenges Ahead , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[29]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[30]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[31]  A Herment,et al.  Local reconstruction of stenosed sections of artery using multiple MRA acquisitions , 2003, Magnetic resonance in medicine.

[32]  D. Louis Collins,et al.  Non-local MRI upsampling , 2010, Medical Image Anal..

[33]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[34]  S Peled,et al.  Superresolution in MRI: Application to human white matter fiber tract visualization by diffusion tensor imaging , 2001, Magnetic resonance in medicine.

[35]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[36]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[37]  M. Gatz,et al.  The Alzheimer's disease knowledge test. , 1988, The Gerontologist.

[38]  Neuropsychological and imaging (MR) biomarkers in the early detection of Mild Cognitive Impairment ( , 2009 .

[39]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[40]  Arthur W. Toga,et al.  MRI resolution enhancement using total variation regularization , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[41]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[42]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[43]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[44]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[45]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[46]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[47]  D. Louis Collins,et al.  MRI Superresolution Using Self-Similarity and Image Priors , 2010, Int. J. Biomed. Imaging.

[48]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[49]  François Rousseau,et al.  A non-local approach for image super-resolution using intermodality priors , 2010, Medical Image Anal..

[50]  Thomas Hofmann,et al.  Probabilistic Latent Semantic Analysis , 1999, UAI.

[51]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[52]  C. Jack,et al.  Alzheimer's Disease Neuroimaging Initiative , 2008 .