3D MRI image super-resolution for brain combining rigid and large diffeomorphic registration

Most of the recent leading multiple magnetic resonance imaging (MRI) super-resolution techniques for brain are limited to rigid motion. In this study, the authors aim to develop a super-resolution technique with diffeomorphism mainly for longitudinal brain MRI data. For the images from different time slots, unpredicted deformation may occur. In previous studies, sole rigid registration or traditional non-rigid registration has been frequently used to achieve multi-plane super-resolution. However, non-rigid motion of two brains from different time slots is difficult to model, since brain contains a wealth of complex structure such as the cerebral cortex. In order to address such problem, rigid and large diffeomorphic registration has been embedded into their super-resolution framework. In addition, many previous researchers use L 2 norm to achieve super-resolution framework. In this work, L 1 norm minimisation and regularisation based on a bilateral prior are adopted. These operations ensure its robustness to the assumed model of data and noise. Their approach is evaluated using Alzheimer datasets from seven different resolutions. Results show that their reconstructions have advantages over rigid and conventional non-rigid registration-based super-resolution, in terms of the root-mean-square error and structure similarity. Furthermore, their reconstruction results improve the precision of brain automatic segmentation.

[1]  Norberto Malpica,et al.  Single-image super-resolution of brain MR images using overcomplete dictionaries , 2013, Medical Image Anal..

[2]  Kim-Hui Yap,et al.  Multi-frame super-resolution from observations with zooming motion , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Jianya Gong,et al.  POCS Super-Resolution Sequence Image Reconstruction Based on Improvement Approach of Keren Registration Method , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[4]  Vladimir Fonov,et al.  Prediction of Alzheimer's disease in subjects with mild cognitive impairment from the ADNI cohort using patterns of cortical thinning , 2013, NeuroImage.

[5]  Yoshiaki Shishikui,et al.  Motion-adaptive sub-Nyquist sampling technique for multi-frame super-resolution , 2012, 2012 Picture Coding Symposium.

[6]  Michael I. Miller,et al.  Landmark matching on brain surfaces via large deformation diffeomorphisms on the sphere , 1999, Medical Imaging.

[7]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[8]  N. Alon,et al.  Resolution enhancement in MRI. , 2006, Magnetic resonance imaging.

[9]  Robert B. Fisher,et al.  Special issue on animal and insect behaviour understanding in image sequences , 2015, EURASIP J. Image Video Process..

[10]  A. N. Rajagopalan,et al.  Joint multi-frame super-resolution and matting , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[11]  Marie Chupin,et al.  Automatic classi fi cation of patients with Alzheimer ' s disease from structural MRI : A comparison of ten methods using the ADNI database , 2010 .

[12]  Arno Klein,et al.  Large-scale evaluation of ANTs and FreeSurfer cortical thickness measurements , 2014, NeuroImage.

[13]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[14]  Zheng Luo,et al.  A POCS super-resolution image reconstruction based on the projection residue , 2012, International Conference on Machine Vision.

[15]  Peter L. Choyke,et al.  Registration of time-series contrast enhanced magnetic resonance images for renography , 2001, Proceedings 14th IEEE Symposium on Computer-Based Medical Systems. CBMS 2001.

[16]  Russell M. Mersereau,et al.  A Super-Resolution Framework for 3-D High-Resolution and High-Contrast Imaging Using 2-D Multislice MRI , 2009, IEEE Transactions on Medical Imaging.

[17]  Stefan Ropele,et al.  Super‐resolution MRI using microscopic spatial modulation of magnetization , 2010, Magnetic resonance in medicine.

[18]  Stefan Wesarg,et al.  Combining short-axis and long-axis cardiac MR images by applying a super-resolution reconstruction algorithm , 2010, Medical Imaging.

[19]  J. Y. Goulermas,et al.  A comparison of seven methods of within-subjects rigid-body pedobarographic image registration. , 2008, Journal of biomechanics.

[20]  Xiaoying Tang,et al.  Multi-Contrast Multi-Atlas Parcellation of Diffusion Tensor Imaging of the Human Brain , 2014, PloS one.

[21]  Daniel Rueckert,et al.  Random forest-based similarity measures for multi-modal classification of Alzheimer's disease , 2013, NeuroImage.

[22]  Michael Elad,et al.  Multiframe demosaicing and super-resolution from undersampled color images , 2004, IS&T/SPIE Electronic Imaging.

[23]  Dinggang Shen,et al.  Longitudinal Guided Super-Resolution Reconstruction of Neonatal Brain MR Images , 2014, STIA.

[24]  John Ashburner,et al.  A fast diffeomorphic image registration algorithm , 2007, NeuroImage.

[25]  Richard Z. Shilling,et al.  Sampling strategies for super-resolution in multi-slice MRI , 2008, 2008 15th IEEE International Conference on Image Processing.

[26]  Freddy Odille,et al.  Motion-Corrected, Super-Resolution Reconstruction for High-Resolution 3D Cardiac Cine MRI , 2015, MICCAI.

[27]  Cher Heng Tan,et al.  Deformable Registration-Based Super-resolution for Isotropic Reconstruction of 4-D MRI Volumes , 2017, IEEE Journal of Biomedical and Health Informatics.

[28]  Jerry L. Prince,et al.  Reconstruction of High-Resolution Tongue Volumes From MRI , 2012, IEEE Transactions on Biomedical Engineering.

[29]  Purang Abolmaesumi,et al.  Point-Based Rigid-Body Registration Using an Unscented Kalman Filter , 2007, IEEE Transactions on Medical Imaging.

[30]  Said Raghay,et al.  A combined total variation and bilateral filter approach for image robust super resolution , 2015, EURASIP J. Image Video Process..

[31]  Eric Van Reeth,et al.  Super-resolution in magnetic resonance imaging: A review , 2012 .

[32]  Sabine Van Huffel,et al.  Patch-Based Super-Resolution of MR Spectroscopic Images: Application to Multiple Sclerosis , 2017, Front. Neurosci..

[33]  Liangpei Zhang,et al.  Multiframe Super-Resolution Employing a Spatially Weighted Total Variation Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[35]  Liangpei Zhang,et al.  A locally adaptive L1-L2 norm for multi-frame super-resolution of images with mixed noise and outliers , 2014, Signal Process..

[36]  Wiro J Niessen,et al.  Super‐resolution methods in MRI: Can they improve the trade‐off between resolution, signal‐to‐noise ratio, and acquisition time? , 2012, Magnetic resonance in medicine.

[37]  Onur Afacan,et al.  3D Super‐Resolution Motion‐Corrected MRI: Validation of Fetal Posterior Fossa Measurements , 2016, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[38]  Rachid Deriche,et al.  The use of super‐resolution techniques to reduce slice thickness in functional MRI , 2004, Int. J. Imaging Syst. Technol..

[39]  Xiaoying Tang,et al.  Evaluation of Cross-Protocol Stability of a Fully Automated Brain Multi-Atlas Parcellation Tool , 2015, PloS one.

[40]  Paul A. Rodríguez,et al.  Total Variation Regularization Algorithms for Images Corrupted with Different Noise Models: A Review , 2013, J. Electr. Comput. Eng..

[41]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[42]  Manuel Desco,et al.  Use of IBASPM atlas-based automatic segmentation toolbox in pathological brains: Effect of template selection , 2008, 2008 IEEE Nuclear Science Symposium Conference Record.

[43]  S Peled,et al.  Superresolution in MRI: Application to human white matter fiber tract visualization by diffusion tensor imaging , 2001, Magnetic resonance in medicine.

[44]  John F. Roddick,et al.  Sparse representation-based MRI super-resolution reconstruction , 2014 .

[45]  Can Ceritoglu,et al.  Diffeomorphic brain mapping based on T1‐weighted images: Improvement of registration accuracy by multichannel mapping , 2013, Journal of magnetic resonance imaging : JMRI.

[46]  Yücel Altunbasak,et al.  Artifact reduction for POCS-based super resolution with edge adaptive regularization and higher-order interpolants , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[47]  Colin Studholme,et al.  On Super-Resolution for Fetal Brain MRI , 2010, MICCAI.

[48]  Edmund Y. Lam,et al.  Application of Tikhonov Regularization to Super-Resolution Reconstruction of Brain MRI Images , 2007, MIMI.

[49]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[50]  Colin Studholme,et al.  Registration-based approach for reconstruction of high-resolution in utero fetal MR brain images. , 2006, Academic radiology.

[51]  Xiaohai He,et al.  Video superresolution reconstruction based on subpixel registration and iterative back projection , 2009, J. Electronic Imaging.

[52]  Subhashis Banerjee,et al.  Space-Time Super-Resolution Using Graph-Cut Optimization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Hayit Greenspan,et al.  MRI inter-slice reconstruction using super-resolution , 2002 .