Improved cortical surface reconstruction using sub-millimeter resolution MPRAGE by image denoising

Automatic cerebral cortical surface reconstruction is a useful tool for cortical anatomy quantification, analysis and visualization. Recently, the Human Connectome Project and several studies have shown the advantages of using T1-weighted magnetic resonance (MR) images with sub-millimeter isotropic spatial resolution instead of the standard 1-millimeter isotropic resolution for improved accuracy of cortical surface positioning and thickness estimation. Nonetheless, sub-millimeter resolution images are noisy by nature and require averaging multiple repetitions to increase the signal-to-noise ratio for precisely delineating the cortical boundary. The prolonged acquisition time and potential motion artifacts pose significant barriers to the wide adoption of cortical surface reconstruction at sub-millimeter resolution for a broad range of neuroscientific and clinical applications. We address this challenge by evaluating the cortical surface reconstruction resulting from denoised single-repetition sub-millimeter T1-weighted images. We systematically characterized the effects of image denoising on empirical data acquired at 0.6 mm isotropic resolution using three classical denoising methods, including denoising convolutional neural network (DnCNN), block-matching and 4-dimensional filtering (BM4D) and adaptive optimized non-local means (AONLM). The denoised single-repetition images were found to be highly similar to 6-repetition averaged images, with a low whole-brain averaged mean absolute difference of ∼0.016, high whole-brain averaged peak signal-to-noise ratio of ∼33.5 dB and structural similarity index of 0.92, and minimal gray matter–white matter contrast loss (2% to 9%). The whole-brain mean absolute discrepancies in gray–white surface placement, gray–CSF surface placement and cortical thickness estimation were lower than 165 μm, 155 μm and 145 μm—sufficiently accurate for most applications. The denoising performance is equivalent to averaging ∼2.5 repetitions of the data in terms of image similarity, and 1.6–2.2 repetitions in terms of the cortical surface placement accuracy. The scan-rescan precision of the cortical surface positioning and thickness estimation was lower than 170 μm. Our unique dataset and systematic characterization support the use of denoising methods for improved cortical surface reconstruction sub-millimeter resolution.

[1]  D. V. van Essen,et al.  Mapping Human Cortical Areas In Vivo Based on Myelin Content as Revealed by T1- and T2-Weighted MRI , 2011, The Journal of Neuroscience.

[2]  OsherStanley,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[3]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[4]  Andreas Engvig,et al.  Effects of memory training on cortical thickness in the elderly , 2010, NeuroImage.

[5]  L. Wald,et al.  Wave‐CAIPI for highly accelerated MP‐RAGE imaging , 2018, Magnetic resonance in medicine.

[6]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[7]  K. Setsompop,et al.  Evaluation of Ultrafast Wave-CAIPI MPRAGE for Visual Grading and Automated Measurement of Brain Tissue Volume , 2020, American Journal of Neuroradiology.

[8]  L. Ying,et al.  Accelerating SENSE using compressed sensing , 2009, Magnetic resonance in medicine.

[9]  M. Kitajima,et al.  Deep Learning Based Noise Reduction for Brain MR Imaging: Tests on Phantoms and Healthy Volunteers , 2019, Magnetic resonance in medical sciences : MRMS : an official journal of Japan Society of Magnetic Resonance in Medicine.

[10]  Pierre-Louis Bazin,et al.  Homeomorphic brain image segmentation with topological and statistical atlases , 2008, Medical Image Anal..

[11]  Justin P. Haldar,et al.  Low-Rank Modeling of Local $k$-Space Neighborhoods (LORAKS) for Constrained MRI , 2014, IEEE Transactions on Medical Imaging.

[12]  F. D. Lange,et al.  Selective Activation of the Deep Layers of the Human Primary Visual Cortex by Top-Down Feedback , 2016, Current Biology.

[13]  S. Rauch,et al.  Meditation experience is associated with increased cortical thickness , 2005, Neuroreport.

[14]  Kawin Setsompop,et al.  DeepDTI: High-fidelity six-direction diffusion tensor imaging using deep learning , 2020, NeuroImage.

[15]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[16]  André J. W. van der Kouwe,et al.  Quantitative comparison of cortical surface reconstructions from MP2RAGE and multi-echo MPRAGE data at 3 and 7T , 2014, NeuroImage.

[17]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[18]  Oliver Speck,et al.  T1-weighted in vivo human whole brain MRI dataset with an ultrahigh isotropic resolution of 250 μm , 2017, Scientific Data.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  David G. Norris,et al.  Diffusion tensor characteristics of gyrencephaly using high resolution diffusion MRI in vivo at 7T , 2015, NeuroImage.

[21]  Jose V. Manjon,et al.  MRI denoising using Deep Learning and Non-local averaging , 2019, ArXiv.

[22]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  Kenji Ito,et al.  Intensity inhomogeneity correction for magnetic resonance imaging of human brain at 7T. , 2014, Medical physics.

[25]  Michael Elad,et al.  Calibrationless parallel imaging reconstruction based on structured low‐rank matrix completion , 2013, Magnetic resonance in medicine.

[26]  Bruce Fischl,et al.  Avoiding asymmetry-induced bias in longitudinal image processing , 2011, NeuroImage.

[27]  P. Batchelor,et al.  International Society for Magnetic Resonance in Medicine , 1997 .

[28]  L. Wald,et al.  A 64‐channel 3T array coil for accelerated brain MRI , 2013, Magnetic resonance in medicine.

[29]  J. McNab,et al.  Multi‐shot diffusion‐weighted MRI reconstruction with magnitude‐based spatial‐angular locally low‐rank regularization (SPA‐LLR) , 2020, Magnetic resonance in medicine.

[30]  F Godenschweger,et al.  Motion correction in MRI of the brain , 2016, Physics in medicine and biology.

[31]  Ben Jeurissen,et al.  The role of whole‐brain diffusion MRI as a tool for studying human in vivo cortical segregation based on a measure of neurite density , 2018, Magnetic resonance in medicine.

[32]  B. J. Anderson,et al.  Alterations in the thickness of motor cortical subregions after motor-skill learning and exercise. , 2002, Learning & memory.

[33]  Julia M. Huntenburg,et al.  Nighres: processing tools for high-resolution neuroimaging , 2018, GigaScience.

[34]  Xinwei Shi,et al.  RUN‐UP: Accelerated multishot diffusion‐weighted MRI reconstruction using an unrolled network with U‐Net as priors , 2020, Magnetic resonance in medicine.

[35]  Oliver Speck,et al.  Prospective motion correction in brain imaging: A review , 2013, Magnetic resonance in medicine.

[36]  Jingwei Zhuo,et al.  P‐LORAKS: Low‐rank modeling of local k‐space neighborhoods with parallel imaging data , 2016, Magnetic resonance in medicine.

[37]  Nikos Makris,et al.  Automatically parcellating the human cerebral cortex. , 2004, Cerebral cortex.

[38]  Essa Yacoub,et al.  The Lifespan Human Connectome Project in Aging: An overview , 2019, NeuroImage.

[39]  Kawin Setsompop,et al.  Wave‐CAIPI for highly accelerated 3D imaging , 2015, Magnetic resonance in medicine.

[40]  Michael Koenigs,et al.  Cortical thinning in psychopathy. , 2012, The American journal of psychiatry.

[41]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  K. Uğurbil,et al.  Layer-Specific fMRI Reflects Different Neuronal Computations at Different Depths in Human V1 , 2012, PloS one.

[43]  Lawrence L. Wald,et al.  Surface based analysis of diffusion orientation for identifying architectonic domains in the in vivo human cortex , 2013, NeuroImage.

[44]  Lei Zhang,et al.  Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising , 2016, IEEE Transactions on Image Processing.

[45]  Natalia Petridou,et al.  Lines of Baillarger in vivo and ex vivo: Myelin contrast across lamina at 7T MRI and histology , 2016, NeuroImage.

[46]  Thomas E. Nichols,et al.  Joint Analysis of Cortical Area and Thickness as a Replacement for the Analysis of the Volume of the Cerebral Cortex , 2017, Cerebral cortex.

[47]  Jaakko Lehtinen,et al.  Noise2Noise: Learning Image Restoration without Clean Data , 2018, ICML.

[48]  Julien Cohen-Adad,et al.  In vivo evidence of disseminated subpial T2* signal changes in multiple sclerosis at 7T: A surface-based analysis , 2011, NeuroImage.

[49]  J. Pauly,et al.  Deep learning enables reduced gadolinium dose for contrast‐enhanced brain MRI , 2018, Journal of magnetic resonance imaging : JMRI.

[50]  Oliver Speck,et al.  Erratum: T1-weighted in vivo human whole brain MRI dataset with an ultrahigh isotropic resolution of 250 μm , 2017, Scientific Data.

[51]  Sébastien Ourselin,et al.  Global image registration using a symmetric block-matching approach , 2014, Journal of medical imaging.

[52]  Lawrence L. Wald,et al.  Laminar analysis of 7T BOLD using an imposed spatial activation pattern in human V1 , 2010, NeuroImage.

[53]  Steen Moeller,et al.  The Human Connectome Project's neuroimaging approach , 2016, Nature Neuroscience.

[54]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  Pierrick Coupé,et al.  Author manuscript, published in "Journal of Magnetic Resonance Imaging 2010;31(1):192-203" DOI: 10.1002/jmri.22003 Adaptive Non-Local Means Denoising of MR Images with Spatially Varying Noise Levels , 2010 .

[56]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[57]  Anders M. Dale,et al.  Cortical Surface-Based Analysis I. Segmentation and Surface Reconstruction , 1999, NeuroImage.

[58]  André J. W. van der Kouwe,et al.  Brain morphometry with multiecho MPRAGE , 2008, NeuroImage.

[59]  M. Dylan Tisdall,et al.  Motion-corrected 350 μ m isotropic MPRAGE at 3 T using volumetric navigators ( vNavs ) , 2012 .

[60]  John M Pauly,et al.  Ultra-Low-Dose 18F-Florbetaben Amyloid PET Imaging Using Deep Learning with Multi-Contrast MRI Inputs. , 2019, Radiology.

[61]  Alan C. Evans,et al.  Neuroanatomical correlates of musicianship as revealed by cortical thickness and voxel-based morphometry. , 2009, Cerebral cortex.

[62]  Uwe Aickelin,et al.  Tailored RF pulse for magnetization inversion at ultrahigh field , 2010, Magnetic resonance in medicine.

[63]  Himanshu Bhat,et al.  Multiple Echo and Inversion Time MPRAGE with Inner Loop GRAPPA Acceleration and Prospective Motion Correction for Minimally Distorted Multispectral Brain Morphometry , 2013 .

[64]  Alan C. Evans,et al.  Focal decline of cortical thickness in Alzheimer's disease identified by computational neuroanatomy. , 2004, Cerebral cortex.

[65]  Tammy Riklin-Raviv,et al.  Ensemble of expert deep neural networks for spatio‐temporal denoising of contrast‐enhanced MRI sequences , 2017, Medical Image Anal..

[66]  Meritxell Bach Cuadra,et al.  A Surface-Based Approach to Quantify Local Cortical Gyrification , 2008, IEEE Transactions on Medical Imaging.

[67]  Bruce Fischl,et al.  Learning an Integral Equation Approximation to Nonlinear Anisotropic Diffusion in Image Processing , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[68]  Anders M. Dale,et al.  Reliability of MRI-derived measurements of human cerebral cortical thickness: The effects of field strength, scanner upgrade and manufacturer , 2006, NeuroImage.

[69]  Bruce Fischl,et al.  Highly accurate inverse consistent registration: A robust approach , 2010, NeuroImage.

[70]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[71]  Robert Turner,et al.  Do the congenitally blind have a stria of Gennari? First intracortical insights in vivo. , 2010, Cerebral cortex.

[72]  N. Schuff,et al.  Different regional patterns of cortical thinning in Alzheimer's disease and frontotemporal dementia. , 2006, Brain : a journal of neurology.

[73]  Oliver Speck,et al.  Cortical thickness determination of the human brain using high resolution 3T and 7T MRI data , 2013, NeuroImage.

[74]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[75]  Xiao Han,et al.  CRUISE: Cortical reconstruction using implicit surface evolution , 2004, NeuroImage.

[76]  Karen O. Egiazarian,et al.  Nonlocal Transform-Domain Filter for Volumetric Data Denoising and Reconstruction , 2013, IEEE Transactions on Image Processing.

[77]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[78]  Bruce Fischl,et al.  Within-subject template estimation for unbiased longitudinal image analysis , 2012, NeuroImage.

[79]  Kawin Setsompop,et al.  Wave‐LORAKS: Combining wave encoding with structured low‐rank matrix modeling for more highly accelerated 3D imaging , 2018, Magnetic resonance in medicine.

[80]  Shahin Nasr,et al.  Interdigitated Color- and Disparity-Selective Columns within Human Visual Cortical Areas V2 and V3 , 2016, The Journal of Neuroscience.

[81]  Abhay Patil,et al.  Learning Image Restoration without Clean Data , 2019 .

[82]  Leon Axel,et al.  Combination of Compressed Sensing and Parallel Imaging for Highly-Accelerated 3 D First-Pass Cardiac Perfusion MRI , 2009 .

[83]  Pierrick Coupé,et al.  An Optimized Blockwise Nonlocal Means Denoising Filter for 3-D Magnetic Resonance Images , 2008, IEEE Transactions on Medical Imaging.

[84]  Loic A. Royer,et al.  Content-aware image restoration: pushing the limits of fluorescence microscopy , 2018, Nature Methods.

[85]  Sheng Zhong,et al.  Two-Stage Convolutional Neural Network for Medical Noise Removal via Image Decomposition , 2020, IEEE Transactions on Instrumentation and Measurement.

[86]  Jennifer A McNab,et al.  Motion‐robust reconstruction of multishot diffusion‐weighted images without phase estimation through locally low‐rank regularization , 2018, Magnetic resonance in medicine.

[87]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[88]  Alan C. Evans,et al.  Automated 3-D extraction and evaluation of the inner and outer cortical surfaces using a Laplacian map and partial volume effect classification , 2005, NeuroImage.

[89]  A. Dale,et al.  Focal thinning of the cerebral cortex in multiple sclerosis. , 2003, Brain : a journal of neurology.

[90]  Hui Zhang,et al.  Neurite imaging reveals microstructural variations in human cerebral cortical gray matter , 2018, NeuroImage.

[91]  Sébastien Ourselin,et al.  Fast free-form deformation using graphics processing units , 2010, Comput. Methods Programs Biomed..

[92]  Dinggang Shen,et al.  3D conditional generative adversarial networks for high-quality PET image estimation at low dose , 2018, NeuroImage.

[93]  Thomas E. Nichols,et al.  Extending the Human Connectome Project across ages: Imaging protocols for the Lifespan Development and Aging projects , 2018, NeuroImage.

[94]  Tao Tan,et al.  Denoising of 3D magnetic resonance images with multi-channel residual learning of convolutional neural network , 2017, Japanese Journal of Radiology.

[95]  Marianna D. Eddy,et al.  Regionally localized thinning of the cerebral cortex in schizophrenia , 2003, Schizophrenia Research.

[96]  Stamatios N. Sotiropoulos,et al.  An integrated approach to correction for off-resonance effects and subject movement in diffusion MR imaging , 2016, NeuroImage.

[97]  Birte U. Forstmann,et al.  Denoising High-Field Multi-Dimensional MRI With Local Complex PCA , 2019, bioRxiv.

[98]  A M Dale,et al.  Measuring the thickness of the human cerebral cortex from magnetic resonance images. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[99]  H. Heinze,et al.  Laminar activity in the hippocampus and entorhinal cortex related to novelty and episodic encoding , 2014, Nature Communications.

[100]  R. Gruetter,et al.  Retrospective correction of involuntary microscopic head movement using highly accelerated fat image navigators (3D FatNavs) at 7T , 2016, Magnetic resonance in medicine.

[101]  Lachlan T. Strike,et al.  Cortical abnormalities in adults and adolescents with major depression based on brain scans from 20 cohorts worldwide in the ENIGMA Major Depressive Disorder Working Group , 2016, Molecular Psychiatry.

[102]  Florian Jug,et al.  Noise2Void - Learning Denoising From Single Noisy Images , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[103]  Jia Guo,et al.  Deep learning and multi-contrast-based denoising for low-SNR Arterial Spin Labeling (ASL) MRI , 2020, Medical Imaging: Image Processing.

[104]  Mert R. Sabuncu,et al.  Measuring and comparing brain cortical surface area and other areal quantities , 2012, NeuroImage.

[105]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[106]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[107]  Greg Zaharchuk,et al.  Ultra-low-dose PET reconstruction using generative adversarial network with feature matching and task-specific perceptual loss. , 2019, Medical physics.

[108]  Luc Van Gool,et al.  NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[109]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[110]  Daniel K Sodickson,et al.  Assessment of the generalization of learned image reconstruction and the potential for transfer learning , 2019, Magnetic resonance in medicine.

[111]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[112]  Rolf Gruetter,et al.  Studying cyto and myeloarchitecture of the human cortex at ultra-high field with quantitative imaging: R1, R2 * and magnetic susceptibility , 2017, NeuroImage.

[113]  Jonathan R. Polimeni,et al.  Advantages of cortical surface reconstruction using submillimeter 7 T MEMPRAGE , 2018, NeuroImage.

[114]  Bruce Fischl,et al.  Geometrically Accurate Topology-Correction of Cortical Surfaces Using Nonseparating Loops , 2007, IEEE Transactions on Medical Imaging.

[115]  Rainer Goebel,et al.  BrainVoyager — Past, present, future , 2012, NeuroImage.

[116]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[117]  K. T. Block,et al.  Undersampled radial MRI with multiple coils. Iterative image reconstruction using a total variation constraint , 2007, Magnetic resonance in medicine.

[118]  Xiaofei Wang,et al.  A Deep Learning Approach to Denoise Optical Coherence Tomography Images of the Optic Nerve Head , 2018, Scientific Reports.

[119]  Juliane Dinse,et al.  A computational framework for ultra-high resolution cortical segmentation at 7Tesla , 2014, NeuroImage.

[120]  Junshen Xu,et al.  Ultra-low-dose 18F-FDG brain PET/MR denoising using deep learning and multi-contrast information , 2020, Medical Imaging: Image Processing.

[121]  Timothy S. Coalson,et al.  Parcellations and hemispheric asymmetries of human cerebral cortex analyzed on surface-based atlases. , 2012, Cerebral cortex.

[122]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[123]  Kawin Setsompop,et al.  Improving in vivo human cerebral cortical surface reconstruction using data-driven super-resolution. , 2020, Cerebral cortex.

[124]  Claudine Joëlle Gauthier,et al.  Cortical lamina-dependent blood volume changes in human brain at 7T , 2015, NeuroImage.

[125]  Essa Yacoub,et al.  The Lifespan Human Connectome Project in Development: A large-scale study of brain connectivity development in 5–21 year olds , 2018, NeuroImage.

[126]  A. Singleton,et al.  The Parkinson Progression Marker Initiative (PPMI) , 2011, Progress in Neurobiology.

[127]  Guido Gerig,et al.  Nonlinear anisotropic filtering of MRI data , 1992, IEEE Trans. Medical Imaging.

[128]  Alex Martin,et al.  Age-related temporal and parietal cortical thinning in autism spectrum disorders. , 2010, Brain : a journal of neurology.

[129]  Lovedeep Gondara,et al.  Medical Image Denoising Using Convolutional Denoising Autoencoders , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[130]  O. Abe,et al.  Utility of real-time prospective motion correction (PROMO) on 3D T1-weighted imaging in automated brain structure measurements , 2016, Scientific Reports.

[131]  James Demmel,et al.  Fast $\ell_1$ -SPIRiT Compressed Sensing Parallel Imaging MRI: Scalable Parallel Implementation and Clinically Feasible Runtime , 2012, IEEE Transactions on Medical Imaging.