Automated Image Registration Quality Assessment Utilizing Deep-learning based Ventricle Extraction in Clinical Data

Registration is a core component of many imaging pipelines. In case of clinical scans, with lower resolution and sometimes substantial motion artifacts, registration can produce poor results. Visual assessment of registration quality in large clinical datasets is inefficient. In this work, we propose to automatically assess the quality of registration to an atlas in clinical FLAIR MRI scans of the brain. The method consists of automatically segmenting the ventricles of a given scan using a neural network, and comparing the segmentation to the atlas ventricles propagated to image space. We used the proposed method to improve clinical image registration to a general atlas by computing multiple registrations one directly to the general atlas and others via different agespecific atlases and then selecting the registration that yielded the highest ventricle overlap. Finally, as an example application of the complete pipeline, a voxelwise map of white matter hyperintensity burden was computed using only the scans with registration quality above a predefined threshold. Methods were evaluated in a single-site dataset of more than 1000 scans, as well as a multicenter dataset comprising 142 clinical scans from 12 sites. The automated ventricle segmentation reached a Dice coefficient with manual annotations of 0.89 in the single-site dataset, and 0.83 in the multi-center dataset. Registration via age-specific atlases could improve ventricle overlap compared to a direct registration to the general atlas (Dice similarity coefficient increase up to 0.15). Experiments also showed that selecting scans with the registration quality assessment method could improve the quality of average maps of white matter hyperintensity burden, instead of using all scans for the computation of the white matter hyperintensity map. In this work, we demonstrated the utility of an automated tool for assessing image registration quality in clinical scans. This image quality assessment step could ultimately assist in the translation of automated neuroimaging pipelines to the clinic.

[1]  Marleen de Bruijne,et al.  Grey Matter Age Prediction as a Biomarker for Risk of Dementia: A Population-based Study , 2019, bioRxiv.

[2]  W. Eric L. Grimson,et al.  A Bayesian model for joint segmentation and registration , 2006, NeuroImage.

[3]  Anthony J. Yezzi,et al.  A variational framework for integrating segmentation and registration through active contours , 2003, Medical Image Anal..

[4]  Carole Dufouil,et al.  Distribution of white matter hyperintensity in cerebral hemorrhage and healthy aging , 2012, Journal of Neurology.

[5]  Mert R. Sabuncu,et al.  VoxelMorph: A Learning Framework for Deformable Medical Image Registration , 2018, IEEE Transactions on Medical Imaging.

[6]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Aamer Aziz,et al.  A knowledge-driven algorithm for a rapid and automatic extraction of the human cerebral ventricular system from MR neuroimages , 2004, NeuroImage.

[8]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[9]  Geraint Rees,et al.  Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy , 2018, ArXiv.

[10]  S. Javeed Hussain,et al.  Detection of Hydrocephalus Lateral Ventricles Quantitatively in Brain MRI images of Infants , 2013 .

[11]  Polina Golland,et al.  Design and rationale for examining neuroimaging genetics in ischemic stroke , 2017, Neurology: Genetics.

[12]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[13]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[14]  Marco Ganzetti,et al.  A Spatial Registration Toolbox for Structural MR Imaging of the Aging Brain , 2018, Neuroinformatics.

[15]  Joanna M. Wardlaw,et al.  Whole Brain Magnetic Resonance Image Atlases: A Systematic Review of Existing Atlases and Caveats for Use in Population Imaging , 2017, Front. Neuroinform..

[16]  Y. Chen,et al.  Image registration via level-set motion: Applications to atlas-based segmentation , 2003, Medical Image Anal..

[17]  Pankaj Sharma,et al.  White Matter Hyperintensity Quantification in Large-Scale Clinical Acute Ischemic Stroke Cohorts – The MRI-GENIE Study , 2019 .

[18]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[19]  Lisa Cloonan,et al.  Determinants of white matter hyperintensity burden differ at the extremes of ages of ischemic stroke onset. , 2015, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[20]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[21]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[22]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[23]  Y. W. Chen,et al.  Progression of white matter lesions and hemorrhages in cerebral amyloid angiopathy , 2006, Neurology.

[24]  Carole Dufouil,et al.  Cerebral White Matter Lesions Are Associated With the Risk of Stroke But Not With Other Vascular Events: The 3-City Dijon Study , 2009, Stroke.

[25]  Brahim Harbaoui,et al.  Recurrent vertigo is a predictor of stroke in a large cohort of hypertensive patients , 2019, Journal of hypertension.

[26]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[27]  W E Wilkinson,et al.  Cortical atrophy, ventricular enlargement and intellectual impairment in the aged , 1979, Neurology.

[28]  Suresh Venkatasubramanian,et al.  The geometric median on Riemannian manifolds with application to robust atlas estimation , 2009, NeuroImage.

[29]  Pankaj Sharma,et al.  White matter hyperintensity quantification in large-scale clinical acute ischemic stroke cohorts – The MRI-GENIE study , 2019, NeuroImage: Clinical.

[30]  Christos Davatzikos,et al.  Population-based MRI atlases of spatial distribution are specific to patient and tumor characteristics in glioblastoma , 2016, NeuroImage: Clinical.

[31]  Aaron Carass,et al.  Brain ventricle parcellation using a deep neural network: Application to patients with ventriculomegaly , 2019, NeuroImage: Clinical.

[32]  Sébastien Ourselin,et al.  GAS: A genetic atlas selection strategy in multi‐atlas segmentation framework , 2019, Medical Image Anal..

[33]  Snehashis Roy,et al.  MR to CT registration of brains using image synthesis , 2014, Medical Imaging.

[34]  Kuncheng Li,et al.  Construction of brain atlases based on a multi-center MRI dataset of 2020 Chinese adults , 2015, Scientific Reports.

[35]  Hamid Krim,et al.  Multiphase Joint Segmentation-Registration and Object Tracking for Layered Images , 2010, IEEE Transactions on Image Processing.

[36]  Anders M. Dale,et al.  Consistent neuroanatomical age-related volume differences across multiple samples , 2011, Neurobiology of Aging.

[37]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[38]  Paul A. Yushkevich,et al.  Multi-Atlas Segmentation with Joint Label Fusion , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Claudia Sommer,et al.  Determinants of white matter hyperintensity burden in patients with Fabry disease , 2016, Neurology.

[40]  Nico Karssemeijer,et al.  Student beats the teacher: deep neural networks for lateral ventricles segmentation in brain MR , 2018, Medical Imaging.

[41]  Aaron Carass,et al.  Efficient multi-atlas registration using an intermediate template image , 2017, Medical Imaging.

[42]  John E. Richards,et al.  Age-specific MRI brain and head templates for healthy adults from 20 through 89 years of age , 2015, Front. Aging Neurosci..

[43]  Zoran Stankovic,et al.  Real-Time 3D Ultrasound Guided Interventional System for Cardiac Stem Cell Therapy with Motion Compensation , 2011, MICCAI.

[44]  J. Sarvaiya,et al.  Image Registration by Template Matching Using Normalized Cross-Correlation , 2009, 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies.

[45]  D. Rueckert,et al.  White matter hyperintensity and stroke lesion segmentation and differentiation using convolutional neural networks , 2017, NeuroImage: Clinical.

[46]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[47]  Guido Gerig,et al.  Unbiased diffeomorphic atlas construction for computational anatomy , 2004, NeuroImage.

[48]  Carmen E Sanchez,et al.  Age-Specific MRI Templates for Pediatric Neuroimaging , 2012, Developmental neuropsychology.

[49]  Robert Zivadinov,et al.  Improved assessment of multiple sclerosis lesion segmentation agreement via detection and outline error estimates , 2012, BMC Medical Imaging.

[50]  Stefan Klein,et al.  Improving alignment in Tract-based spatial statistics: Evaluation and optimization of image registration , 2013, NeuroImage.

[51]  Jerry L. Prince,et al.  Large-scale parcellation of the ventricular system using convolutional neural networks , 2019, Medical Imaging.

[52]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[53]  Polina Golland,et al.  Patch-Based Discrete Registration of Clinical Brain Images , 2016, Patch-MI@MICCAI.

[54]  Panagiotis Fotiadis,et al.  Spatial signature of white matter hyperintensities in stroke patients , 2018 .