ERNet: Unsupervised Collective Extraction and Registration in Neuroimaging Data

Brain extraction and registration are important preprocessing steps in neuroimaging data analysis, where the goal is to extract the brain regions from MRI scans (ie extraction step) and align them with a target brain image (ie registration step). Conventional research mainly focuses on developing methods for the extraction and registration tasks separately under supervised settings. The performance of these methods highly depends on the amount of training samples and visual inspections performed by experts for error correction. However, in many medical studies, collecting voxel-level labels and conducting manual quality control in high-dimensional neuroimages (eg 3D MRI) are very expensive and time-consuming. Moreover, brain extraction and registration are highly related tasks in neuroimaging data and should be solved collectively. In this paper, we study the problem of unsupervised collective extraction and registration in neuroimaging data. We propose a unified end-to-end framework, called ERNet (Extraction-Registration Network), to jointly optimize the extraction and registration tasks, allowing feedback between them. Specifically, we use a pair of multi-stage extraction and registration modules to learn the extraction mask and transformation, where the extraction network improves the extraction accuracy incrementally and the registration network successively warps the extracted image until it is well-aligned with the target image. Experiment results on real-world datasets show that our proposed method can effectively improve the performance on extraction and registration tasks in neuroimaging data.

[1]  Hans J. Johnson,et al.  Advanced Normalization Tools (ANTs) , 2020 .

[2]  Yue Dong,et al.  Recursive Cascaded Networks for Unsupervised Medical Image Registration , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[3]  Richard Frayne,et al.  Convolutional neural networks for skull-stripping in brain MR imaging using silver standard masks , 2019, Artif. Intell. Medicine.

[4]  Hafiz Zia Ur Rehman,et al.  3D U-Net for Skull Stripping in Brain MRI , 2019, Applied Sciences.

[5]  Dinggang Shen,et al.  Deep Adversarial Learning for Multi-Modality Missing Data Completion , 2018, KDD.

[6]  Mert R. Sabuncu,et al.  An Unsupervised Learning Model for Deformable Medical Image Registration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Boudewijn P. F. Lelieveldt,et al.  Nonrigid Image Registration Using Multi-scale 3D Convolutional Neural Networks , 2017, MICCAI.

[8]  Richard Frayne,et al.  An open, multi-vendor, multi-field-strength brain MR dataset and analysis of publicly available skull stripping methods agreement , 2017, NeuroImage.

[9]  Philip S. Yu,et al.  Structural Deep Brain Network Mining , 2017, KDD.

[10]  Fei Wang,et al.  Unsupervised Network Discovery for Brain Imaging Data , 2017, KDD.

[11]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[12]  Max Jaderberg,et al.  Spatial Transformer Networks , 2015, NIPS.

[13]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Torsten Rohlfing,et al.  Image Similarity and Tissue Overlaps as Surrogates for Image Registration Accuracy: Widely Used but Unreliable , 2012, IEEE Transactions on Medical Imaging.

[16]  Vladimir S Fonov,et al.  BEaST: Brain extraction based on nonlocal segmentation technique , 2012, NeuroImage.

[17]  Paul M. Thompson,et al.  Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods , 2011, IEEE Transactions on Medical Imaging.

[18]  Jing Li,et al.  Mining brain region connectivity for alzheimer's disease study via sparse inverse covariance estimation , 2009, KDD.

[19]  Michael S. Beauchamp,et al.  A new method for improving functional-to-structural MRI alignment using local Pearson correlation , 2009, NeuroImage.

[20]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[21]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[22]  A. M. Dale,et al.  A hybrid approach to the skull stripping problem in MRI , 2004, NeuroImage.

[23]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[24]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[25]  Richard M. Leahy,et al.  BrainSuite: An Automated Cortical Surface Identification Tool , 2000, MICCAI.

[26]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[27]  John Boaz Lee,et al.  Dual-Attention Recurrent Networks for Affine Registration of Neuroimaging Data , 2020, SDM.