Morphological Simplification of Brain MR Images by Deep Learning for Facilitating Deformable Registration

Brain MR image registration is challenging due to the large inter-subject anatomical variation. Especially, the highly convoluted brain cortex makes it difficult to accurately align the corresponding structures of the underlying images. In this paper, we propose a novel deep learning strategy to simplify the image registration task. Specifically, we train a morphological simplification network (MS-Net), which can generate a simplified image with fewer anatomical details given a complex input image. With this trained MS-Net, we can reduce the complexity of both the fixed and the moving images and iteratively derive their respective trajectories of gradually simplified images. The generated images at the ends of the two trajectories are so simple that they are very similar in appearance and morphology and thus easy to register. In this way, these two trajectories can act as a bridge to link the fixed and the moving images and guide their registration. Our experiments show that the proposed method can achieve more accurate registration results than state-of-the-art methods. Moreover, the proposed method can be generalized to the unseen dataset without the need for re-training or domain adaptation.

[1]  Dinggang Shen,et al.  Cross-Manifold Guidance in Deformable Registration of Brain MR Images , 2016, MIAR.

[2]  Paul M. Thompson,et al.  Surface-Constrained Volumetric Brain Registration Using Harmonic Mappings , 2007, IEEE Transactions on Medical Imaging.

[3]  Dinggang Shen,et al.  Predict brain MR image registration via sparse learning of appearance and transformation , 2015, Medical Image Anal..

[4]  Pingkun Yan,et al.  Deep learning in medical image registration: a survey , 2020, Machine Vision and Applications.

[5]  Christos Davatzikos,et al.  GRAM: A framework for geodesic registration on anatomical manifolds , 2010, Medical Image Anal..

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[8]  Imran A. Pirwani,et al.  Introduction to the Non-rigid Image Registration Evaluation Project (NIREP) , 2006, WBIR.

[9]  Tom Vercauteren,et al.  Diffeomorphic demons: Efficient non-parametric image registration , 2009, NeuroImage.

[10]  Dinggang Shen,et al.  HAMMER: hierarchical attribute matching mechanism for elastic registration , 2002, IEEE Transactions on Medical Imaging.

[11]  Mert R. Sabuncu,et al.  An Unsupervised Learning Model for Deformable Medical Image Registration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Alain Trouvé,et al.  Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms , 2005, International Journal of Computer Vision.

[13]  Dinggang Shen,et al.  Deformable Image Registration Using a Cue-Aware Deep Regression Network , 2018, IEEE Transactions on Biomedical Engineering.

[14]  Gabriel Taubin,et al.  Curve and surface smoothing without shrinkage , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.