Intrinsic Patch-Based Cortical Anatomical Parcellation Using Graph Convolutional Neural Network on Surface Manifold

Automatic parcellation of cortical surfaces into anatomically meaningful regions of interest (ROIs) is of great importance in brain analysis. Due to the complex shape of the convoluted cerebral cortex, conventional methods generally require three steps to obtain the parcellations. First, the original cortical surface is iteratively inflated and mapped onto a spherical surface with minimal metric distortion, for providing a simpler shape for analysis. Then, a registration or learning-based labeling method is adopted to parcellate ROIs on the mapped spherical surface. Finally, parcellation labels on the spherical surface are mapped back to the original cortical surface. Despite great success, spherical mapping of the original cortical surface is inherently sensitive to topological noise and cannot deal with the impaired brains that violate spherical topology. To address these issues, in this paper, we propose to directly parcellate the cerebral cortex on the original cortical surface manifold without requiring spherical mapping, by leveraging the strong learning ability of the graph convolutional neural networks. Also, we extend the convolution to the surface manifold using the kernel strategy, which enables us to over-come the notorious shape difference issue (e.g., different vertex number and connections) across different subjects. Our method aims to learn the highly nonlinear mapping between cortical attribute patterns (on local intrinsic surface patches) and parcellation labels. We have validated our method on a normal cortical surface dataset and a synthetic dataset with impaired brains, which shows that our method achieves comparable accuracy to the methods using spherical mapping, and works well on cortical surfaces violating the spherical topology.

[1]  Anders M. Dale,et al.  An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest , 2006, NeuroImage.

[2]  Dinggang Shen,et al.  Registration-Free Infant Cortical Surface Parcellation Using Deep Convolutional Neural Networks , 2018, MICCAI.

[3]  Christian Desrosiers,et al.  Graph Convolutions on Spectral Embeddings for Cortical Surface Parcellation , 2019, Medical Image Anal..

[4]  Jonathan Masci,et al.  Geometric Deep Learning on Graphs and Manifolds Using Mixture Model CNNs , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Lok Ming Lui,et al.  FLASH: Fast Landmark Aligned Spherical Harmonic Parameterization for Genus-0 Closed Brain Surfaces , 2015, SIAM J. Imaging Sci..

[6]  Dinggang Shen,et al.  Spherical U-Net on Cortical Surfaces: Methods and Applications , 2019, IPMI.

[7]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[8]  Yoshua Bengio,et al.  Convolutional neural networks for mesh-based parcellation of the cerebral cortex , 2018 .

[9]  Joseph S. B. Mitchell,et al.  The Discrete Geodesic Problem , 1987, SIAM J. Comput..

[10]  Dinggang Shen,et al.  Computational neuroanatomy of baby brains: A review , 2019, NeuroImage.

[11]  Dinggang Shen,et al.  Consistent sulcal parcellation of longitudinal cortical surfaces , 2011, NeuroImage.

[12]  Dinggang Shen,et al.  Construction of spatiotemporal neonatal cortical surface atlases using a large-scale dataset , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[13]  A. Dale,et al.  High‐resolution intersubject averaging and a coordinate system for the cortical surface , 1999, Human brain mapping.

[14]  Frithjof Kruggel,et al.  Automatic segmentation of human brain sulci , 2008, Medical Image Anal..