Axial multi-layer perceptron architecture for automatic segmentation of choroid plexus in multiple sclerosis

Choroid plexuses (CP) are structures of the brain ventricles which produce most of the cerebrospinal fluid (CSF). Several postmortem and in vivo studies have pointed towards their role in the inflammatory processes in multiple sclerosis (MS). Automatic segmentation of CP from MRI thus has high value for studying their characteristics in large cohorts of patients. To the best of our knowledge, the only freely available tool for CP segmentation is FreeSurfer but its accuracy for this specific structure is poor. In this paper, we propose to automatically segment CP from non-contrast enhanced T1-weighted MRI. To that end, we introduce a new model called “Axial-MLP” based on an assembly of Axial multi-layer perceptrons (MLPs). This is inspired by recent works which showed that the self-attention layers of Transformers can be replaced with MLPs. This approach is systematically compared with a standard 3D U-Net, nnU-Net, Freesurfer and FastSurfer. For our experiments, we make use of a dataset of 141 subjects (44 controls and 97 patients with MS). We show that all the tested deep learning (DL) methods outperform FreeSurfer (Dice around 0.7 for DL vs 0.33 for FreeSurfer). Axial-MLP is competitive with U-Nets even though it is slightly less accurate. The conclusions of our paper are two-fold: 1) the studied deep learning methods could be useful tools to study CP in large cohorts of MS patients; 2) Axial-MLP is a potentially viable alternative to convolutional neural networks for such tasks, although it could benefit from further improvements.

[1]  Bruce Fischl,et al.  FreeSurfer , 2012, NeuroImage.

[2]  Daguang Xu,et al.  UNETR: Transformers for 3D Medical Image Segmentation , 2021, 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV).

[3]  Yan Wang,et al.  TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation , 2021, ArXiv.

[4]  Stephen Lin,et al.  Swin Transformer: Hierarchical Vision Transformer using Shifted Windows , 2021, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[5]  Jeong Hyun Lee,et al.  Choroid plexus changes on magnetic resonance imaging in multiple sclerosis and neuromyelitis optica spectrum disorder , 2020, Journal of the Neurological Sciences.

[6]  H. D. de Vries,et al.  Inflammation of the choroid plexus in progressive multiple sclerosis: accumulation of granulocytes and T cells , 2020, Acta Neuropathologica Communications.

[7]  Matthieu Cord,et al.  ResMLP: Feedforward Networks for Image Classification With Data-Efficient Training , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jonathan Tompson,et al.  Efficient object localization using Convolutional Networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Riitta Hari,et al.  Enlargement of choroid plexus in complex regional pain syndrome , 2015, Scientific Reports.

[10]  Alexander Kolesnikov,et al.  MLP-Mixer: An all-MLP Architecture for Vision , 2021, NeurIPS.

[11]  Ninon Burgos,et al.  Convolutional Neural Networks for Classification of Alzheimer's Disease: Overview and Reproducible Evaluation , 2019, Medical Image Anal..

[12]  M. Gollasch,et al.  Disturbed function of the blood–cerebrospinal fluid barrier aggravates neuro-inflammation , 2014, Acta Neuropathologica.

[13]  Klaus H. Maier-Hein,et al.  nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation , 2018, Bildverarbeitung für die Medizin.

[14]  D. Louis Collins,et al.  Unbiased average age-appropriate atlases for pediatric studies , 2011, NeuroImage.

[15]  Chunhua Shen,et al.  CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation , 2021, MICCAI.

[16]  Natalia Egorova,et al.  Choroid plexus volume after stroke , 2019, International journal of stroke : official journal of the International Stroke Society.

[17]  David C. Alsop,et al.  Choroid Plexus Segmentation Using Optimized 3D U-Net , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[18]  Johannes Ettl,et al.  MRI based neuroanatomical segmentation in breast cancer patients: leptomeningeal carcinomatosis vs. oligometastatic brain disease vs. multimetastastic brain disease , 2019, Radiation Oncology.

[19]  Ninon Burgos,et al.  Clinica: An Open-Source Software Platform for Reproducible Clinical Neuroscience Studies , 2018, Frontiers in Neuroinformatics.

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Sébastien Ourselin,et al.  TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learning , 2020, Comput. Methods Programs Biomed..

[22]  Á. Pascual-Leone,et al.  Improving Choroid Plexus Segmentation in the Healthy and Diseased Brain: Relevance for Tau-PET Imaging in Dementia. , 2020, Journal of Alzheimer's disease : JAD.

[23]  Georg Heigold,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2021, ICLR.

[24]  Luke Melas-Kyriazi,et al.  Do You Even Need Attention? A Stack of Feed-Forward Layers Does Surprisingly Well on ImageNet , 2021, ArXiv.

[25]  Geoffrey E. Hinton,et al.  Layer Normalization , 2016, ArXiv.

[26]  C. Almli,et al.  Unbiased nonlinear average age-appropriate brain templates from birth to adulthood , 2009, NeuroImage.

[27]  Alberto Romagnolo,et al.  Involvement of the choroid plexus in multiple sclerosis autoimmune inflammation: A neuropathological study , 2008, Journal of Neuroimmunology.

[28]  C. Louapre,et al.  Choroid Plexus Enlargement in Inflammatory Multiple Sclerosis: 3.0-T MRI and Translocator Protein PET Evaluation. , 2021, Radiology.

[29]  M. Béné,et al.  CHOROID PLEXUS, AGEING OF THE BRAIN, AND ALZHEIMER'S DISEASE , 2003 .

[30]  Andrea Vedaldi,et al.  Instance Normalization: The Missing Ingredient for Fast Stylization , 2016, ArXiv.

[31]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[32]  Á. Pascual-Leone,et al.  Choroid plexus volume is associated with levels of CSF proteins: relevance for Alzheimer's and Parkinson's disease , 2020, Neurobiology of Aging.

[33]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[34]  J. Gee,et al.  The Insight ToolKit image registration framework , 2014, Front. Neuroinform..

[35]  B. Fischl,et al.  FastSurfer - A fast and accurate deep learning based neuroimaging pipeline , 2019, NeuroImage.

[36]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[37]  Tim Salimans,et al.  Axial Attention in Multidimensional Transformers , 2019, ArXiv.

[38]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[39]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.