Hierarchically Spatial Encoding Module for Chronic Stroke Lesion Segmentation

Since stroke is still the leading cause of death worldwide, neuroimaging research to investigate the mechanism under the brain reorganization and rehabilitation is becoming predominant. In such areas, lesion delineation is a critical step and manual tracing is the gold standard so far, but it is time-consuming and readily influenced by bias. In this work, we propose a volumetric convolutional neural network for lesion segmentation with a novel and well-motivated Hierarchically Spatial Encoding Module (HSEM) based on Recurrent Neural Network (RNN). The proposed HSEM leverages the inherent spatial characteristics of the human brain by encoding the context from various dimensions hierarchically, therefore enhancing the segmentation results. We evaluate our approach on a fresh-new benchmark data set ATLAS. Our method achieves the F1-score of 66.07%, precision of 69.32%, recall of 67.6%, and obtains superior performance compared with other state-of-the-arts. The experiments prove that our proposed module has strong robustness when embedded into the neural network structure and further verify the module can mimic the human brain to make a diagnostic decision with the existence of inherent anisotropy and spatial properties. Furthermore, our model has the potential to provide finer lesion segmentation in some cases where the lesion is not annotated by experts perfectly.

[1]  Anil F. Ramlackhansingh,et al.  Lesion identification using unified segmentation-normalisation models and fuzzy clustering , 2008, NeuroImage.

[2]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[3]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[4]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[5]  Lei Ai,et al.  A large, open source dataset of stroke anatomical brain images and manual lesion segmentations , 2017, Scientific Data.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[8]  Joseph C. Griffis,et al.  Voxel-based Gaussian naïve Bayes classification of ischemic stroke lesions in individual T1-weighted MRI scans , 2016, Journal of Neuroscience Methods.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Brian Avants,et al.  Automated segmentation of chronic stroke lesions using LINDA: Lesion identification with neighborhood data analysis , 2016, Human brain mapping.

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.