Grey Matter Segmentation in Spinal Cord MRIs via 3D Convolutional Encoder Networks with Shortcut Connections

Segmentation of grey matter in magnetic resonance images of the spinal cord is an important step in assessing disease state in neurological disorders such as multiple sclerosis. However, manual delineation of spinal cord tissue is time-consuming and susceptible to variability introduced by the rater. We present a novel segmentation method for spinal cord tissue that uses fully convolutional encoder networks (CENs) for direct end-to-end training and includes shortcut connections to combine multi-scale features, similar to a u-net. While CENs with shortcuts have been used successfully for brain tissue segmentation, spinal cord images have very different features, and therefore deserve their own investigation. In particular, we develop the methodology by evaluating the impact of the number of layers, filter sizes, and shortcuts on segmentation accuracy in standard-resolution cord MRIs. This deep learning-based method is trained on data from a recent public challenge, consisting of 40 MRIs from 4 unique scan sites, with each MRI having 4 manual segmentations from 4 expert raters, resulting in a total of 160 image-label pairs. Performance of the method is evaluated using an independent test set of 40 scans and compared against the challenge results. Using a comprehensive suite of performance metrics, including the Dice similarity coefficient (DSC) and Jaccard index, we found shortcuts to have the strongest impact (0.60 to 0.80 in DSC), while filter size (0.76 to 0.80) and the number of layers (0.77 to 0.80) are also important considerations. Overall, the method is highly competitive with other state-of-the-art methods.

[1]  Kesshi M Jordan,et al.  Spinal cord gray matter atrophy correlates with multiple sclerosis disability , 2014, Annals of neurology.

[2]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[3]  Ludwig Kappos,et al.  Relevance of spinal cord abnormalities to clinical disability in multiple sclerosis: MR imaging findings in a large cohort of patients. , 2013, Radiology.

[4]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[5]  Julien Cohen-Adad,et al.  Spinal cord grey matter segmentation challenge , 2017, NeuroImage.

[6]  Julien Cohen-Adad,et al.  SCT: Spinal Cord Toolbox, an open-source software for processing spinal cord MRI data , 2017, NeuroImage.

[7]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[10]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[11]  Lisa Tang,et al.  Deep Convolutional Encoder Networks for Multiple Sclerosis Lesion Segmentation , 2015, MICCAI.

[12]  Graham W. Taylor,et al.  Adaptive deconvolutional networks for mid and high level feature learning , 2011, 2011 International Conference on Computer Vision.

[13]  R. Bakshi,et al.  Measurement of Brain and Spinal Cord Atrophy by Magnetic Resonance Imaging as a Tool to Monitor Multiple Sclerosis , 2005, Journal of neuroimaging : official journal of the American Society of Neuroimaging.