Automatic Segmentation of the Scoliotic Spine from Mr Images

Segmenting vertebral bodies (VBs) and intervertebral discs (IVDs) in magnetic resonance imaging (MRI) data is an important step towards the creation of 3D spine models for image-guided surgical treatement of adolescent idiopathic scoliosis (AIS). Recent advances in deep learning have established state-of-the-art results in medical image segmentation. Thus, in this paper, we present a method based on convolutional neural networks to simultaneously segment VBs and IVDs in MRI data sets of AIS patients, a difficult problem which has not yet been adressed in the literature. Our architecure is inspired by the U-net architecture, combined with the recently proposed and promising squeeze-and-excitation (SE) block and an objective function incorporating Cohen’s kappa to deal with the imbalamce class problem. Our model is first trained using a public dataset of non-AIS patients, then fine tuned using a few images of AIS patients. Results in 8 test AIS patient MRI volumes show that the fine tuning and SE strategies both improve segmentation considerably while remaining highly complementary to each other.

[1]  Serge J. Belongie,et al.  Normalized cuts in 3-D for spinal MRI segmentation , 2004, IEEE Transactions on Medical Imaging.

[2]  Kumaradevan Punithakumar,et al.  Vertebral Body Segmentation in MRI via Convex Relaxation and Distribution Matching , 2012, MICCAI.

[3]  Gang Sun,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[4]  Farida Cheriet,et al.  Texture Analysis for Automatic Segmentation of Intervertebral Disks of Scoliotic Spines From MR Images , 2009, IEEE Transactions on Information Technology in Biomedicine.

[5]  Nassir Navab,et al.  Recalibrating Fully Convolutional Networks With Spatial and Channel “Squeeze and Excitation” Blocks , 2018, IEEE Transactions on Medical Imaging.

[6]  Chengwen Chu,et al.  Fully Automatic Localization and Segmentation of 3D Vertebral Bodies from CT/MR Images via a Learning-Based Method , 2015, PloS one.

[7]  Arie Ben-David,et al.  Comparison of classification accuracy using Cohen's Weighted Kappa , 2008, Expert Syst. Appl..

[8]  Hao Chen,et al.  3D multi‐scale FCN with random modality voxel dropout learning for Intervertebral Disc Localization and Segmentation from Multi‐modality MR Images , 2018, Medical Image Anal..

[9]  Bostjan Likar,et al.  Model-Based Segmentation of Vertebral Bodies from MR Images with 3D CNNs , 2016, MICCAI.

[10]  Chengwen Chu,et al.  Localization and Segmentation of 3D Intervertebral Discs in MR Images by Data Driven Estimation , 2015, IEEE Transactions on Medical Imaging.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Shuo Li,et al.  Graph Cuts with Invariant Object-Interaction Priors: Application to Intervertebral Disc Segmentation , 2011, IPMI.

[13]  Lena Costaridou,et al.  Atlas-Based Segmentation of Degenerated Lumbar Intervertebral Discs From MR Images of the Spine , 2009, IEEE Transactions on Biomedical Engineering.

[14]  S Crozier,et al.  Automated detection, 3D segmentation and analysis of high resolution spine MR images using statistical shape models , 2012, Physics in medicine and biology.

[15]  Hao Chen,et al.  3D Fully Convolutional Networks for Intervertebral Disc Localization and Segmentation , 2016, MIAR.