A vertebral level-wise data augmentation scheme for segmentation via deep learning

Accurate vertebral segmentation is important for image-related assessment of spine pathologies. Recent spine segmentation techniques focus on deep learning-based methods. However, they typically require a large training dataset with accurate annotations, which may not be feasible in practice. To mitigate the challenge, here we propose a data augmentation scheme based on a single spine to incorporate biomechanically constrained intervertebral motion (rotation and translation) to generate a large training dataset (N=3000). Vertebrae are then segmented using a point cloud-based deep learning architecture, PointNet++, which appears not to have been applied to spine segmentation before. Spine testing samples (N=90) are first generated by applying our data augmentation technique to three separate spines. Segmentation performances are compared with two baseline data augmentation methods that do not include intervertebral motion. Then, we further evaluate our technique based on 8 spine samples from actual image acquisitions. In both cases, we show that incorporation of vertebral level-wise data augmentation improves segmentation accuracy in terms of mean Dice coefficient (e.g., 0.932 vs. 0.902 for augmented testing samples and 0.940 vs. 0.924 for acquired testing samples). These results suggest that our vertebral level-wise data augmentation is useful to facilitate deep learning-based spine segmentation, which is important especially when it is not feasible to generate accurate annotations for a large number of training samples.

[1]  Shiming Xiang,et al.  Relation-Shape Convolutional Neural Network for Point Cloud Analysis , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Li Cheng,et al.  Automatic generation of pedicle contours in 3D vertebral models , 2019, Comput. Biol. Medicine.

[3]  Keith D. Paulsen,et al.  Automatic geometric rectification for patient registration in image-guided spinal surgery , 2016, SPIE Medical Imaging.

[4]  Chengwen Chu,et al.  Fully Automatic Localization and Segmentation of 3D Vertebral Bodies from CT/MR Images via a Learning-Based Method , 2015, PloS one.

[5]  Keith D. Paulsen,et al.  Intraoperative CT as a registration benchmark for intervertebral motion compensation in image-guided open spinal surgery , 2015, International Journal of Computer Assisted Radiology and Surgery.

[6]  H. Wilke,et al.  Biomechanical in vitro evaluation of the complete porcine spine in comparison with data of the human spine , 2011, European Spine Journal.

[7]  Hao Chen,et al.  Automatic Localization and Identification of Vertebrae in Spine CT via a Joint Learning Model with Deep Neural Networks , 2015, MICCAI.

[8]  Cristian Lorenz,et al.  Automated model-based vertebra detection, identification, and segmentation in CT images , 2009, Medical Image Anal..

[9]  H. An,et al.  Imaging in Spine Surgery: Current Concepts and Future Directions , 2019, Spine surgery and related research.

[10]  Leonidas J. Guibas,et al.  PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space , 2017, NIPS.

[11]  W. Wells,et al.  Deep Learning–Based Automatic Segmentation of Lumbosacral Nerves on CT for Spinal Intervention: A Translational Study , 2019, American Journal of Neuroradiology.

[12]  Nikolas Lessmann,et al.  Iterative fully convolutional neural networks for automatic vertebra segmentation and identification , 2018, Medical Image Anal..

[13]  Alejandro F. Frangi,et al.  Statistical Interspace Models (SIMs): Application to Robust 3D Spine Segmentation , 2015, IEEE Transactions on Medical Imaging.

[14]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jiebo Luo,et al.  Joint Vertebrae Identification and Localization in Spinal CT Images by Combining Short- and Long-Range Contextual Information , 2018, IEEE Transactions on Medical Imaging.

[16]  R. Irwan,et al.  Measurement of angular and linear segmental lumbar spine flexion-extension motion by means of image registration , 2004, European Spine Journal.

[17]  Jan S. Kirschke,et al.  Probabilistic Point Cloud Reconstructions for Vertebral Shape Analysis , 2019, MICCAI.

[18]  Yue Wang,et al.  Dynamic Graph CNN for Learning on Point Clouds , 2018, ACM Trans. Graph..