3D Convolutional Sequence to Sequence Model for Vertebral Compression Fractures Identification in CT

An osteoporosis-related fracture occurs every three seconds worldwide, affecting one in three women and one in five men aged over 50. The early detection of at-risk patients facilitates effective and well-evidenced preventative interventions, reducing the incidence of major osteoporotic fractures. In this study, we present an automatic system for identification of vertebral compression fractures on Computed Tomography images, which are often an undiagnosed precursor to major osteoporosis-related fractures. The system integrates a compact 3D representation of the spine, utilizing a Convolutional Neural Network (CNN) for spinal cord detection and a novel end-to-end sequence to sequence 3D architecture. We evaluate several model variants that exploit different representation and classification approaches and present a framework combining an ensemble of models that achieves state of the art results, validated on a large data set, with a patient-level fracture identification of 0.955 Area Under the Curve (AUC). The system proposed has the potential to support osteoporosis clinical management, improve treatment pathways, and to change the course of one of the most burdensome diseases of our generation.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Niklas Zethraeus,et al.  Intervention thresholds for osteoporosis in the UK. , 2005, Bone.

[3]  Eitan Bachmat,et al.  Automated opportunistic osteoporotic fracture risk assessment using computed tomography scans to aid in FRAX underutilization , 2020, Nature Medicine.

[4]  Amir Bar,et al.  Improved ICH Classification Using Task-Dependent Learning , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[5]  David Chettrit,et al.  PHT-bot: a deep learning based system for automatic risk stratification of COPD patients based upon signs of pulmonary hypertension , 2019, Medical Imaging.

[6]  O. Johnell,et al.  An estimate of the worldwide prevalence and disability associated with osteoporotic fractures , 2006, Osteoporosis International.

[7]  Nicola Sverzellati,et al.  Incidental vertebral compression fractures in imaging studies: Lessons not learned by radiologists. , 2010, World journal of radiology.

[8]  M. Nevitt,et al.  Vertebral fracture assessment using a semiquantitative technique , 1993, Journal of bone and mineral research : the official journal of the American Society for Bone and Mineral Research.

[9]  O. Johnell,et al.  Long-Term Risk of Osteoporotic Fracture in Malmö , 2000, Osteoporosis International.

[10]  Perry J Pickhardt,et al.  Unreported vertebral body compression fractures at abdominal multidetector CT. , 2013, Radiology.

[11]  Dirk Vandermeulen,et al.  Detection of vertebral fractures in CT using 3D Convolutional Neural Networks , 2019, CSI@MICCAI.

[12]  Marcello Henrique Nogueira-Barbosa,et al.  BGrowth: an efficient approach for the segmentation of vertebral compression fractures in magnetic resonance imaging , 2019, SAC.

[13]  Jan S. Kirschke,et al.  Btrfly Net: Vertebrae Labelling with Energy-based Adversarial Learning of Local Spine Prior , 2018, MICCAI.

[14]  Lior Wolf,et al.  Compression fractures detection on CT , 2017, Medical Imaging.

[15]  Hao Chen,et al.  Automatic Localization and Identification of Vertebrae in Spine CT via a Joint Learning Model with Deep Neural Networks , 2015, MICCAI.

[16]  Francisco Casacuberta,et al.  A Neural, Interactive-predictive System for Multimodal Sequence to Sequence Tasks , 2019, ACL.

[17]  O. Johnell,et al.  Prevalent vertebral deformities predict increased mortality and increased fracture rate in both men and women: A 10-year population-based study of 598 individuals from the Swedish cohort in the European Vertebral Osteoporosis Study , 2003, Osteoporosis International.

[18]  B. Edwards,et al.  Prior Fractures are Common in Patients with Subsequent Hip Fractures , 2007, Clinical orthopaedics and related research.

[19]  W. Marsden I and J , 2012 .

[20]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Alex Sherstinsky,et al.  Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network , 2018, Physica D: Nonlinear Phenomena.

[22]  Eli Goz,et al.  TextRay: Mining Clinical Reports to Gain a Broad Understanding of Chest X-rays , 2018, MICCAI.

[23]  A Valentinitsch,et al.  Opportunistic osteoporosis screening in multi-detector CT images via local classification of textures , 2019, Osteoporosis International.

[24]  Berkman Sahiner,et al.  3D convolutional neural network for automatic detection of lung nodules in chest CT , 2017, Medical Imaging.

[25]  A. Krishnaraj,et al.  Simulating Dual-Energy X-Ray Absorptiometry in CT Using Deep-Learning Segmentation Cascade. , 2019, Journal of the American College of Radiology : JACR.

[26]  Saeed Hassanpour,et al.  Deep neural networks for automatic detection of osteoporotic vertebral fractures on CT scans , 2018, Comput. Biol. Medicine.

[27]  R. Whitehouse,et al.  Under-reporting of osteoporotic vertebral fractures on computed tomography. , 2009, European journal of radiology.

[28]  Jiri Chmelik,et al.  Learning-based vertebra localization and labeling in 3D CT data of possibly incomplete and pathological spines , 2020, Comput. Methods Programs Biomed..